-- Logs begin at Thu 2022-06-23 00:49:12 UTC, end at Thu 2022-06-23 02:25:48 UTC. -- Jun 23 01:49:58.853751 dv-cinder-815582-9-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 23 01:49:58.861249 dv-cinder-815582-9-smb devstack@keystone.service[80416]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 23 01:49:58.863256 dv-cinder-815582-9-smb devstack@keystone.service[80416]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 01:49:58 2022] *** Jun 23 01:49:58.863256 dv-cinder-815582-9-smb devstack@keystone.service[80416]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 01:49:58.863256 dv-cinder-815582-9-smb devstack@keystone.service[80416]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 01:49:58.863256 dv-cinder-815582-9-smb devstack@keystone.service[80416]: nodename: dv-cinder-815582-9-smb Jun 23 01:49:58.863256 dv-cinder-815582-9-smb devstack@keystone.service[80416]: machine: x86_64 Jun 23 01:49:58.863256 dv-cinder-815582-9-smb devstack@keystone.service[80416]: clock source: unix Jun 23 01:49:58.863256 dv-cinder-815582-9-smb devstack@keystone.service[80416]: pcre jit disabled Jun 23 01:49:58.863256 dv-cinder-815582-9-smb devstack@keystone.service[80416]: detected number of CPU cores: 4 Jun 23 01:49:58.863760 dv-cinder-815582-9-smb devstack@keystone.service[80416]: current working directory: / Jun 23 01:49:58.863760 dv-cinder-815582-9-smb devstack@keystone.service[80416]: detected binary path: /usr/bin/uwsgi-core Jun 23 01:49:58.863760 dv-cinder-815582-9-smb devstack@keystone.service[80416]: your processes number limit is 47680 Jun 23 01:49:58.863760 dv-cinder-815582-9-smb devstack@keystone.service[80416]: your memory page size is 4096 bytes Jun 23 01:49:58.863760 dv-cinder-815582-9-smb devstack@keystone.service[80416]: detected max file descriptor number: 2048 Jun 23 01:49:58.863760 dv-cinder-815582-9-smb devstack@keystone.service[80416]: lock engine: pthread robust mutexes Jun 23 01:49:58.865583 dv-cinder-815582-9-smb devstack@keystone.service[80416]: thunder lock: enabled Jun 23 01:49:58.865583 dv-cinder-815582-9-smb devstack@keystone.service[80416]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 23 01:49:58.865583 dv-cinder-815582-9-smb devstack@keystone.service[80416]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 01:49:58.909426 dv-cinder-815582-9-smb devstack@keystone.service[80416]: Python main interpreter initialized at 0x560912e549c0 Jun 23 01:49:58.909426 dv-cinder-815582-9-smb devstack@keystone.service[80416]: python threads support enabled Jun 23 01:49:58.909426 dv-cinder-815582-9-smb devstack@keystone.service[80416]: your server socket listen backlog is limited to 100 connections Jun 23 01:49:58.909426 dv-cinder-815582-9-smb devstack@keystone.service[80416]: your mercy for graceful operations on workers is 90 seconds Jun 23 01:49:58.909778 dv-cinder-815582-9-smb devstack@keystone.service[80416]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 01:49:58.909981 dv-cinder-815582-9-smb devstack@keystone.service[80416]: *** Operational MODE: preforking *** Jun 23 01:49:58.910141 dv-cinder-815582-9-smb devstack@keystone.service[80416]: *** uWSGI is running in multiple interpreter mode *** Jun 23 01:49:58.910141 dv-cinder-815582-9-smb devstack@keystone.service[80416]: spawned uWSGI master process (pid: 80416) Jun 23 01:49:58.912305 dv-cinder-815582-9-smb devstack@keystone.service[80416]: spawned uWSGI worker 1 (pid: 80430, cores: 1) Jun 23 01:49:58.912305 dv-cinder-815582-9-smb devstack@keystone.service[80416]: spawned uWSGI worker 2 (pid: 80431, cores: 1) Jun 23 01:49:58.912305 dv-cinder-815582-9-smb devstack@keystone.service[80416]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 01:49:58.910352 dv-cinder-815582-9-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 23 01:50:04.340464 dv-cinder-815582-9-smb devstack@keystone.service[80430]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 01:50:04.340464 dv-cinder-815582-9-smb devstack@keystone.service[80430]: from cryptography.utils import int_from_bytes Jun 23 01:50:04.341281 dv-cinder-815582-9-smb devstack@keystone.service[80430]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 01:50:04.341281 dv-cinder-815582-9-smb devstack@keystone.service[80430]: from cryptography.utils import int_from_bytes Jun 23 01:50:04.363263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 01:50:04.363263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: from cryptography.utils import int_from_bytes Jun 23 01:50:04.363807 dv-cinder-815582-9-smb devstack@keystone.service[80431]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 01:50:04.363807 dv-cinder-815582-9-smb devstack@keystone.service[80431]: from cryptography.utils import int_from_bytes Jun 23 01:50:04.389613 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 01:50:04.389782 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 01:50:04.389979 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] command line args: [] {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 01:50:04.390246 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 01:50:04.390401 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ================================================================================ {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 01:50:04.390676 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] admin_token = **** {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.390918 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] config_dir = [] {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.391070 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.391281 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] config_source = [] {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.391433 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] debug = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.391666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.392035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.392157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.392450 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.392671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.392901 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] list_limit = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.393082 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] log_config_append = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.393255 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.393434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] log_dir = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.393609 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] log_file = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.393845 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.394076 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.394321 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.394564 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.394739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.394914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.395156 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.395470 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.395655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.395888 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.396126 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.396355 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.396601 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.396975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.397303 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.397954 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.398140 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] publish_errors = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.398376 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.398608 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.398786 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.399033 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.399268 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.399538 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] standard_threads = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.399771 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.400012 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.400186 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.400361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] use_journal = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.400534 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] use_json = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.400707 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] use_stderr = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.400882 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] use_syslog = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.401111 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.401370 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.401607 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.401865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.402103 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.402354 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.402593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.402842 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.403077 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.403323 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.403603 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.403855 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.404087 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.404331 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.404566 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.404812 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.405057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.405293 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.405548 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.405800 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.406044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.406279 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.406533 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.406792 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.407044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.407292 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.407546 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.407775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.408004 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.408237 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.408481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.408727 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.408953 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.409180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.409424 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.409672 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.409909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.410156 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.410386 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.410624 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.410857 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.411084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.411312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.411563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.411796 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.412029 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.412276 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.412799 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.413045 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.413278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.413513 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.413757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.414006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.414235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.414475 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.414712 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.414949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.415186 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.415458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.415677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.415927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.416160 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.416299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 01:50:04.416390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.416502 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 01:50:04.416615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.416699 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] command line args: [] {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 01:50:04.416875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.416952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 01:50:04.417112 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.417188 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ================================================================================ {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 01:50:04.417341 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.417421 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] admin_token = **** {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.417576 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.417656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] config_dir = [] {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.417776 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.417852 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.417960 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] config_source = [] {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.418067 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.418148 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] debug = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.418303 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.418455 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.418553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.418622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.418697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.418770 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.418954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.419030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.419199 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.419280 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.419445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] list_limit = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.419524 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.419613 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] log_config_append = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.419712 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.419787 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.419947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] log_dir = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.420025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.420122 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] log_file = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.420209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.420360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.420441 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.420604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.420678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.420846 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.420930 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.421077 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.421151 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.421250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.421324 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.421423 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.421532 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.421663 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.421793 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.421904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.422032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.422134 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.422271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.422364 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.422506 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.422580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.422747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.422829 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.422982 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.423056 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.423217 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.423291 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.423480 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.423696 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.423778 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.423931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.424014 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.424159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.424242 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] publish_errors = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.424392 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.424473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.424621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.424694 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.424798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.424879 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.425040 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.425123 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.425270 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.425349 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.425501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] standard_threads = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.425577 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.425731 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.425805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.425971 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.426051 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.426147 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.426249 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.426322 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] use_journal = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.426479 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] auth.external = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.426554 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] use_json = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.426650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] use_stderr = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.426731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.426822 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] use_syslog = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.426988 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.427063 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 01:50:04.427221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.427344 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.427473 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] auth.password = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.427572 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.427688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] auth.token = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.427788 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.427927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.428338 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.428699 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.428798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.428900 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.429007 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.429103 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.429225 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.429308 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.429427 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.429509 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.429586 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.429657 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.429768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.429841 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] credential.caching = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.429959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.430032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.430101 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.430211 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.430284 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.430393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.430519 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.430597 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.430759 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.430870 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.430993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.431078 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.431228 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.431303 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.431508 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.431590 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.431757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.431848 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.431998 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.432074 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.432243 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.432357 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.432499 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.432622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.432758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.432872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.433000 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.433072 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.433244 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.433327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.433474 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.433556 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] federation.caching = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.433704 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.433780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.433932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.434015 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.434165 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.434241 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.434407 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.434481 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.434653 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.434737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.434883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.434959 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.435110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.435185 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.435358 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.435462 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.435636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.435715 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.435873 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.435949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.436118 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.436264 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.436663 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.436743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] identity.caching = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.436889 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.436974 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.437123 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.437202 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.437353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.437430 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.437583 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.437657 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.437808 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.437882 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.438037 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.438114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.438271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.438345 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.438514 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.438588 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.438745 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.438823 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.438980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.439054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.439206 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.439280 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.439454 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.439533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.439689 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.439763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.439935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.440010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.440164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.440267 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.440405 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.440482 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.440639 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.440715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.440872 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.440948 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.441107 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.441191 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.441341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.441495 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.441576 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.441654 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.441789 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.441867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.442018 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.442094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.442252 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.442328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.442480 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.442563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.442716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.442792 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.442961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.443036 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.443187 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.443265 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.443430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.443518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.443717 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.443807 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.443949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.444024 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.444193 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.444259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.444446 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.444591 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.444674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.444838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.444915 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.445073 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.445149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.445309 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.445393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.445542 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.445618 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.445784 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.445858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.446016 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.446098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.446248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.446336 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.446488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.446567 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.446721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.446806 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.446947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.447023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.447174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.447250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.447405 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.447504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.447663 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.447745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.447900 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.447974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.448134 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.448217 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.448367 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.448443 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.448597 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.user = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.448673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.448833 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.448915 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.449068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.449144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.449301 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.449377 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.449534 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.449687 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.449761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.449830 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.449975 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.450052 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.450202 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.450286 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.450440 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.450515 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.450667 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.450741 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.450895 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.450978 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.451126 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.451201 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.451351 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.451491 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.451620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.451708 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.451865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.451940 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.452109 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.452198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.452355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.452472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.452591 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] auth.external = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.452670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.452816 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.452892 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.453061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.453139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.453297 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.453373 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.453536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.453611 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] auth.password = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.453760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] auth.token = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.453837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.453991 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.454066 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.454221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.454297 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.454465 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.454541 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.454692 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.454767 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.454938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.455013 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.455163 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.455239 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.455397 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.455491 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.455651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] credential.caching = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.455726 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.455888 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.455965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.456132 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.456207 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.456374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.456449 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.456605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.456681 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.456832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.456907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.457067 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.457141 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.457304 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] resource.caching = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.457381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.457554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.457630 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.457788 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.457862 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.458022 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.458099 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.458271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.458346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.458520 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.458595 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.458752 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.458829 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.458996 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.459072 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.459233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.459363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.459542 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.459637 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] federation.caching = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.459775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] role.caching = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.459972 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.460038 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] role.driver = sql {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.460228 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.460312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.460471 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.460546 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.460697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.460772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.460940 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.461024 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.461173 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.461284 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.461416 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.461490 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.461649 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.461731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.461889 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.461964 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.462121 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.462196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.462352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.462435 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.462588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] identity.caching = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.462663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.462828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.462903 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.463068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.463144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.463300 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.463376 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.463564 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.463727 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.463815 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.463963 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.464038 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.464212 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.464288 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.464460 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.464543 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.464709 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.464785 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.464938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.465013 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.465167 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.465251 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.465396 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.465472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.465638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.465714 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.465881 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.465964 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.466111 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.466185 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.466339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.466414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.466567 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.466651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.466817 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.466894 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.467068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.467149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.467304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.467388 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.467556 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.467634 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.467790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.467871 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.468017 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.468100 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.468249 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.468325 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] token.caching = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.468480 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.468554 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.468715 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.468797 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.468947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.469021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.469173 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.469247 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.469417 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.469501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.469654 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.469729 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.469884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.469959 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.470128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.470215 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.470376 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.470450 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.470602 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.470676 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.470837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.470919 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.471060 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.471134 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.471292 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.471368 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.471548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.471627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.471775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.471849 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.472008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.472081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.472242 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.472321 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.472486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.472561 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] database.connection = **** {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.472731 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.472816 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.472958 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.473061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.473184 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.473339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.473415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.473628 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.473704 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.473877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.473959 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.474109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.474184 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.474340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.474415 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.474567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.user = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.474695 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.474804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.475013 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.475088 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.475288 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.475354 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.475592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.475663 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.475865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.475942 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.476132 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.476207 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.476366 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.476444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.476595 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.476670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.476828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.476932 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.477061 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.477207 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.477282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.477477 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.477553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.477647 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 01:50:04.477735 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.477970 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.478213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.478454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.478696 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.478925 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.479169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.479427 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.479666 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.479902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.480136 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.480385 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.480632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.480868 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.481122 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.481353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.481595 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.481828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.482063 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.482297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.482540 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.482778 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.483006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.483242 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.483507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] resource.caching = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.483758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.484003 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.484237 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.484485 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.484732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.484964 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.485208 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.485443 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.485679 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.485911 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] role.caching = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.486155 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] role.driver = sql {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.486383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.486630 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.486875 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.487121 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.487364 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.487631 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.487877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.488122 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.488380 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.488611 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.488857 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.489104 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.489349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.489595 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.490009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.490250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.490519 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.490990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.491331 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.491536 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.491772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.492027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.492278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.492525 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.492758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.492990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.493223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.493473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.493727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.493975 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.494212 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.494447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.494678 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.494913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] token.caching = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.495149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.495394 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.495650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.495905 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.496150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.496396 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.496621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.496860 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.497105 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.497341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.497577 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.497810 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.498054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.498300 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.498529 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.498770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.499064 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.499324 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] database.connection = **** {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.499591 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.499841 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.500077 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.500324 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.500557 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.500793 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.501027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.501262 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.501507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.501743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.501986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.502219 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.502466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.502699 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.502945 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.503173 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.503430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.503668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 01:50:04.503840 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 01:50:04.508266 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.508497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.508721 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.517260 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.529539 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.529743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.529971 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.538455 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.544871 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.545104 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.556403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.556662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.687796 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.689322 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.736337 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.736499 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.736726 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.736818 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.799897 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.800073 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.800293 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.800375 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.800458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.800523 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.800595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.800656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.800721 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.800799 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.800873 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.801034 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.826117 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.826343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.826516 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.826604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.826743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.826824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.826942 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.827036 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.827156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.827281 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.827360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.827499 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.827579 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.827708 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.838483 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.838997 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.851272 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.851537 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.851691 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.851781 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.851845 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.851924 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.851988 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.852131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.852220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.852399 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.852524 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.852592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80430) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.852666 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.852817 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 01:50:04.869792 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.870002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 01:50:04.870099 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.870230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 01:50:04.870328 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.870516 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 01:50:04.870607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.870749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 01:50:04.870828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.870948 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.871040 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.871234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.871335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.871525 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.871653 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.871792 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.882436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.882710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.882835 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.883004 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.883133 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.883272 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.883401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.883669 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.891508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:04.891918 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:04.894803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:04.895077 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.895200 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:04.895362 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.895569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.895674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.895744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.895927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.896054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.896168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.896276 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.896454 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.896581 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.896730 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.896951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.897390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.897478 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.897558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.897621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.897680 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.897754 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.897964 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.924243 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.924940 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.925861 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:04.926533 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.926627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:04.926852 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.931458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:04.931884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.932167 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.932410 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:04.932826 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.933111 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.939923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:04.940144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.940840 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:04.941122 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.944811 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:04.945073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.945380 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.945654 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.945795 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:04.945880 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.946030 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.946160 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.946291 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.946427 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.946589 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.946713 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.946872 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.947150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.947426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.947693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.965458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.965738 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.966661 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.966936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.970605 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:04.971600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:04.974265 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.974661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.975273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.975700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.979770 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:04.980752 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:04.983385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:04.984375 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:04.987050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.987344 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.987659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.987937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.988062 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.988277 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.988370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.988494 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.988617 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.988884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.989166 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:04.989441 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.007681 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:05.007959 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.008233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.008473 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.008573 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:05.008868 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.009135 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.009401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.016434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.017308 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.018146 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.018429 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.019023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.019293 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.021677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:05.022326 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.022524 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:05.022627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.022778 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.022906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.023045 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.023174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.023299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.023660 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.036370 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:05.036647 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.036931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.037057 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:05.037222 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.037377 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.038005 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.038005 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.038996 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.039289 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.039509 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.039606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.039734 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.039992 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.057516 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:05.058090 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:05.060820 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:05.061707 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:05.064493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.065052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.066229 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.066786 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.067899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:05.068165 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.068439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.068587 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:05.068993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.069308 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.076682 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.077197 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.078298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:05.078780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:05.081551 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.081849 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.082011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.082243 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.082369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.082470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.082695 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.082972 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.091866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:05.092149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.092305 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:05.092378 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.092440 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.092704 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.100541 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:05.100686 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80430) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 01:50:05.100893 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.101018 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.101221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.101398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.101497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.101680 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.101773 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.101919 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.102002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.102145 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.102330 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.102448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.102576 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.102669 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.102847 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.102925 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.103148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.103266 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.103491 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.103677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.103677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.103943 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.104072 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.104195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.104316 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80430) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.104458 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 01:50:05.141973 dv-cinder-815582-9-smb devstack@keystone.service[80430]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x560912e549c0 pid: 80430 (default app) Jun 23 01:50:05.142100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x560912e549c0 pid: 80431 (default app) Jun 23 01:50:05.145441 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3602ec-4993-4f6f-b2f3-f2543b515d28 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:05.145744 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3602ec-4993-4f6f-b2f3-f2543b515d28 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:05.146021 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3602ec-4993-4f6f-b2f3-f2543b515d28 None None] PATH_INFO: `/v3` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:05.150494 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Thu Jun 23 01:50:05 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:12.815671 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3add0-7a9a-4988-b18a-5cfb311b3dc3 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:12.817234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3add0-7a9a-4988-b18a-5cfb311b3dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:12.817234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3add0-7a9a-4988-b18a-5cfb311b3dc3 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:12.823608 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:12 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:12.832770 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe5c42-02ed-4539-be0f-4756aea2aa40 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:12.833211 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe5c42-02ed-4539-be0f-4756aea2aa40 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:12.833358 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe5c42-02ed-4539-be0f-4756aea2aa40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:12.901782 dv-cinder-815582-9-smb devstack@keystone.service[80430]: INFO dbcounter [None req-2dbe5c42-02ed-4539-be0f-4756aea2aa40 None None] Registered counter for database keystone Jun 23 01:50:12.926214 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG oslo_db.sqlalchemy.engines [None req-2dbe5c42-02ed-4539-be0f-4756aea2aa40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80430) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 01:50:12.933411 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writer thread running {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 01:50:13.111351 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG passlib.handlers.bcrypt [None req-2dbe5c42-02ed-4539-be0f-4756aea2aa40 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80430) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 01:50:13.111676 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG passlib.handlers.bcrypt [None req-2dbe5c42-02ed-4539-be0f-4756aea2aa40 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80430) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 01:50:13.167223 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-2dbe5c42-02ed-4539-be0f-4756aea2aa40 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:13.168852 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-2dbe5c42-02ed-4539-be0f-4756aea2aa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:13.308319 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 01:50:13.486580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3add0-7a9a-4988-b18a-5cfb311b3dc3 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:13.563630 dv-cinder-815582-9-smb devstack@keystone.service[80431]: INFO dbcounter [None req-74f3add0-7a9a-4988-b18a-5cfb311b3dc3 None None] Registered counter for database keystone Jun 23 01:50:13.585077 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG oslo_db.sqlalchemy.engines [None req-74f3add0-7a9a-4988-b18a-5cfb311b3dc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 01:50:13.596084 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writer thread running {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 01:50:13.724419 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3add0-7a9a-4988-b18a-5cfb311b3dc3 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:13.730048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07232733-7361-4618-a913-5a5349fd34d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:13.730721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07232733-7361-4618-a913-5a5349fd34d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:13.731003 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07232733-7361-4618-a913-5a5349fd34d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:13.731276 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07232733-7361-4618-a913-5a5349fd34d2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:13.741800 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07232733-7361-4618-a913-5a5349fd34d2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:13.798326 dv-cinder-815582-9-smb devstack@keystone.service[80431]: WARNING keystone.common.rbac_enforcer.enforcer [None req-07232733-7361-4618-a913-5a5349fd34d2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 01:50:13.798675 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07232733-7361-4618-a913-5a5349fd34d2 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:13.809315 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Thu Jun 23 01:50:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 01:50:13.816632 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe5c42-02ed-4539-be0f-4756aea2aa40 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:13.833538 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe5c42-02ed-4539-be0f-4756aea2aa40 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:13.839549 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa114c2-742b-46fd-8982-21ed9c64a329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:13.840676 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa114c2-742b-46fd-8982-21ed9c64a329 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:13.840965 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa114c2-742b-46fd-8982-21ed9c64a329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:13.841242 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa114c2-742b-46fd-8982-21ed9c64a329 admin admin] PATH_INFO: `/v3/projects/3c1562009fe043679c20e065b5b0b463` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:13.845595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa114c2-742b-46fd-8982-21ed9c64a329 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c1562009fe043679c20e065b5b0b463)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:13.895544 dv-cinder-815582-9-smb devstack@keystone.service[80430]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3aa114c2-742b-46fd-8982-21ed9c64a329 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 01:50:13.895887 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa114c2-742b-46fd-8982-21ed9c64a329 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:13.900568 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Thu Jun 23 01:50:13 2022] GET /identity/v3/projects/3c1562009fe043679c20e065b5b0b463 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:15.919694 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e992b41-3f6a-47c4-9726-9ca393b88d05 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:15.920531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e992b41-3f6a-47c4-9726-9ca393b88d05 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:15.920531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e992b41-3f6a-47c4-9726-9ca393b88d05 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:15.925867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:15.932699 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd74cd-3aa0-4dda-823b-7678172e5bcb None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:15.933127 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd74cd-3aa0-4dda-823b-7678172e5bcb None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:15.933218 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd74cd-3aa0-4dda-823b-7678172e5bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:15.954333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-00fd74cd-3aa0-4dda-823b-7678172e5bcb None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:15.955903 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-00fd74cd-3aa0-4dda-823b-7678172e5bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:15.965191 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 01:50:15.988360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e992b41-3f6a-47c4-9726-9ca393b88d05 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:16.004485 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e992b41-3f6a-47c4-9726-9ca393b88d05 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:16.009853 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e4bd4-3039-4811-acc8-560339fd7220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:16.010523 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e4bd4-3039-4811-acc8-560339fd7220 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:16.010802 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e4bd4-3039-4811-acc8-560339fd7220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:16.011074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e4bd4-3039-4811-acc8-560339fd7220 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:16.019550 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e4bd4-3039-4811-acc8-560339fd7220 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:16.021334 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e4bd4-3039-4811-acc8-560339fd7220 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:16.030905 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Thu Jun 23 01:50:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 01:50:16.037043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd74cd-3aa0-4dda-823b-7678172e5bcb None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:16.052628 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd74cd-3aa0-4dda-823b-7678172e5bcb None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:16.062441 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1e107-0a0e-4f66-b785-8d3880a57d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:16.063842 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1e107-0a0e-4f66-b785-8d3880a57d07 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:16.064283 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1e107-0a0e-4f66-b785-8d3880a57d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:16.064737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1e107-0a0e-4f66-b785-8d3880a57d07 admin admin] PATH_INFO: `/v3/users/f8e0f94435f64c67b24912b3d4dbc165` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:16.067241 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1e107-0a0e-4f66-b785-8d3880a57d07 admin admin] RBAC: Authorizing `identity:get_user(user_id=f8e0f94435f64c67b24912b3d4dbc165)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:16.069846 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1e107-0a0e-4f66-b785-8d3880a57d07 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:16.071448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Thu Jun 23 01:50:16 2022] GET /identity/v3/users/f8e0f94435f64c67b24912b3d4dbc165 => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:18.178816 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733e4e6-eb8c-4dcb-9f43-adedb7eaa5c4 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:18.179321 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733e4e6-eb8c-4dcb-9f43-adedb7eaa5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:18.179321 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733e4e6-eb8c-4dcb-9f43-adedb7eaa5c4 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:18.180867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:18.184899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb8b9f-cebf-4157-b521-7fbabba71188 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:18.185343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb8b9f-cebf-4157-b521-7fbabba71188 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:18.185462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb8b9f-cebf-4157-b521-7fbabba71188 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:18.185852 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ff255-f8ec-43ec-a47f-16d9fb684f1d None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:18.186645 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ff255-f8ec-43ec-a47f-16d9fb684f1d None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:18.187054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ff255-f8ec-43ec-a47f-16d9fb684f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:18.187880 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:18.195401 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710ca4e-8186-47e7-9101-588751db9a5c None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:18.195735 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710ca4e-8186-47e7-9101-588751db9a5c None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:18.196023 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710ca4e-8186-47e7-9101-588751db9a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:18.213262 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-e710ca4e-8186-47e7-9101-588751db9a5c None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:18.214494 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-e710ca4e-8186-47e7-9101-588751db9a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:18.228825 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG passlib.handlers.bcrypt [None req-c01ff255-f8ec-43ec-a47f-16d9fb684f1d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80431) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 01:50:18.229267 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG passlib.handlers.bcrypt [None req-c01ff255-f8ec-43ec-a47f-16d9fb684f1d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80431) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 01:50:18.276043 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-c01ff255-f8ec-43ec-a47f-16d9fb684f1d None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:18.277670 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-c01ff255-f8ec-43ec-a47f-16d9fb684f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:18.300701 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 7/12] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:18.324133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710ca4e-8186-47e7-9101-588751db9a5c None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:18.348551 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:18.381607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 6/13] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:18.404489 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ff255-f8ec-43ec-a47f-16d9fb684f1d None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:18.430368 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710ca4e-8186-47e7-9101-588751db9a5c None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:18.464818 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8146023-309c-4af0-8872-27a0a9b6db94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:18.465652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8146023-309c-4af0-8872-27a0a9b6db94 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:18.465931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8146023-309c-4af0-8872-27a0a9b6db94 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:18.466203 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8146023-309c-4af0-8872-27a0a9b6db94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:18.477984 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8146023-309c-4af0-8872-27a0a9b6db94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:18.489274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-c8146023-309c-4af0-8872-27a0a9b6db94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:50:18.489274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:18.489274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:18.489274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:18.489274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:18.489274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:18.489274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:18.489274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:18.489274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:18.489274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:18.489274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:18.489274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:18.489274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:18.489274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:18.489274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:18.489274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:18.490414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:18.490414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:18.490414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:18.490414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:18.490414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:18.490414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:18.490414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:18.490414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:18.490414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:18.490414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:18.490414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:18.490414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:18.490414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:18.490414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:18.490414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:18.490414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:18.491369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:18.491369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:18.491369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:18.491369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:18.491369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:18.491369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:18.491369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:18.491369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:18.491369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:18.491369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:18.491369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:50:18.491369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:50:18.491369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 8/14] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:50:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:50:18.496540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8146023-309c-4af0-8872-27a0a9b6db94 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:18.508609 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ff255-f8ec-43ec-a47f-16d9fb684f1d None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:18.511165 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:18.547651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0f4fd-331f-4550-97c7-a24527ad86e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:18.548550 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0f4fd-331f-4550-97c7-a24527ad86e4 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:18.548830 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0f4fd-331f-4550-97c7-a24527ad86e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:18.549101 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0f4fd-331f-4550-97c7-a24527ad86e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:18.581439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:18.601870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8146023-309c-4af0-8872-27a0a9b6db94 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:18.618856 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0f4fd-331f-4550-97c7-a24527ad86e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:18.620476 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0f4fd-331f-4550-97c7-a24527ad86e4 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:18.637059 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895eb10-c662-47cb-8abd-cde6f41e5409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:18.637742 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895eb10-c662-47cb-8abd-cde6f41e5409 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:18.638024 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895eb10-c662-47cb-8abd-cde6f41e5409 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:18.638289 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895eb10-c662-47cb-8abd-cde6f41e5409 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:18.639049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895eb10-c662-47cb-8abd-cde6f41e5409 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:18.639359 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895eb10-c662-47cb-8abd-cde6f41e5409 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:18.640832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895eb10-c662-47cb-8abd-cde6f41e5409 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:18.653114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 9/15] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:50:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:50:18.658711 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895eb10-c662-47cb-8abd-cde6f41e5409 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:18.718611 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 7/16] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:50:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 01:50:18.724390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0f4fd-331f-4550-97c7-a24527ad86e4 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:18.728189 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:18.760341 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895eb10-c662-47cb-8abd-cde6f41e5409 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:18.796189 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ffcae-e40b-4f9f-aaa6-5be1ba55a52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:18.797075 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ffcae-e40b-4f9f-aaa6-5be1ba55a52b None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:18.797363 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ffcae-e40b-4f9f-aaa6-5be1ba55a52b None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:18.797634 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ffcae-e40b-4f9f-aaa6-5be1ba55a52b None admin] PATH_INFO: `/v3/users/f8e0f94435f64c67b24912b3d4dbc165` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:18.798867 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ffcae-e40b-4f9f-aaa6-5be1ba55a52b None admin] RBAC: Authorizing `identity:get_user(user_id=f8e0f94435f64c67b24912b3d4dbc165)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:18.800382 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ffcae-e40b-4f9f-aaa6-5be1ba55a52b None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:18.806484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 10/17] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:18 2022] GET /identity/v3/users/f8e0f94435f64c67b24912b3d4dbc165 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:50:18.807531 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ffcae-e40b-4f9f-aaa6-5be1ba55a52b None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:18.822063 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:18.825604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0f4fd-331f-4550-97c7-a24527ad86e4 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:18.859661 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d67ec0-182f-408a-a0c9-de5f66ab7ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:18.860476 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d67ec0-182f-408a-a0c9-de5f66ab7ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:18.860765 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d67ec0-182f-408a-a0c9-de5f66ab7ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:18.861044 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d67ec0-182f-408a-a0c9-de5f66ab7ff4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:18.879512 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d67ec0-182f-408a-a0c9-de5f66ab7ff4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:18.881058 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d67ec0-182f-408a-a0c9-de5f66ab7ff4 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:18.902046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-50d67ec0-182f-408a-a0c9-de5f66ab7ff4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:50:18.902046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:18.902046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:18.902046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:18.902046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:18.902046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:18.902046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:18.902046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:18.902046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:18.902046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:18.902046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:18.902046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:18.902046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:50:18.902046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:50:18.902046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:50:18.902913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:50:18.902913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:18.902913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:18.902913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:18.902913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:18.902913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:18.902913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:18.902913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:18.902913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:18.902913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:18.902913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:18.902913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:18.902913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:18.902913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:18.902913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:18.902913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:18.902913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:18.903859 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:50:18.903859 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:50:18.903859 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:50:18.903859 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:50:18.903859 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 8/18] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:50:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:50:18.910046 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ffcae-e40b-4f9f-aaa6-5be1ba55a52b None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:18.910183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d67ec0-182f-408a-a0c9-de5f66ab7ff4 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:18.948903 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ce0f7-6caa-4e69-8b70-c40e856ea698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:18.949705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ce0f7-6caa-4e69-8b70-c40e856ea698 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:18.949983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ce0f7-6caa-4e69-8b70-c40e856ea698 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:18.950254 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ce0f7-6caa-4e69-8b70-c40e856ea698 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:18.951465 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ce0f7-6caa-4e69-8b70-c40e856ea698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:18.952951 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ce0f7-6caa-4e69-8b70-c40e856ea698 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:18.954550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 11/19] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:50:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:18.960286 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ce0f7-6caa-4e69-8b70-c40e856ea698 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:18.972860 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:19.017744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d67ec0-182f-408a-a0c9-de5f66ab7ff4 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:19.041662 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:19.051046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b47cc-1063-42b5-a919-ee64e6912d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:19.051751 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b47cc-1063-42b5-a919-ee64e6912d7d None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:19.052040 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b47cc-1063-42b5-a919-ee64e6912d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:19.052321 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b47cc-1063-42b5-a919-ee64e6912d7d None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:19.053105 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b47cc-1063-42b5-a919-ee64e6912d7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:19.053391 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b47cc-1063-42b5-a919-ee64e6912d7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:19.054783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b47cc-1063-42b5-a919-ee64e6912d7d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:19.062089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ce0f7-6caa-4e69-8b70-c40e856ea698 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:19.072933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 9/20] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:19.101643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbba205-ce2a-4d70-8f9b-ed68bff8af15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:19.102334 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbba205-ce2a-4d70-8f9b-ed68bff8af15 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:19.102618 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbba205-ce2a-4d70-8f9b-ed68bff8af15 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:19.102896 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbba205-ce2a-4d70-8f9b-ed68bff8af15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:19.103799 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbba205-ce2a-4d70-8f9b-ed68bff8af15 None admin] RBAC: Adding query filter params (role.id=58e04437159e4eb39aa4a43c213ea34c, scope.domain.id=default, user.id=f8e0f94435f64c67b24912b3d4dbc165) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:19.104113 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbba205-ce2a-4d70-8f9b-ed68bff8af15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:19.105630 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbba205-ce2a-4d70-8f9b-ed68bff8af15 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:19.113648 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 12/21] 10.222.0.13 () {56 vars in 1322 bytes} [Thu Jun 23 01:50:18 2022] GET /identity/v3/role_assignments?user.id=f8e0f94435f64c67b24912b3d4dbc165&scope.domain.id=default&role.id=58e04437159e4eb39aa4a43c213ea34c => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:21.562490 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f2191-dc70-4e02-88d7-b578af1e2ab2 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:21.563435 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f2191-dc70-4e02-88d7-b578af1e2ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:21.563987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f2191-dc70-4e02-88d7-b578af1e2ab2 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:21.565547 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 10/22] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:21.585224 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939306f-c105-49f4-a87a-b24d3f44189b None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:21.586102 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939306f-c105-49f4-a87a-b24d3f44189b None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:21.586570 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939306f-c105-49f4-a87a-b24d3f44189b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:21.608425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-0939306f-c105-49f4-a87a-b24d3f44189b None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:21.609902 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-0939306f-c105-49f4-a87a-b24d3f44189b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:21.693769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 13/23] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:21.722597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c3217-e10a-459e-b356-5a7e5496942c None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:21.723155 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c3217-e10a-459e-b356-5a7e5496942c None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:21.723658 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c3217-e10a-459e-b356-5a7e5496942c None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:21.725263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 11/24] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:21.729782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c3217-e10a-459e-b356-5a7e5496942c None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:21.734133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c48a5f-36a0-4c2c-8003-0ec9c35eb815 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:21.735477 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c48a5f-36a0-4c2c-8003-0ec9c35eb815 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:21.735985 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c48a5f-36a0-4c2c-8003-0ec9c35eb815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:21.780448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-73c48a5f-36a0-4c2c-8003-0ec9c35eb815 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:21.782860 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-73c48a5f-36a0-4c2c-8003-0ec9c35eb815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:21.976829 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 14/25] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:50:21.993141 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c3217-e10a-459e-b356-5a7e5496942c None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:22.015618 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3edd09-c7f8-45c7-bc0f-0e24ab7bc7a1 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:22.016179 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3edd09-c7f8-45c7-bc0f-0e24ab7bc7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:22.016627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3edd09-c7f8-45c7-bc0f-0e24ab7bc7a1 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:22.018188 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 15/26] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:50:22.024248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3edd09-c7f8-45c7-bc0f-0e24ab7bc7a1 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:22.029330 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:22.030838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:22.075981 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e4534-b4d4-449e-ae7c-8c10d9fa5e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:22.076795 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e4534-b4d4-449e-ae7c-8c10d9fa5e00 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:22.077076 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e4534-b4d4-449e-ae7c-8c10d9fa5e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:22.077366 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e4534-b4d4-449e-ae7c-8c10d9fa5e00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:22.088508 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e4534-b4d4-449e-ae7c-8c10d9fa5e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:22.090096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e4534-b4d4-449e-ae7c-8c10d9fa5e00 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:22.110094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-658e4534-b4d4-449e-ae7c-8c10d9fa5e00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:50:22.110094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:22.110094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:22.110094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:22.110094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:22.110094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:22.110094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:22.110094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:22.110094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:22.110094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:22.110094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:22.110094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:22.110094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:50:22.110094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:50:22.110094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:50:22.110953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:50:22.110953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:22.110953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:22.110953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:22.110953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:22.110953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:22.110953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:22.110953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:22.110953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:22.110953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:22.110953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:22.110953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:22.110953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:22.110953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:22.110953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:22.110953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:22.110953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:22.111773 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:50:22.111773 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:50:22.111773 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:50:22.111773 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:50:22.113779 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 12/27] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:50:22.115357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53e997-58dc-4a08-928f-72600885ea9f None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:22.115860 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53e997-58dc-4a08-928f-72600885ea9f None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:22.116385 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53e997-58dc-4a08-928f-72600885ea9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:22.138278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-ca53e997-58dc-4a08-928f-72600885ea9f None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:22.139783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-ca53e997-58dc-4a08-928f-72600885ea9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:22.159201 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3edd09-c7f8-45c7-bc0f-0e24ab7bc7a1 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:22.202939 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846142bf-91fc-4492-9aee-d122a67bfcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:22.203834 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846142bf-91fc-4492-9aee-d122a67bfcc1 None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:22.204136 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846142bf-91fc-4492-9aee-d122a67bfcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:22.204413 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846142bf-91fc-4492-9aee-d122a67bfcc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:22.205169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846142bf-91fc-4492-9aee-d122a67bfcc1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:22.206581 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846142bf-91fc-4492-9aee-d122a67bfcc1 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:22.218030 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 13/28] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:22.219851 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd070d-e958-47a1-a570-95006629a2ab None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:22.220355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd070d-e958-47a1-a570-95006629a2ab None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:22.220854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd070d-e958-47a1-a570-95006629a2ab None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:22.222431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 14/29] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:22.223705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd070d-e958-47a1-a570-95006629a2ab None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:22.332841 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:22.338184 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd070d-e958-47a1-a570-95006629a2ab None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:22.351517 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 16/30] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Jun 23 01:50:22 2022] POST /identity/v3/roles => generated 219 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:50:22.353434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7520b28-a9fb-4c77-8577-05a72144d862 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:22.353949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7520b28-a9fb-4c77-8577-05a72144d862 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:22.354438 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7520b28-a9fb-4c77-8577-05a72144d862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:22.373049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-f7520b28-a9fb-4c77-8577-05a72144d862 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:22.374991 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-f7520b28-a9fb-4c77-8577-05a72144d862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:22.378388 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb37f85-9486-4193-99c5-b48cb2cc2518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:22.380049 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb37f85-9486-4193-99c5-b48cb2cc2518 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:22.380337 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb37f85-9486-4193-99c5-b48cb2cc2518 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:22.380705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb37f85-9486-4193-99c5-b48cb2cc2518 None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:22.381721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb37f85-9486-4193-99c5-b48cb2cc2518 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:22.381946 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb37f85-9486-4193-99c5-b48cb2cc2518 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:22.383394 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb37f85-9486-4193-99c5-b48cb2cc2518 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:22.398850 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 15/31] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:22.399801 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb37f85-9486-4193-99c5-b48cb2cc2518 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:22.444818 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:22.457739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 17/32] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:22.459242 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7520b28-a9fb-4c77-8577-05a72144d862 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:22.534777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb37f85-9486-4193-99c5-b48cb2cc2518 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:22.584153 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea553786-4ad2-45ee-b606-c47f1924d1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:22.585011 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea553786-4ad2-45ee-b606-c47f1924d1fd None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:22.585234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea553786-4ad2-45ee-b606-c47f1924d1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:22.585503 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea553786-4ad2-45ee-b606-c47f1924d1fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:22.588155 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7520b28-a9fb-4c77-8577-05a72144d862 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:22.610169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea553786-4ad2-45ee-b606-c47f1924d1fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:22.620772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-ea553786-4ad2-45ee-b606-c47f1924d1fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:50:22.620772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:22.620772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:22.620772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:22.620772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:22.620772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:22.620772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:22.620772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:22.620772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:22.620772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:22.620772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:22.620772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:22.620772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:22.620772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:22.620772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:22.620772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:22.621651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:22.621651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:22.621651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:22.621651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:22.621651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:22.621651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:22.621651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:22.621651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:22.621651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:22.621651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:22.621651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:22.621651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:22.621651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:22.621651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:22.621651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:22.621651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:22.622632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:22.622632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:22.622632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:22.622632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:22.622632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:22.622632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:22.622632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:22.622632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:22.622632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:22.622632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:22.622632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:50:22.622632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:50:22.622632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 16/33] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:50:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:50:22.623432 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6199d-ba58-469c-86aa-7e525ed1f7d4 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:22.623580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6199d-ba58-469c-86aa-7e525ed1f7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:22.623853 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6199d-ba58-469c-86aa-7e525ed1f7d4 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:22.625110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 17/34] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:22.625780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6199d-ba58-469c-86aa-7e525ed1f7d4 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:22.634419 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9169e3-0e4e-47b2-9d8c-32ee0f610d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:22.635096 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9169e3-0e4e-47b2-9d8c-32ee0f610d3c None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:22.635379 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9169e3-0e4e-47b2-9d8c-32ee0f610d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:22.635699 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9169e3-0e4e-47b2-9d8c-32ee0f610d3c None admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:22.636415 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9169e3-0e4e-47b2-9d8c-32ee0f610d3c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:22.638041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9169e3-0e4e-47b2-9d8c-32ee0f610d3c None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:22.656213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:22.672385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 18/35] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 01:50:22 2022] POST /identity/v3/projects => generated 301 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:50:22.673673 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f0426-6c5f-4aa2-829e-c20fdfc78acc None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:22.673956 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f0426-6c5f-4aa2-829e-c20fdfc78acc None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:22.674230 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f0426-6c5f-4aa2-829e-c20fdfc78acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:22.701733 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-238f0426-6c5f-4aa2-829e-c20fdfc78acc None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:22.703126 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-238f0426-6c5f-4aa2-829e-c20fdfc78acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:22.763790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:22.776125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6199d-ba58-469c-86aa-7e525ed1f7d4 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:22.805862 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 19/36] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:22.808369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f0426-6c5f-4aa2-829e-c20fdfc78acc None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:22.839044 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db62e0d-ce36-4962-acbf-5a14718bb42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:22.840011 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db62e0d-ce36-4962-acbf-5a14718bb42c None admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:22.840426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db62e0d-ce36-4962-acbf-5a14718bb42c None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:22.840843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db62e0d-ce36-4962-acbf-5a14718bb42c None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:22.841601 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db62e0d-ce36-4962-acbf-5a14718bb42c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:22.843008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db62e0d-ce36-4962-acbf-5a14718bb42c None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:22.948614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f0426-6c5f-4aa2-829e-c20fdfc78acc None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:22.977173 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Jun 23 01:50:22 2022] POST /identity/v3/roles => generated 225 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:50:22.977936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db62e0d-ce36-4962-acbf-5a14718bb42c None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:22.990855 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546d593-57af-40fe-84a0-cb0de97e5187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:22.992019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546d593-57af-40fe-84a0-cb0de97e5187 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:22.992508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546d593-57af-40fe-84a0-cb0de97e5187 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:22.993010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546d593-57af-40fe-84a0-cb0de97e5187 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:22.994040 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546d593-57af-40fe-84a0-cb0de97e5187 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:22.994557 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546d593-57af-40fe-84a0-cb0de97e5187 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:22.996304 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546d593-57af-40fe-84a0-cb0de97e5187 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:23.011966 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 20/38] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:50:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:23.013272 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546d593-57af-40fe-84a0-cb0de97e5187 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:23.073362 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:23.090859 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:23.121496 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db62e0d-ce36-4962-acbf-5a14718bb42c None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:23.141213 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546d593-57af-40fe-84a0-cb0de97e5187 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:23.169292 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea80fd6-e208-473f-ad75-69b7ec394692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:23.169987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea80fd6-e208-473f-ad75-69b7ec394692 None admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:23.170292 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea80fd6-e208-473f-ad75-69b7ec394692 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:23.170556 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea80fd6-e208-473f-ad75-69b7ec394692 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:23.171631 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea80fd6-e208-473f-ad75-69b7ec394692 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:23.173865 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea80fd6-e208-473f-ad75-69b7ec394692 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:23.184407 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46179d00-9407-4148-8b2d-d94965c68330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:23.185333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46179d00-9407-4148-8b2d-d94965c68330 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:23.185619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46179d00-9407-4148-8b2d-d94965c68330 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:23.185899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46179d00-9407-4148-8b2d-d94965c68330 None admin] PATH_INFO: `/v3/users/f8e0f94435f64c67b24912b3d4dbc165` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:23.187479 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46179d00-9407-4148-8b2d-d94965c68330 None admin] RBAC: Authorizing `identity:get_user(user_id=f8e0f94435f64c67b24912b3d4dbc165)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:23.188972 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46179d00-9407-4148-8b2d-d94965c68330 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:23.192054 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 21/39] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:23 2022] GET /identity/v3/users/f8e0f94435f64c67b24912b3d4dbc165 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:23.192164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 19/40] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Jun 23 01:50:22 2022] POST /identity/v3/roles => generated 223 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:50:23.192238 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca043420-87d5-4251-ae1d-99ef85655bd3 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:23.192238 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca043420-87d5-4251-ae1d-99ef85655bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:23.192370 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca043420-87d5-4251-ae1d-99ef85655bd3 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:23.194540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 22/41] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:23.198147 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea80fd6-e208-473f-ad75-69b7ec394692 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:23.199843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17067b1-fe2e-477c-82e8-d755bb247333 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:23.200139 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17067b1-fe2e-477c-82e8-d755bb247333 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:23.200425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17067b1-fe2e-477c-82e8-d755bb247333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:23.219741 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-d17067b1-fe2e-477c-82e8-d755bb247333 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:23.221350 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-d17067b1-fe2e-477c-82e8-d755bb247333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:23.306610 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 23/42] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:50:23.321981 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea80fd6-e208-473f-ad75-69b7ec394692 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:23.336483 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17067b1-fe2e-477c-82e8-d755bb247333 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:23.364023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7fce5-95c8-463f-b083-687da1240c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:23.366518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7fce5-95c8-463f-b083-687da1240c96 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:23.366518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7fce5-95c8-463f-b083-687da1240c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:23.366518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7fce5-95c8-463f-b083-687da1240c96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:23.369022 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7fce5-95c8-463f-b083-687da1240c96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:23.370960 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7fce5-95c8-463f-b083-687da1240c96 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:23.375144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 20/43] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:50:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:23.380771 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7fce5-95c8-463f-b083-687da1240c96 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:23.390678 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:23.489378 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:23.493851 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7fce5-95c8-463f-b083-687da1240c96 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:23.528676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bc09b-302d-45cc-b113-f1e712bacd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:23.529574 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bc09b-302d-45cc-b113-f1e712bacd8b None admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:23.529853 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bc09b-302d-45cc-b113-f1e712bacd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:23.530127 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bc09b-302d-45cc-b113-f1e712bacd8b None admin] PATH_INFO: `/v3/domains/default/users/f8e0f94435f64c67b24912b3d4dbc165/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:23.532450 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bc09b-302d-45cc-b113-f1e712bacd8b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f8e0f94435f64c67b24912b3d4dbc165, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:23.533876 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bc09b-302d-45cc-b113-f1e712bacd8b None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:23.549490 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 21/44] 10.222.0.13 () {58 vars in 1361 bytes} [Thu Jun 23 01:50:23 2022] PUT /identity/v3/domains/default/users/f8e0f94435f64c67b24912b3d4dbc165/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 01:50:23.563631 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17067b1-fe2e-477c-82e8-d755bb247333 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:23.594558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cd386-827a-4044-b139-facb40306377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:23.595286 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cd386-827a-4044-b139-facb40306377 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:23.595615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cd386-827a-4044-b139-facb40306377 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:23.595897 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cd386-827a-4044-b139-facb40306377 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:23.597278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cd386-827a-4044-b139-facb40306377 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:23.598820 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cd386-827a-4044-b139-facb40306377 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:23.601009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 24/45] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:50:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:50:23.607138 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bc09b-302d-45cc-b113-f1e712bacd8b None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:23.678881 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:23.717052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bc09b-302d-45cc-b113-f1e712bacd8b None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:23.859864 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c6061-0319-4f2a-b8ab-86baa0af23d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:23.860440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c6061-0319-4f2a-b8ab-86baa0af23d5 None admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:23.860726 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c6061-0319-4f2a-b8ab-86baa0af23d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:23.861004 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c6061-0319-4f2a-b8ab-86baa0af23d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:23.861740 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c6061-0319-4f2a-b8ab-86baa0af23d5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:23.863235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c6061-0319-4f2a-b8ab-86baa0af23d5 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:23.892655 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 22/46] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 01:50:23 2022] POST /identity/v3/projects => generated 312 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 01:50:25.553659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de051697-e144-4321-ba11-7d0ba0066324 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:25.554229 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de051697-e144-4321-ba11-7d0ba0066324 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:25.554229 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de051697-e144-4321-ba11-7d0ba0066324 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:25.555849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 25/47] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:25.561062 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455e0eb-c0a2-4ccd-9b17-d35d8cf9c208 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:25.561811 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455e0eb-c0a2-4ccd-9b17-d35d8cf9c208 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:25.562056 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455e0eb-c0a2-4ccd-9b17-d35d8cf9c208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:25.579682 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-a455e0eb-c0a2-4ccd-9b17-d35d8cf9c208 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:25.581208 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a455e0eb-c0a2-4ccd-9b17-d35d8cf9c208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:25.652583 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 23/48] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:25.676407 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de051697-e144-4321-ba11-7d0ba0066324 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:25.784414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de051697-e144-4321-ba11-7d0ba0066324 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:25.786837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:25.821706 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c6abd-0cc7-464c-8697-5779e26dea71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:25.822430 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c6abd-0cc7-464c-8697-5779e26dea71 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:25.822715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c6abd-0cc7-464c-8697-5779e26dea71 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:25.822993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c6abd-0cc7-464c-8697-5779e26dea71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:25.833474 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c6abd-0cc7-464c-8697-5779e26dea71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:25.841417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-f93c6abd-0cc7-464c-8697-5779e26dea71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:50:25.841417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:25.841417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:25.841417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:25.841417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:25.841417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:25.841417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:25.841417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:25.841417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:25.841417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:25.841417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:25.841417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:25.841417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:25.841417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:25.841417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:25.841417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:25.842468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:25.842468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:25.842468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:25.842468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:25.842468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:25.842468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:25.842468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:25.842468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:25.842468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:25.842468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:25.842468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:25.842468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:25.842468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:25.842468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:25.842468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:25.842468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:25.843333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:25.843333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:25.843333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:25.843333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:25.843333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:25.843333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:25.843333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:25.843333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:25.843333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:25.843333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:25.843333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:50:25.843333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:50:25.843333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 26/49] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:50:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:50:25.850304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455e0eb-c0a2-4ccd-9b17-d35d8cf9c208 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:25.884921 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202b941-9275-4ba2-9067-c931ad7a04f6 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:25.885210 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202b941-9275-4ba2-9067-c931ad7a04f6 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:25.885482 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202b941-9275-4ba2-9067-c931ad7a04f6 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:25.886843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 27/50] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:25.891738 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee1f0a-54eb-4656-ac5b-3b7a02db1a0b None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:25.892025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee1f0a-54eb-4656-ac5b-3b7a02db1a0b None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:25.892302 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee1f0a-54eb-4656-ac5b-3b7a02db1a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:25.901115 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:25.910435 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-d3ee1f0a-54eb-4656-ac5b-3b7a02db1a0b None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:25.911677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-d3ee1f0a-54eb-4656-ac5b-3b7a02db1a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:25.957013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455e0eb-c0a2-4ccd-9b17-d35d8cf9c208 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:25.978243 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 28/51] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:25.990659 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9128ea3c-46db-4359-9457-b64149b006d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:25.991343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128ea3c-46db-4359-9457-b64149b006d9 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:25.991654 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128ea3c-46db-4359-9457-b64149b006d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:25.991933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128ea3c-46db-4359-9457-b64149b006d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:25.992695 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9128ea3c-46db-4359-9457-b64149b006d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:25.993008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9128ea3c-46db-4359-9457-b64149b006d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:25.994398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9128ea3c-46db-4359-9457-b64149b006d9 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:26.000874 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee1f0a-54eb-4656-ac5b-3b7a02db1a0b None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:26.006365 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 24/52] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:50:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:26.011910 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9128ea3c-46db-4359-9457-b64149b006d9 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:26.096138 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:26.103937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee1f0a-54eb-4656-ac5b-3b7a02db1a0b None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:26.109192 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9128ea3c-46db-4359-9457-b64149b006d9 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:26.120829 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:26.138311 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75e5c9-56b4-4e23-8574-9b49b6723921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:26.139118 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75e5c9-56b4-4e23-8574-9b49b6723921 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:26.139400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75e5c9-56b4-4e23-8574-9b49b6723921 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:26.139717 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75e5c9-56b4-4e23-8574-9b49b6723921 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:26.140928 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75e5c9-56b4-4e23-8574-9b49b6723921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:26.142448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75e5c9-56b4-4e23-8574-9b49b6723921 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:26.143588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47ece4-dbd5-456c-b2ff-6cb57073ac1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:26.144096 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 29/53] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:50:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:26.144492 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47ece4-dbd5-456c-b2ff-6cb57073ac1c None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:26.144774 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47ece4-dbd5-456c-b2ff-6cb57073ac1c None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:26.145050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47ece4-dbd5-456c-b2ff-6cb57073ac1c None admin] PATH_INFO: `/v3/users/f8e0f94435f64c67b24912b3d4dbc165` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:26.146344 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f47ece4-dbd5-456c-b2ff-6cb57073ac1c None admin] RBAC: Authorizing `identity:get_user(user_id=f8e0f94435f64c67b24912b3d4dbc165)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:26.148029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f47ece4-dbd5-456c-b2ff-6cb57073ac1c None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:26.149557 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75e5c9-56b4-4e23-8574-9b49b6723921 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:26.149647 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 25/54] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:26 2022] GET /identity/v3/users/f8e0f94435f64c67b24912b3d4dbc165 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:26.154766 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47ece4-dbd5-456c-b2ff-6cb57073ac1c None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:26.248512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75e5c9-56b4-4e23-8574-9b49b6723921 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:26.253486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47ece4-dbd5-456c-b2ff-6cb57073ac1c None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:26.282817 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0dbff-1ff1-41ee-bade-3462b9b70497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:26.283567 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0dbff-1ff1-41ee-bade-3462b9b70497 None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:26.283855 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0dbff-1ff1-41ee-bade-3462b9b70497 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:26.284146 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0dbff-1ff1-41ee-bade-3462b9b70497 None admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:26.284843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0dbff-1ff1-41ee-bade-3462b9b70497 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:26.286308 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0dbff-1ff1-41ee-bade-3462b9b70497 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:26.287356 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc95ce5-b61d-46eb-b5e3-e56fed7d684a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:26.288196 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc95ce5-b61d-46eb-b5e3-e56fed7d684a None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:26.288478 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc95ce5-b61d-46eb-b5e3-e56fed7d684a None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:26.288750 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc95ce5-b61d-46eb-b5e3-e56fed7d684a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:26.289933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc95ce5-b61d-46eb-b5e3-e56fed7d684a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:26.291360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc95ce5-b61d-46eb-b5e3-e56fed7d684a None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:26.293001 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 26/55] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:50:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:50:26.298768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc95ce5-b61d-46eb-b5e3-e56fed7d684a None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:26.311997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 30/56] 10.222.0.13 () {60 vars in 1140 bytes} [Thu Jun 23 01:50:26 2022] POST /identity/v3/projects => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 01:50:26.351238 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:26.410560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc95ce5-b61d-46eb-b5e3-e56fed7d684a None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:26.451663 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac750c-fa30-4bbc-ab68-2b1e73ae3a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:26.452348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac750c-fa30-4bbc-ab68-2b1e73ae3a7f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:26.452630 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac750c-fa30-4bbc-ab68-2b1e73ae3a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:26.452890 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac750c-fa30-4bbc-ab68-2b1e73ae3a7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:26.453744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac750c-fa30-4bbc-ab68-2b1e73ae3a7f None admin] RBAC: Adding query filter params (role.id=58e04437159e4eb39aa4a43c213ea34c, scope.domain.id=default, user.id=f8e0f94435f64c67b24912b3d4dbc165) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:26.454054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac750c-fa30-4bbc-ab68-2b1e73ae3a7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:26.455540 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac750c-fa30-4bbc-ab68-2b1e73ae3a7f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:26.464715 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 27/57] 10.222.0.13 () {56 vars in 1322 bytes} [Thu Jun 23 01:50:26 2022] GET /identity/v3/role_assignments?user.id=f8e0f94435f64c67b24912b3d4dbc165&scope.domain.id=default&role.id=58e04437159e4eb39aa4a43c213ea34c => generated 530 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:28.330799 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6a9f0-d23c-438b-b2f8-56cb932b6083 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:28.331342 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6a9f0-d23c-438b-b2f8-56cb932b6083 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:28.331342 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6a9f0-d23c-438b-b2f8-56cb932b6083 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:28.332784 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 31/58] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:28.339140 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372ecba-e9c2-4c8f-bd55-ab43167b511a None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:28.339852 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372ecba-e9c2-4c8f-bd55-ab43167b511a None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:28.340173 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372ecba-e9c2-4c8f-bd55-ab43167b511a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:28.362692 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-7372ecba-e9c2-4c8f-bd55-ab43167b511a None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:28.363957 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-7372ecba-e9c2-4c8f-bd55-ab43167b511a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:28.439678 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 28/59] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:28.464708 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6a9f0-d23c-438b-b2f8-56cb932b6083 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:28.483944 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:28.580451 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6a9f0-d23c-438b-b2f8-56cb932b6083 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:28.625475 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b1971-0164-4528-8234-caa7d58d5065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:28.626240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b1971-0164-4528-8234-caa7d58d5065 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:28.626531 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b1971-0164-4528-8234-caa7d58d5065 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:28.626847 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b1971-0164-4528-8234-caa7d58d5065 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:28.628113 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b1971-0164-4528-8234-caa7d58d5065 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:28.629604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b1971-0164-4528-8234-caa7d58d5065 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:28.631470 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 32/60] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:50:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:50:28.637312 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372ecba-e9c2-4c8f-bd55-ab43167b511a None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:28.677071 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:28.738542 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372ecba-e9c2-4c8f-bd55-ab43167b511a None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:28.774884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa886e-0f9a-4af5-9173-a1d8fa6c86fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:28.775594 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa886e-0f9a-4af5-9173-a1d8fa6c86fa None admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:28.775878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa886e-0f9a-4af5-9173-a1d8fa6c86fa None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:28.776152 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa886e-0f9a-4af5-9173-a1d8fa6c86fa None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:28.776864 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa886e-0f9a-4af5-9173-a1d8fa6c86fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:28.778605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa886e-0f9a-4af5-9173-a1d8fa6c86fa None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:28.813549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 29/61] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 01:50:28 2022] POST /identity/v3/users => generated 275 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:50:31.818902 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae124f-8d62-4025-8c71-ece67a618be4 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:31.819485 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae124f-8d62-4025-8c71-ece67a618be4 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:31.819485 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae124f-8d62-4025-8c71-ece67a618be4 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:31.820865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 33/62] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:31.837491 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f25e47-c1d6-40af-8db3-f9b9308c7c3f None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:31.838419 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f25e47-c1d6-40af-8db3-f9b9308c7c3f None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:31.839027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f25e47-c1d6-40af-8db3-f9b9308c7c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:31.864404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-15f25e47-c1d6-40af-8db3-f9b9308c7c3f None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:31.865997 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-15f25e47-c1d6-40af-8db3-f9b9308c7c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:31.946178 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf1748-c656-4365-980e-a65a07b6df79 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:31.946825 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf1748-c656-4365-980e-a65a07b6df79 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:31.947319 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf1748-c656-4365-980e-a65a07b6df79 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:31.948913 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 34/63] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:50:31.954804 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc5a80-ceb5-4a49-8737-634b8a35eecc None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:31.955286 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc5a80-ceb5-4a49-8737-634b8a35eecc None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:31.955829 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc5a80-ceb5-4a49-8737-634b8a35eecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:31.959577 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 30/64] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:31.982924 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f25e47-c1d6-40af-8db3-f9b9308c7c3f None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:31.985490 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-bfdc5a80-ceb5-4a49-8737-634b8a35eecc None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:31.986752 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-bfdc5a80-ceb5-4a49-8737-634b8a35eecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:32.027815 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:32.105870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 35/65] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:50:32.133350 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc5a80-ceb5-4a49-8737-634b8a35eecc None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:32.148145 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f25e47-c1d6-40af-8db3-f9b9308c7c3f None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:32.185221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df38f41-1638-4e19-a5d6-013afd41cbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:32.186751 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df38f41-1638-4e19-a5d6-013afd41cbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:32.187209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:32.187321 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df38f41-1638-4e19-a5d6-013afd41cbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:32.187729 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df38f41-1638-4e19-a5d6-013afd41cbf3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:32.208381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df38f41-1638-4e19-a5d6-013afd41cbf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:32.216559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-9df38f41-1638-4e19-a5d6-013afd41cbf3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:50:32.216559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:32.216559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:32.216559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:32.216559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:32.216559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:32.216559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:32.216559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:32.216559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:32.216559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:32.216559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:32.216559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:32.216559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:32.216559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:32.216559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:32.216559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:32.217569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:32.217569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:32.217569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:32.217569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:32.217569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:32.217569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:32.217569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:32.217569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:32.217569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:32.217569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:32.217569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:32.217569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:32.217569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:32.217569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:32.217569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:32.217569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:32.218507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:32.218507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:32.218507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:32.218507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:32.218507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:32.218507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:32.218507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:32.218507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:32.218507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:32.218507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:32.218507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:50:32.218507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:50:32.230435 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 31/66] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:50:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:50:32.238444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df38f41-1638-4e19-a5d6-013afd41cbf3 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:32.368939 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc5a80-ceb5-4a49-8737-634b8a35eecc None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:32.403511 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:32.426793 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df38f41-1638-4e19-a5d6-013afd41cbf3 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:32.427609 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d04eda-2940-4302-b24b-74baf108ed5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:32.428632 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d04eda-2940-4302-b24b-74baf108ed5b None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:32.428923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d04eda-2940-4302-b24b-74baf108ed5b None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:32.429201 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d04eda-2940-4302-b24b-74baf108ed5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:32.442174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d04eda-2940-4302-b24b-74baf108ed5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:32.450116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-58d04eda-2940-4302-b24b-74baf108ed5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:50:32.450116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:32.450116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:32.450116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:32.450116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:32.450116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:32.450116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:32.450116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:32.450116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:32.450116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:32.450116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:32.450116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:32.450116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:32.450116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:32.450116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:32.450116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:32.451009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:32.451009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:32.451009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:32.451009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:32.451009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:32.451009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:32.451009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:32.451009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:32.451009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:32.451009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:32.451009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:32.451009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:32.451009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:32.451009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:32.451009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:32.451009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:32.451828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:32.451828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:32.451828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:32.451828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:32.451828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:32.451828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:32.451828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:32.451828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:32.451828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:32.451828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:32.451828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:50:32.451828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:50:32.451828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 36/67] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:50:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:50:32.453312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71acaf-2c67-4585-9640-7ad3bf030fa6 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:32.453575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71acaf-2c67-4585-9640-7ad3bf030fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:32.454016 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71acaf-2c67-4585-9640-7ad3bf030fa6 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:32.455482 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 37/68] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:32.456387 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238c255-2f01-4122-a2ef-e3a46e6514f5 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:32.456860 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238c255-2f01-4122-a2ef-e3a46e6514f5 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:32.456954 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238c255-2f01-4122-a2ef-e3a46e6514f5 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:32.463103 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 38/69] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:32.463103 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238c255-2f01-4122-a2ef-e3a46e6514f5 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:32.473067 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a41785-31c1-47d3-a9ae-875b6cc96951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:32.473755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a41785-31c1-47d3-a9ae-875b6cc96951 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:32.474045 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a41785-31c1-47d3-a9ae-875b6cc96951 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:32.474372 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a41785-31c1-47d3-a9ae-875b6cc96951 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:32.475142 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a41785-31c1-47d3-a9ae-875b6cc96951 None admin] RBAC: Adding query filter params (name=member) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:32.475487 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a41785-31c1-47d3-a9ae-875b6cc96951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:32.476897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a41785-31c1-47d3-a9ae-875b6cc96951 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:32.485463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 32/70] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:50:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:32.489318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71976d7d-914f-4da0-8df2-a4198835a7f5 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:32.491234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71976d7d-914f-4da0-8df2-a4198835a7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:32.491571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71976d7d-914f-4da0-8df2-a4198835a7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:32.513953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-71976d7d-914f-4da0-8df2-a4198835a7f5 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:32.515478 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-71976d7d-914f-4da0-8df2-a4198835a7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:32.534884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:32.571848 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238c255-2f01-4122-a2ef-e3a46e6514f5 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:32.607440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 33/71] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:32.607440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159f185-e26e-4df7-89a8-c671d40296de None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:32.607440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159f185-e26e-4df7-89a8-c671d40296de None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:32.607440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159f185-e26e-4df7-89a8-c671d40296de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:32.619472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43649f-6df4-432d-b370-4691bfa9eaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:32.620230 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43649f-6df4-432d-b370-4691bfa9eaf8 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:32.620634 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43649f-6df4-432d-b370-4691bfa9eaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:32.621011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43649f-6df4-432d-b370-4691bfa9eaf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:32.621983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43649f-6df4-432d-b370-4691bfa9eaf8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:32.622404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43649f-6df4-432d-b370-4691bfa9eaf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:32.623915 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43649f-6df4-432d-b370-4691bfa9eaf8 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:32.626458 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-e159f185-e26e-4df7-89a8-c671d40296de None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:32.627683 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-e159f185-e26e-4df7-89a8-c671d40296de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:32.633520 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 39/72] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:50:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:32.634734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43649f-6df4-432d-b370-4691bfa9eaf8 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:32.698481 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 34/73] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:32.699327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159f185-e26e-4df7-89a8-c671d40296de None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:32.708817 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:32.746749 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43649f-6df4-432d-b370-4691bfa9eaf8 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:32.781119 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4b3a5-7af6-42c4-a7c8-e3171fbee357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:32.782005 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4b3a5-7af6-42c4-a7c8-e3171fbee357 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:32.782286 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4b3a5-7af6-42c4-a7c8-e3171fbee357 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:32.782563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4b3a5-7af6-42c4-a7c8-e3171fbee357 None admin] PATH_INFO: `/v3/users/0a55a1d08bab41e3ac768f97064540ed` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:32.784590 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:32.796502 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4b3a5-7af6-42c4-a7c8-e3171fbee357 None admin] RBAC: Authorizing `identity:get_user(user_id=0a55a1d08bab41e3ac768f97064540ed)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:32.797981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4b3a5-7af6-42c4-a7c8-e3171fbee357 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:32.798072 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159f185-e26e-4df7-89a8-c671d40296de None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:32.799718 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 40/74] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:32 2022] GET /identity/v3/users/0a55a1d08bab41e3ac768f97064540ed => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:32.800481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4b3a5-7af6-42c4-a7c8-e3171fbee357 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:32.836877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f91b85-ef0a-42cd-bdea-8c5c242d2497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:32.837688 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f91b85-ef0a-42cd-bdea-8c5c242d2497 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:32.838219 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f91b85-ef0a-42cd-bdea-8c5c242d2497 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:32.838219 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f91b85-ef0a-42cd-bdea-8c5c242d2497 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:32.848426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f91b85-ef0a-42cd-bdea-8c5c242d2497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:32.856250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-28f91b85-ef0a-42cd-bdea-8c5c242d2497 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:50:32.856250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:32.856250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:32.856250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:32.856250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:32.856250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:32.856250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:32.856250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:32.856250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:32.856250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:32.856250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:32.856250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:32.856250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:32.856250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:32.856250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:32.856250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:32.857392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:32.857392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:32.857392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:32.857392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:32.857392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:32.857392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:32.857392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:32.857392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:32.857392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:32.857392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:32.857392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:32.857392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:32.857392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:32.857392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:32.857392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:32.857392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:32.858768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:32.858768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:32.858768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:32.858768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:32.858768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:32.858768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:32.858768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:32.858768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:32.858768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:32.858768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:32.858768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:50:32.858768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:50:32.858768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 35/75] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:50:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:50:32.858768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f51ef2-206c-4a46-9716-fe65c29ec455 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:32.859639 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f51ef2-206c-4a46-9716-fe65c29ec455 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:32.859639 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f51ef2-206c-4a46-9716-fe65c29ec455 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:32.863568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 36/76] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:32.863568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f51ef2-206c-4a46-9716-fe65c29ec455 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:32.908198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4b3a5-7af6-42c4-a7c8-e3171fbee357 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:32.932600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:32.948462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57926641-fe9f-4e2d-8972-30859a3c3ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:32.949359 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57926641-fe9f-4e2d-8972-30859a3c3ede None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:32.949634 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57926641-fe9f-4e2d-8972-30859a3c3ede None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:32.949919 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57926641-fe9f-4e2d-8972-30859a3c3ede None admin] PATH_INFO: `/v3/users/f8e0f94435f64c67b24912b3d4dbc165` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:32.951148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57926641-fe9f-4e2d-8972-30859a3c3ede None admin] RBAC: Authorizing `identity:get_user(user_id=f8e0f94435f64c67b24912b3d4dbc165)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:32.952662 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57926641-fe9f-4e2d-8972-30859a3c3ede None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:32.954297 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 41/77] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:32 2022] GET /identity/v3/users/f8e0f94435f64c67b24912b3d4dbc165 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:32.955058 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57926641-fe9f-4e2d-8972-30859a3c3ede None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:32.970570 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f51ef2-206c-4a46-9716-fe65c29ec455 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:33.004411 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b4385-91e8-40f7-b66b-a9f0da2aef7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:33.005230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b4385-91e8-40f7-b66b-a9f0da2aef7f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:33.005544 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b4385-91e8-40f7-b66b-a9f0da2aef7f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:33.005818 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b4385-91e8-40f7-b66b-a9f0da2aef7f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:33.014484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:33.018875 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b4385-91e8-40f7-b66b-a9f0da2aef7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:33.027149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-052b4385-91e8-40f7-b66b-a9f0da2aef7f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:50:33.027149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:33.027149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:33.027149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:33.027149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:33.027149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:33.027149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:33.027149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:33.027149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:33.027149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:33.027149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:33.027149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:33.027149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:33.027149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:33.027149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:33.027149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:33.028128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:33.028128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:33.028128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:33.028128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:33.028128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:33.028128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:33.028128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:33.028128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:33.028128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:33.028128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:33.028128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:33.028128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:33.028128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:33.028128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:33.028128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:33.028128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:33.028884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:33.028884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:33.028884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:33.028884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:33.028884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:33.028884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:33.028884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:33.028884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:33.028884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:33.028884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:33.028884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:50:33.028884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:50:33.028884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 37/78] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 01:50:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:50:33.029652 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b4385-91e8-40f7-b66b-a9f0da2aef7f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:33.060047 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57926641-fe9f-4e2d-8972-30859a3c3ede None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:33.095535 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832c6ac-1cfc-418b-b300-266d2c11ab0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:33.096200 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832c6ac-1cfc-418b-b300-266d2c11ab0e None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:33.096482 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832c6ac-1cfc-418b-b300-266d2c11ab0e None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:33.096757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832c6ac-1cfc-418b-b300-266d2c11ab0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:33.131506 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b4385-91e8-40f7-b66b-a9f0da2aef7f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:33.156891 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:33.165167 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832c6ac-1cfc-418b-b300-266d2c11ab0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:33.166206 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef9030-7e14-4936-af2d-0092f6be8f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:33.166633 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832c6ac-1cfc-418b-b300-266d2c11ab0e None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:33.166922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef9030-7e14-4936-af2d-0092f6be8f36 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:33.167210 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef9030-7e14-4936-af2d-0092f6be8f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:33.167519 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef9030-7e14-4936-af2d-0092f6be8f36 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:33.168287 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef9030-7e14-4936-af2d-0092f6be8f36 None admin] RBAC: Adding query filter params (name=member) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:33.168601 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef9030-7e14-4936-af2d-0092f6be8f36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:33.169986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef9030-7e14-4936-af2d-0092f6be8f36 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:33.179040 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 38/79] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:50:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:33.180298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83768102-fa41-4910-ba9c-4d9b3243dcd5 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:33.180595 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83768102-fa41-4910-ba9c-4d9b3243dcd5 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:33.180880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83768102-fa41-4910-ba9c-4d9b3243dcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:33.197932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-83768102-fa41-4910-ba9c-4d9b3243dcd5 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:33.199152 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-83768102-fa41-4910-ba9c-4d9b3243dcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:33.223686 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:33.264974 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 42/80] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:50:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:50:33.265830 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 39/81] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:33.265935 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832c6ac-1cfc-418b-b300-266d2c11ab0e None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:33.271349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83768102-fa41-4910-ba9c-4d9b3243dcd5 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:33.369534 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83768102-fa41-4910-ba9c-4d9b3243dcd5 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:33.374285 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832c6ac-1cfc-418b-b300-266d2c11ab0e None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:33.389420 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:33.404578 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cf752-720e-42ad-bc02-5fdbba8ae933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:33.405262 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cf752-720e-42ad-bc02-5fdbba8ae933 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:33.405536 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cf752-720e-42ad-bc02-5fdbba8ae933 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:33.405838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cf752-720e-42ad-bc02-5fdbba8ae933 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:33.406581 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250cf752-720e-42ad-bc02-5fdbba8ae933 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:33.406887 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250cf752-720e-42ad-bc02-5fdbba8ae933 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:33.408315 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250cf752-720e-42ad-bc02-5fdbba8ae933 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:33.410619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ad101-0d1b-4511-a50e-349edaa42490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:33.411279 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ad101-0d1b-4511-a50e-349edaa42490 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:33.411650 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ad101-0d1b-4511-a50e-349edaa42490 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:33.412151 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ad101-0d1b-4511-a50e-349edaa42490 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:33.416436 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 40/82] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:50:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:33.417150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cf752-720e-42ad-bc02-5fdbba8ae933 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:33.440659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:33.482113 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ad101-0d1b-4511-a50e-349edaa42490 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:33.483669 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ad101-0d1b-4511-a50e-349edaa42490 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:33.525023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cf752-720e-42ad-bc02-5fdbba8ae933 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:33.560484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1009ea-6ad7-4141-b948-94ccd76bddc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:33.561706 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1009ea-6ad7-4141-b948-94ccd76bddc9 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:33.561981 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1009ea-6ad7-4141-b948-94ccd76bddc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:33.562260 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1009ea-6ad7-4141-b948-94ccd76bddc9 None admin] PATH_INFO: `/v3/users/0a55a1d08bab41e3ac768f97064540ed` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:33.563534 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1009ea-6ad7-4141-b948-94ccd76bddc9 None admin] RBAC: Authorizing `identity:get_user(user_id=0a55a1d08bab41e3ac768f97064540ed)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:33.565072 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1009ea-6ad7-4141-b948-94ccd76bddc9 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:33.566715 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 41/83] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:33 2022] GET /identity/v3/users/0a55a1d08bab41e3ac768f97064540ed => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:33.567493 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1009ea-6ad7-4141-b948-94ccd76bddc9 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:33.588025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 43/84] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:50:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:50:33.591544 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ad101-0d1b-4511-a50e-349edaa42490 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:33.615799 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:33.650260 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:33.667499 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1009ea-6ad7-4141-b948-94ccd76bddc9 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:33.691098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ad101-0d1b-4511-a50e-349edaa42490 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:33.701361 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6862b-c961-4994-9d69-a83eeaa7672e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:33.702224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6862b-c961-4994-9d69-a83eeaa7672e None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:33.702507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6862b-c961-4994-9d69-a83eeaa7672e None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:33.702785 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6862b-c961-4994-9d69-a83eeaa7672e None admin] PATH_INFO: `/v3/projects/95472ace4fc043ed86453b0002951eec` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:33.704013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6862b-c961-4994-9d69-a83eeaa7672e None admin] RBAC: Authorizing `identity:get_project(project_id=95472ace4fc043ed86453b0002951eec)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:33.705481 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6862b-c961-4994-9d69-a83eeaa7672e None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:33.707210 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 42/85] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:33 2022] GET /identity/v3/projects/95472ace4fc043ed86453b0002951eec => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:33.707997 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6862b-c961-4994-9d69-a83eeaa7672e None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:33.725787 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78777e-a19e-47a5-859d-24ff1bc8d000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:33.726587 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78777e-a19e-47a5-859d-24ff1bc8d000 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:33.726869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78777e-a19e-47a5-859d-24ff1bc8d000 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:33.727140 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78777e-a19e-47a5-859d-24ff1bc8d000 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:33.728389 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78777e-a19e-47a5-859d-24ff1bc8d000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:33.729856 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78777e-a19e-47a5-859d-24ff1bc8d000 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:33.731491 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 44/86] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:50:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:33.732248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78777e-a19e-47a5-859d-24ff1bc8d000 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:33.817167 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6862b-c961-4994-9d69-a83eeaa7672e None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:33.826800 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78777e-a19e-47a5-859d-24ff1bc8d000 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:33.835228 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:33.854375 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:33.854610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cb60d-6ea0-4382-831e-b88e264b07f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:33.855504 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cb60d-6ea0-4382-831e-b88e264b07f8 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:33.855876 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cb60d-6ea0-4382-831e-b88e264b07f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:33.856193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cb60d-6ea0-4382-831e-b88e264b07f8 None admin] PATH_INFO: `/v3/users/0a55a1d08bab41e3ac768f97064540ed` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:33.857548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cb60d-6ea0-4382-831e-b88e264b07f8 None admin] RBAC: Authorizing `identity:get_user(user_id=0a55a1d08bab41e3ac768f97064540ed)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:33.859262 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cb60d-6ea0-4382-831e-b88e264b07f8 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:33.860894 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 43/87] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:33 2022] GET /identity/v3/users/0a55a1d08bab41e3ac768f97064540ed => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:33.861658 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cb60d-6ea0-4382-831e-b88e264b07f8 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:33.862636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9845e7-bb0c-4111-9a4a-fcd472c92bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:33.863296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9845e7-bb0c-4111-9a4a-fcd472c92bbf None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:33.863617 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9845e7-bb0c-4111-9a4a-fcd472c92bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:33.863892 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9845e7-bb0c-4111-9a4a-fcd472c92bbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:33.933863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9845e7-bb0c-4111-9a4a-fcd472c92bbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:33.935384 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9845e7-bb0c-4111-9a4a-fcd472c92bbf None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:33.962727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cb60d-6ea0-4382-831e-b88e264b07f8 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:33.995688 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395c355-17f8-4983-9296-1aaa7851824d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:33.996561 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395c355-17f8-4983-9296-1aaa7851824d None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:33.996846 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395c355-17f8-4983-9296-1aaa7851824d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:33.997120 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395c355-17f8-4983-9296-1aaa7851824d None admin] PATH_INFO: `/v3/projects/95472ace4fc043ed86453b0002951eec` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:33.998289 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395c355-17f8-4983-9296-1aaa7851824d None admin] RBAC: Authorizing `identity:get_project(project_id=95472ace4fc043ed86453b0002951eec)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:33.999758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395c355-17f8-4983-9296-1aaa7851824d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:34.001457 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 44/88] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:33 2022] GET /identity/v3/projects/95472ace4fc043ed86453b0002951eec => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:34.002219 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395c355-17f8-4983-9296-1aaa7851824d None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:34.032470 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 45/89] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:50:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:50:34.033282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9845e7-bb0c-4111-9a4a-fcd472c92bbf None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:34.060476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:34.062484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:34.106755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395c355-17f8-4983-9296-1aaa7851824d None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:34.133659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9845e7-bb0c-4111-9a4a-fcd472c92bbf None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:34.139770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ac51a-b824-47b9-8696-948cdf1e9bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:34.140462 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ac51a-b824-47b9-8696-948cdf1e9bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:34.140747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ac51a-b824-47b9-8696-948cdf1e9bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:34.141037 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ac51a-b824-47b9-8696-948cdf1e9bf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:34.141870 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ac51a-b824-47b9-8696-948cdf1e9bf0 None admin] RBAC: Adding query filter params (role.id=51b1227b19794e6fb73ae32c4d0165fb, scope.project.id=95472ace4fc043ed86453b0002951eec, user.id=0a55a1d08bab41e3ac768f97064540ed) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:34.142185 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ac51a-b824-47b9-8696-948cdf1e9bf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:34.143670 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ac51a-b824-47b9-8696-948cdf1e9bf0 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:34.149924 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 45/90] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:50:34 2022] GET /identity/v3/role_assignments?user.id=0a55a1d08bab41e3ac768f97064540ed&scope.project.id=95472ace4fc043ed86453b0002951eec&role.id=51b1227b19794e6fb73ae32c4d0165fb => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:34.150775 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ac51a-b824-47b9-8696-948cdf1e9bf0 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:34.186085 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b6b4a-221f-4970-9c68-11a95b2acf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:34.187023 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b6b4a-221f-4970-9c68-11a95b2acf7e None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:34.187302 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b6b4a-221f-4970-9c68-11a95b2acf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:34.187598 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b6b4a-221f-4970-9c68-11a95b2acf7e None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:34.188342 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b6b4a-221f-4970-9c68-11a95b2acf7e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:34.189858 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b6b4a-221f-4970-9c68-11a95b2acf7e None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:34.219671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 46/91] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 01:50:34 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:50:34.232802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b6b4a-221f-4970-9c68-11a95b2acf7e None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:34.274188 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ac51a-b824-47b9-8696-948cdf1e9bf0 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:34.297364 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:34.319953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb50ff3-a838-408c-adeb-729199223a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:34.320839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb50ff3-a838-408c-adeb-729199223a43 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:34.321200 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb50ff3-a838-408c-adeb-729199223a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:34.321546 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb50ff3-a838-408c-adeb-729199223a43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:34.367235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:34.389546 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b6b4a-221f-4970-9c68-11a95b2acf7e None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:34.409468 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb50ff3-a838-408c-adeb-729199223a43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:34.411096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb50ff3-a838-408c-adeb-729199223a43 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:34.434476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2b76e-d342-4ccc-a72b-7f5adbeda3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:34.435184 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2b76e-d342-4ccc-a72b-7f5adbeda3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:34.435547 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2b76e-d342-4ccc-a72b-7f5adbeda3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:34.435837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2b76e-d342-4ccc-a72b-7f5adbeda3a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:34.437074 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2b76e-d342-4ccc-a72b-7f5adbeda3a5 None admin] RBAC: Adding query filter params (role.id=58e04437159e4eb39aa4a43c213ea34c, scope.project.id=95472ace4fc043ed86453b0002951eec, user.id=f8e0f94435f64c67b24912b3d4dbc165) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:34.437319 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2b76e-d342-4ccc-a72b-7f5adbeda3a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:34.438820 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2b76e-d342-4ccc-a72b-7f5adbeda3a5 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:34.447156 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 47/92] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:50:34 2022] GET /identity/v3/role_assignments?user.id=f8e0f94435f64c67b24912b3d4dbc165&scope.project.id=95472ace4fc043ed86453b0002951eec&role.id=58e04437159e4eb39aa4a43c213ea34c => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:34.448892 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2b76e-d342-4ccc-a72b-7f5adbeda3a5 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:34.554924 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 46/93] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:50:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:50:34.563041 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb50ff3-a838-408c-adeb-729199223a43 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:34.589302 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:34.590901 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2b76e-d342-4ccc-a72b-7f5adbeda3a5 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:34.673925 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc53f6-9cdf-4d56-9ba6-59e6b452b567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:34.674813 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc53f6-9cdf-4d56-9ba6-59e6b452b567 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:34.675096 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc53f6-9cdf-4d56-9ba6-59e6b452b567 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:34.675370 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc53f6-9cdf-4d56-9ba6-59e6b452b567 None admin] PATH_INFO: `/v3/projects/4cfc36a19e8349e4ad5c522904eda547` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:34.676874 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc53f6-9cdf-4d56-9ba6-59e6b452b567 None admin] RBAC: Authorizing `identity:get_project(project_id=4cfc36a19e8349e4ad5c522904eda547)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:34.678468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc53f6-9cdf-4d56-9ba6-59e6b452b567 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:34.687862 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 48/94] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:34 2022] GET /identity/v3/projects/4cfc36a19e8349e4ad5c522904eda547 => generated 312 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:34.693815 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc53f6-9cdf-4d56-9ba6-59e6b452b567 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:34.709952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb50ff3-a838-408c-adeb-729199223a43 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:34.733151 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:34.766989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895cb57-097a-4bee-96ba-2a002a6ad91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:34.767904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895cb57-097a-4bee-96ba-2a002a6ad91d None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:34.768186 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895cb57-097a-4bee-96ba-2a002a6ad91d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:34.768459 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895cb57-097a-4bee-96ba-2a002a6ad91d None admin] PATH_INFO: `/v3/projects/95472ace4fc043ed86453b0002951eec` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:34.770674 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895cb57-097a-4bee-96ba-2a002a6ad91d None admin] RBAC: Authorizing `identity:get_project(project_id=95472ace4fc043ed86453b0002951eec)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:34.772241 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895cb57-097a-4bee-96ba-2a002a6ad91d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:34.774340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 47/95] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:34 2022] GET /identity/v3/projects/95472ace4fc043ed86453b0002951eec => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:34.782022 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895cb57-097a-4bee-96ba-2a002a6ad91d None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:34.887692 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc53f6-9cdf-4d56-9ba6-59e6b452b567 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:34.942349 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fef96-ca85-44d3-9015-a21fcb149151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:34.943473 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fef96-ca85-44d3-9015-a21fcb149151 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:34.943745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fef96-ca85-44d3-9015-a21fcb149151 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:34.944039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fef96-ca85-44d3-9015-a21fcb149151 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:34.945351 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fef96-ca85-44d3-9015-a21fcb149151 None admin] RBAC: Adding query filter params (role.id=51b1227b19794e6fb73ae32c4d0165fb, scope.project.id=4cfc36a19e8349e4ad5c522904eda547, user.id=0a55a1d08bab41e3ac768f97064540ed) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:34.945925 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fef96-ca85-44d3-9015-a21fcb149151 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:34.947602 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fef96-ca85-44d3-9015-a21fcb149151 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:34.954685 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 49/96] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:50:34 2022] GET /identity/v3/role_assignments?user.id=0a55a1d08bab41e3ac768f97064540ed&scope.project.id=4cfc36a19e8349e4ad5c522904eda547&role.id=51b1227b19794e6fb73ae32c4d0165fb => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:34.973846 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:34.996065 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895cb57-097a-4bee-96ba-2a002a6ad91d None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:35.053344 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059870ff-bf95-4b13-b56f-418856a3286c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:35.054050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059870ff-bf95-4b13-b56f-418856a3286c None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:35.054342 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059870ff-bf95-4b13-b56f-418856a3286c None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:35.054627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059870ff-bf95-4b13-b56f-418856a3286c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:35.055582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059870ff-bf95-4b13-b56f-418856a3286c None admin] RBAC: Adding query filter params (role.id=77aca4b95bbe47cbb528be2615112ac4, scope.project.id=95472ace4fc043ed86453b0002951eec, user.id=0a55a1d08bab41e3ac768f97064540ed) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:35.055905 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059870ff-bf95-4b13-b56f-418856a3286c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:35.057451 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059870ff-bf95-4b13-b56f-418856a3286c None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:35.065186 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 48/97] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:50:34 2022] GET /identity/v3/role_assignments?user.id=0a55a1d08bab41e3ac768f97064540ed&scope.project.id=95472ace4fc043ed86453b0002951eec&role.id=77aca4b95bbe47cbb528be2615112ac4 => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:50:36.713428 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbadc15-7e2c-4d78-8376-a5dbae643987 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:36.714452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbadc15-7e2c-4d78-8376-a5dbae643987 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:36.714937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbadc15-7e2c-4d78-8376-a5dbae643987 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:36.716854 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 50/98] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:36.721972 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb88301-0297-47b5-bfa2-2c6b72672841 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:36.722784 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb88301-0297-47b5-bfa2-2c6b72672841 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:36.723265 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb88301-0297-47b5-bfa2-2c6b72672841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:36.743812 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-cbb88301-0297-47b5-bfa2-2c6b72672841 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:36.745336 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-cbb88301-0297-47b5-bfa2-2c6b72672841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:36.832191 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 49/99] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:36.866585 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbadc15-7e2c-4d78-8376-a5dbae643987 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:36.964403 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:36.996125 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbadc15-7e2c-4d78-8376-a5dbae643987 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:37.034532 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f02c5-b0bc-4d11-a28c-53b6f56eb384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:37.035346 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f02c5-b0bc-4d11-a28c-53b6f56eb384 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:37.035680 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f02c5-b0bc-4d11-a28c-53b6f56eb384 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:37.035962 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f02c5-b0bc-4d11-a28c-53b6f56eb384 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:37.052702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f02c5-b0bc-4d11-a28c-53b6f56eb384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:37.060666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-672f02c5-b0bc-4d11-a28c-53b6f56eb384 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:50:37.060666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:37.060666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:37.060666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:37.060666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:37.060666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:37.060666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:37.060666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:37.060666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:37.060666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:37.060666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:37.060666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:37.060666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:37.060666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:37.060666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:37.060666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:37.061828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:37.061828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:37.061828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:37.061828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:37.061828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:37.061828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:37.061828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:37.061828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:37.061828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:37.061828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:37.061828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:37.061828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:37.061828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:37.061828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:37.061828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:37.061828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:37.062600 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:37.062600 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:37.062600 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:37.062600 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:37.062600 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:37.062600 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:37.062600 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:37.062600 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:37.062600 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:37.062600 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:37.062600 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:50:37.062600 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:50:37.067526 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 51/100] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:50:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:50:37.069924 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb88301-0297-47b5-bfa2-2c6b72672841 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:37.159271 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:37.183428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb88301-0297-47b5-bfa2-2c6b72672841 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:37.226830 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a0a43-75d8-44dc-8d4a-4195328b639a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:37.227770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a0a43-75d8-44dc-8d4a-4195328b639a None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:37.228200 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a0a43-75d8-44dc-8d4a-4195328b639a None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:37.228620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a0a43-75d8-44dc-8d4a-4195328b639a None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:37.229519 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a0a43-75d8-44dc-8d4a-4195328b639a None admin] RBAC: Adding query filter params (name=member) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:37.229993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a0a43-75d8-44dc-8d4a-4195328b639a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:37.231563 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a0a43-75d8-44dc-8d4a-4195328b639a None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:37.240362 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 50/101] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:50:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:37.246288 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f02c5-b0bc-4d11-a28c-53b6f56eb384 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:37.348772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e02b9c-38fb-4b5c-b8a4-55f1beebfd12 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:37.349761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e02b9c-38fb-4b5c-b8a4-55f1beebfd12 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:37.350243 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e02b9c-38fb-4b5c-b8a4-55f1beebfd12 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:37.352116 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 51/102] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:37.357865 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6af70-2d4f-49ef-95ab-36f0d5b1a84c None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:37.358431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6af70-2d4f-49ef-95ab-36f0d5b1a84c None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:37.358911 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6af70-2d4f-49ef-95ab-36f0d5b1a84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:37.360144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f02c5-b0bc-4d11-a28c-53b6f56eb384 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:37.392824 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-edf6af70-2d4f-49ef-95ab-36f0d5b1a84c None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:37.394273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-edf6af70-2d4f-49ef-95ab-36f0d5b1a84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:37.416965 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356189af-e72b-49fb-bc38-1ec002bcd830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:37.418933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356189af-e72b-49fb-bc38-1ec002bcd830 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:37.421134 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356189af-e72b-49fb-bc38-1ec002bcd830 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:37.421561 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356189af-e72b-49fb-bc38-1ec002bcd830 None admin] PATH_INFO: `/v3/users/0a55a1d08bab41e3ac768f97064540ed` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:37.424095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356189af-e72b-49fb-bc38-1ec002bcd830 None admin] RBAC: Authorizing `identity:get_user(user_id=0a55a1d08bab41e3ac768f97064540ed)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:37.426579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356189af-e72b-49fb-bc38-1ec002bcd830 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:37.430494 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 52/103] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:37 2022] GET /identity/v3/users/0a55a1d08bab41e3ac768f97064540ed => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:37.436759 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c26d1-3a1f-4745-afe6-be4eb8232b26 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:37.437219 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c26d1-3a1f-4745-afe6-be4eb8232b26 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:37.437635 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c26d1-3a1f-4745-afe6-be4eb8232b26 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:37.439110 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 53/104] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:37.441499 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c26d1-3a1f-4745-afe6-be4eb8232b26 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:37.461954 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:37.525645 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 52/105] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:50:37.526980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72b549-6920-4f3b-9ed3-bbf769122b4d None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:37.527276 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72b549-6920-4f3b-9ed3-bbf769122b4d None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:37.533478 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72b549-6920-4f3b-9ed3-bbf769122b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:37.575682 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-8d72b549-6920-4f3b-9ed3-bbf769122b4d None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:37.576904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-8d72b549-6920-4f3b-9ed3-bbf769122b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:37.668335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c26d1-3a1f-4745-afe6-be4eb8232b26 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:37.698763 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 53/106] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:37.699651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72b549-6920-4f3b-9ed3-bbf769122b4d None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:37.707822 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:37.738584 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a93af7-8183-4306-b499-cf03b09f7b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:37.740548 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a93af7-8183-4306-b499-cf03b09f7b11 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:37.740829 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a93af7-8183-4306-b499-cf03b09f7b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:37.741099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a93af7-8183-4306-b499-cf03b09f7b11 None admin] PATH_INFO: `/v3/projects/95472ace4fc043ed86453b0002951eec` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:37.744310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a93af7-8183-4306-b499-cf03b09f7b11 None admin] RBAC: Authorizing `identity:get_project(project_id=95472ace4fc043ed86453b0002951eec)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:37.746802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a93af7-8183-4306-b499-cf03b09f7b11 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:37.748555 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 54/107] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:37 2022] GET /identity/v3/projects/95472ace4fc043ed86453b0002951eec => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:37.750391 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a93af7-8183-4306-b499-cf03b09f7b11 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:37.892748 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72b549-6920-4f3b-9ed3-bbf769122b4d None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:37.911673 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:37.944966 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1ca72-186e-4280-b7bd-5672a9bc5ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:37.945794 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1ca72-186e-4280-b7bd-5672a9bc5ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:37.946077 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1ca72-186e-4280-b7bd-5672a9bc5ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:37.946354 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1ca72-186e-4280-b7bd-5672a9bc5ce1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:37.959493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a93af7-8183-4306-b499-cf03b09f7b11 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:37.961317 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1ca72-186e-4280-b7bd-5672a9bc5ce1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:37.972401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-a7d1ca72-186e-4280-b7bd-5672a9bc5ce1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 01:50:37.972401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:37.972401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:37.972401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:37.972401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:37.972401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:37.972401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:37.972401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:37.972401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:37.972401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:37.972401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:37.972401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:37.972401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:37.972401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:37.972401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:37.972401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:37.973381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:37.973381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:37.973381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:37.973381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:37.973381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:37.973381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:37.973381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:37.973381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:37.973381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:37.973381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:37.973381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:37.973381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:37.973381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:37.973381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:37.973381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:37.973381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:37.974207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:37.974207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:37.974207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:37.974207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:37.974207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:37.974207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:37.974207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:37.974207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:37.974207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:37.974207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:37.974207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 01:50:37.974207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:50:37.976859 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 54/108] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:50:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:50:37.978125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1ca72-186e-4280-b7bd-5672a9bc5ce1 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:38.003978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa03ce0-e74d-4227-b822-ca366a49632c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:38.004956 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa03ce0-e74d-4227-b822-ca366a49632c None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:38.006043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa03ce0-e74d-4227-b822-ca366a49632c None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:38.006714 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa03ce0-e74d-4227-b822-ca366a49632c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:38.020492 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa03ce0-e74d-4227-b822-ca366a49632c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:38.029755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-caa03ce0-e74d-4227-b822-ca366a49632c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:50:38.029755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:38.029755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:38.029755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:38.029755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:38.029755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:38.029755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:38.029755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:38.029755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:38.029755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:38.029755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:38.029755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:38.029755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:38.029755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:38.029755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:38.029755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:38.030768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:38.030768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:38.030768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:38.030768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:38.030768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:38.030768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:38.030768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:38.030768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:38.030768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:38.030768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:38.030768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:38.030768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:38.030768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:38.030768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:38.030768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:38.030768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:38.031737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:38.031737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:38.031737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:38.031737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:38.031737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:38.031737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:38.031737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:38.031737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:38.031737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:38.031737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:38.031737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:50:38.031737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:50:38.033113 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 55/109] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:50:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:50:38.034582 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605b9eb-73fc-47b9-9329-76d8a945c5b5 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:38.034919 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605b9eb-73fc-47b9-9329-76d8a945c5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:38.035203 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605b9eb-73fc-47b9-9329-76d8a945c5b5 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:38.037031 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 56/110] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:38.038012 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605b9eb-73fc-47b9-9329-76d8a945c5b5 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:38.051482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:38.091543 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1ca72-186e-4280-b7bd-5672a9bc5ce1 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:38.126476 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9f983-9625-4a26-bd4f-c460c4cbab56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:38.127509 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9f983-9625-4a26-bd4f-c460c4cbab56 None admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:38.127797 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9f983-9625-4a26-bd4f-c460c4cbab56 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:38.128075 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9f983-9625-4a26-bd4f-c460c4cbab56 None admin] PATH_INFO: `/v3/projects/95472ace4fc043ed86453b0002951eec/users/0a55a1d08bab41e3ac768f97064540ed/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:38.130215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9f983-9625-4a26-bd4f-c460c4cbab56 None admin] RBAC: Authorizing `identity:create_grant(project_id=95472ace4fc043ed86453b0002951eec, user_id=0a55a1d08bab41e3ac768f97064540ed, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:38.131778 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9f983-9625-4a26-bd4f-c460c4cbab56 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:38.146560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 55/111] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:50:37 2022] PUT /identity/v3/projects/95472ace4fc043ed86453b0002951eec/users/0a55a1d08bab41e3ac768f97064540ed/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:50:38.147503 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605b9eb-73fc-47b9-9329-76d8a945c5b5 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:38.147812 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7bcbc-c7dd-4fb5-93d8-97f9c71633e3 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:38.148097 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7bcbc-c7dd-4fb5-93d8-97f9c71633e3 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:38.148374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7bcbc-c7dd-4fb5-93d8-97f9c71633e3 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:38.149840 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 56/112] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:38.150397 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7bcbc-c7dd-4fb5-93d8-97f9c71633e3 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:38.215870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d11112-96a0-4f82-8531-c1d160ab5c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:38.217185 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d11112-96a0-4f82-8531-c1d160ab5c3a None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:38.217615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d11112-96a0-4f82-8531-c1d160ab5c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:38.218286 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d11112-96a0-4f82-8531-c1d160ab5c3a None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:38.219677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d11112-96a0-4f82-8531-c1d160ab5c3a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:38.220154 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d11112-96a0-4f82-8531-c1d160ab5c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:38.221794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d11112-96a0-4f82-8531-c1d160ab5c3a None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:38.225887 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:38.235830 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 57/113] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:50:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:38.242646 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3bb5d-3d15-4a8e-b10c-7bf679118f6e None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:38.242646 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3bb5d-3d15-4a8e-b10c-7bf679118f6e None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:38.242995 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3bb5d-3d15-4a8e-b10c-7bf679118f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:38.269302 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-ace3bb5d-3d15-4a8e-b10c-7bf679118f6e None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:38.271308 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-ace3bb5d-3d15-4a8e-b10c-7bf679118f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:38.291031 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7bcbc-c7dd-4fb5-93d8-97f9c71633e3 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:38.319368 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:38.333819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31d3b1-228d-426e-b739-2b44987cff3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:38.334816 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31d3b1-228d-426e-b739-2b44987cff3f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:38.335351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31d3b1-228d-426e-b739-2b44987cff3f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:38.336000 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31d3b1-228d-426e-b739-2b44987cff3f None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:38.336777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31d3b1-228d-426e-b739-2b44987cff3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:38.337093 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31d3b1-228d-426e-b739-2b44987cff3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:38.338495 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31d3b1-228d-426e-b739-2b44987cff3f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:38.347776 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 57/114] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:50:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:38.348926 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44777cbc-2e4f-4294-8aea-722c911a23f8 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:38.349225 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44777cbc-2e4f-4294-8aea-722c911a23f8 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:38.349509 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44777cbc-2e4f-4294-8aea-722c911a23f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:38.358564 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 58/115] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:38.359516 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3bb5d-3d15-4a8e-b10c-7bf679118f6e None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:38.374760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-44777cbc-2e4f-4294-8aea-722c911a23f8 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:38.376562 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-44777cbc-2e4f-4294-8aea-722c911a23f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:38.452272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 58/116] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:38.453047 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44777cbc-2e4f-4294-8aea-722c911a23f8 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:38.484861 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3bb5d-3d15-4a8e-b10c-7bf679118f6e None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:38.513515 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:38.521892 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ee8f1-0587-402f-8f81-f6a015069617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:38.522869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ee8f1-0587-402f-8f81-f6a015069617 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:38.523150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ee8f1-0587-402f-8f81-f6a015069617 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:38.523374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ee8f1-0587-402f-8f81-f6a015069617 None admin] PATH_INFO: `/v3/users/6a573e6e218a47988d2a1feeb70f90bd` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:38.537824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ee8f1-0587-402f-8f81-f6a015069617 None admin] RBAC: Authorizing `identity:get_user(user_id=6a573e6e218a47988d2a1feeb70f90bd)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:38.539322 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ee8f1-0587-402f-8f81-f6a015069617 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:38.545727 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 59/117] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:38 2022] GET /identity/v3/users/6a573e6e218a47988d2a1feeb70f90bd => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:38.545727 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ee8f1-0587-402f-8f81-f6a015069617 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:38.558417 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44777cbc-2e4f-4294-8aea-722c911a23f8 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:38.573259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:38.594903 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82457413-fb84-45c7-8e79-4fa40240fb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:38.595834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82457413-fb84-45c7-8e79-4fa40240fb2d None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:38.596123 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82457413-fb84-45c7-8e79-4fa40240fb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:38.596407 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82457413-fb84-45c7-8e79-4fa40240fb2d None admin] PATH_INFO: `/v3/users/f8e0f94435f64c67b24912b3d4dbc165` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:38.597608 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82457413-fb84-45c7-8e79-4fa40240fb2d None admin] RBAC: Authorizing `identity:get_user(user_id=f8e0f94435f64c67b24912b3d4dbc165)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:38.599228 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82457413-fb84-45c7-8e79-4fa40240fb2d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:38.601161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 59/118] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:38 2022] GET /identity/v3/users/f8e0f94435f64c67b24912b3d4dbc165 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:38.606779 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a45dd-5012-4138-9bb4-a0c07b2c83c4 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:38.606976 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a45dd-5012-4138-9bb4-a0c07b2c83c4 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:38.607313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a45dd-5012-4138-9bb4-a0c07b2c83c4 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:38.608831 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 60/119] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:38.609307 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a45dd-5012-4138-9bb4-a0c07b2c83c4 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:38.657976 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ee8f1-0587-402f-8f81-f6a015069617 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:38.693743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87614997-fea9-462f-a910-839c78a75979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:38.694573 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87614997-fea9-462f-a910-839c78a75979 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:38.694862 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87614997-fea9-462f-a910-839c78a75979 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:38.695141 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87614997-fea9-462f-a910-839c78a75979 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:38.706149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87614997-fea9-462f-a910-839c78a75979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:38.714408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-87614997-fea9-462f-a910-839c78a75979 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:50:38.714408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:38.714408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:38.714408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:38.714408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:38.714408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:38.714408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:38.714408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:38.714408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:38.714408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:38.714408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:38.714408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:38.714408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:38.714408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:38.714408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:38.714408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:38.715271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:38.715271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:38.715271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:38.715271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:38.715271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:38.715271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:38.715271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:38.715271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:38.715271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:38.715271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:38.715271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:38.715271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:38.715271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:38.715271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:38.715271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:38.715271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:38.716170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:38.716170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:38.716170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:38.716170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:38.716170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:38.716170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:38.716170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:38.716170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:38.716170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:38.716170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:38.716170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:50:38.716170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:50:38.716170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 60/120] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 01:50:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:50:38.716927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87614997-fea9-462f-a910-839c78a75979 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:38.728769 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a45dd-5012-4138-9bb4-a0c07b2c83c4 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:38.763285 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c293cb-6bd7-4f01-9db6-2471585ed2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:38.764133 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c293cb-6bd7-4f01-9db6-2471585ed2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:38.764421 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c293cb-6bd7-4f01-9db6-2471585ed2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:38.764699 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c293cb-6bd7-4f01-9db6-2471585ed2d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:38.765856 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c293cb-6bd7-4f01-9db6-2471585ed2d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:38.766059 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:38.767363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c293cb-6bd7-4f01-9db6-2471585ed2d6 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:38.768987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 61/121] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:50:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:38.773757 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c293cb-6bd7-4f01-9db6-2471585ed2d6 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:38.821632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:38.834601 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87614997-fea9-462f-a910-839c78a75979 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:38.870656 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5fd7f-2367-425f-afe6-87fd0684fe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:38.871606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5fd7f-2367-425f-afe6-87fd0684fe5e None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:38.871900 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5fd7f-2367-425f-afe6-87fd0684fe5e None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:38.872325 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5fd7f-2367-425f-afe6-87fd0684fe5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:38.875686 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c293cb-6bd7-4f01-9db6-2471585ed2d6 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:38.915761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024850e-d2e0-4fbf-9c10-682f908acc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:38.916766 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024850e-d2e0-4fbf-9c10-682f908acc8e None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:38.917071 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024850e-d2e0-4fbf-9c10-682f908acc8e None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:38.917352 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024850e-d2e0-4fbf-9c10-682f908acc8e None admin] PATH_INFO: `/v3/projects/95472ace4fc043ed86453b0002951eec` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:38.918831 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024850e-d2e0-4fbf-9c10-682f908acc8e None admin] RBAC: Authorizing `identity:get_project(project_id=95472ace4fc043ed86453b0002951eec)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:38.920495 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024850e-d2e0-4fbf-9c10-682f908acc8e None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:38.924809 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 62/122] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:38 2022] GET /identity/v3/projects/95472ace4fc043ed86453b0002951eec => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:38.924809 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45726e89-5d09-404f-84c6-fcc8fc6d969b None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:38.924809 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45726e89-5d09-404f-84c6-fcc8fc6d969b None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:38.924809 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45726e89-5d09-404f-84c6-fcc8fc6d969b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:38.944275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-45726e89-5d09-404f-84c6-fcc8fc6d969b None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:38.945524 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-45726e89-5d09-404f-84c6-fcc8fc6d969b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:38.954044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5fd7f-2367-425f-afe6-87fd0684fe5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:38.955566 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5fd7f-2367-425f-afe6-87fd0684fe5e None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:39.000904 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:39.017046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 63/123] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:39.018070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45726e89-5d09-404f-84c6-fcc8fc6d969b None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:39.069169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 61/124] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:50:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:50:39.070260 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5fd7f-2367-425f-afe6-87fd0684fe5e None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:39.079910 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:39.131477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45726e89-5d09-404f-84c6-fcc8fc6d969b None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:39.167561 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209fadd-5b46-4464-8c30-95a6fee50600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:39.168217 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209fadd-5b46-4464-8c30-95a6fee50600 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:39.168518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209fadd-5b46-4464-8c30-95a6fee50600 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:39.168795 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209fadd-5b46-4464-8c30-95a6fee50600 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:39.169670 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209fadd-5b46-4464-8c30-95a6fee50600 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:39.169982 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209fadd-5b46-4464-8c30-95a6fee50600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:39.171523 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209fadd-5b46-4464-8c30-95a6fee50600 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:39.184974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 64/125] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:50:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:39.184974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209fadd-5b46-4464-8c30-95a6fee50600 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:39.189645 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5fd7f-2367-425f-afe6-87fd0684fe5e None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:39.223112 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae157587-64da-46d7-9f28-712c333c990c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:39.223813 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae157587-64da-46d7-9f28-712c333c990c None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:39.224130 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae157587-64da-46d7-9f28-712c333c990c None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:39.224404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae157587-64da-46d7-9f28-712c333c990c None admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:39.225153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae157587-64da-46d7-9f28-712c333c990c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:39.226641 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae157587-64da-46d7-9f28-712c333c990c None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:39.246124 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:39.254157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 62/126] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 01:50:39 2022] POST /identity/v3/projects => generated 302 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:50:39.255343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae157587-64da-46d7-9f28-712c333c990c None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:39.303989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209fadd-5b46-4464-8c30-95a6fee50600 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:39.321103 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:39.359772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91c4aa-3b84-4f28-b0de-b50e87f30f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:39.360731 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91c4aa-3b84-4f28-b0de-b50e87f30f3b None admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:39.363759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91c4aa-3b84-4f28-b0de-b50e87f30f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:39.364366 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91c4aa-3b84-4f28-b0de-b50e87f30f3b None admin] PATH_INFO: `/v3/projects/95472ace4fc043ed86453b0002951eec/users/f8e0f94435f64c67b24912b3d4dbc165/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:39.367937 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91c4aa-3b84-4f28-b0de-b50e87f30f3b None admin] RBAC: Authorizing `identity:create_grant(project_id=95472ace4fc043ed86453b0002951eec, user_id=f8e0f94435f64c67b24912b3d4dbc165, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:39.370791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91c4aa-3b84-4f28-b0de-b50e87f30f3b None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:39.390917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 65/127] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:50:39 2022] PUT /identity/v3/projects/95472ace4fc043ed86453b0002951eec/users/f8e0f94435f64c67b24912b3d4dbc165/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:50:39.392799 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91c4aa-3b84-4f28-b0de-b50e87f30f3b None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:39.400411 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae157587-64da-46d7-9f28-712c333c990c None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:39.446028 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6baf478-6c48-4531-b9ab-7d334552464e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:39.446941 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baf478-6c48-4531-b9ab-7d334552464e None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:39.447230 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baf478-6c48-4531-b9ab-7d334552464e None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:39.447555 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baf478-6c48-4531-b9ab-7d334552464e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:39.460898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6baf478-6c48-4531-b9ab-7d334552464e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:39.470198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-e6baf478-6c48-4531-b9ab-7d334552464e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:50:39.470198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:39.470198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:39.470198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:39.470198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:39.470198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:39.470198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:39.470198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:39.470198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:39.470198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:39.470198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:39.470198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:39.470198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:39.470198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:39.470198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:39.470198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:39.471137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:39.471137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:39.471137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:39.471137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:39.471137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:39.471137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:39.471137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:39.471137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:39.471137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:39.471137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:39.471137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:39.471137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:39.471137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:39.471137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:39.471137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:39.471137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:39.471933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:39.471933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:39.471933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:39.471933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:39.471933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:39.471933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:39.471933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:39.471933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:39.471933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:39.471933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:39.471933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:50:39.471933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:50:39.471933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 63/128] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:50:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:50:39.472559 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6baf478-6c48-4531-b9ab-7d334552464e None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:39.533656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91c4aa-3b84-4f28-b0de-b50e87f30f3b None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:39.543472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:39.575731 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc98ff-2846-495b-9435-db2963300f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:39.577083 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc98ff-2846-495b-9435-db2963300f7f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:39.577568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc98ff-2846-495b-9435-db2963300f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:39.578041 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc98ff-2846-495b-9435-db2963300f7f None admin] PATH_INFO: `/v3/projects/95472ace4fc043ed86453b0002951eec` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:39.579629 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc98ff-2846-495b-9435-db2963300f7f None admin] RBAC: Authorizing `identity:get_project(project_id=95472ace4fc043ed86453b0002951eec)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:39.581330 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc98ff-2846-495b-9435-db2963300f7f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:39.583587 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 66/129] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:39 2022] GET /identity/v3/projects/95472ace4fc043ed86453b0002951eec => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:39.584920 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc98ff-2846-495b-9435-db2963300f7f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:39.592915 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6baf478-6c48-4531-b9ab-7d334552464e None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:39.629745 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:39.633224 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941ddee-16e6-4371-8c80-a46ed7a12f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:39.634970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941ddee-16e6-4371-8c80-a46ed7a12f80 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:39.634970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941ddee-16e6-4371-8c80-a46ed7a12f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:39.635131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941ddee-16e6-4371-8c80-a46ed7a12f80 None admin] PATH_INFO: `/v3/users/0a55a1d08bab41e3ac768f97064540ed` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:39.637540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941ddee-16e6-4371-8c80-a46ed7a12f80 None admin] RBAC: Authorizing `identity:get_user(user_id=0a55a1d08bab41e3ac768f97064540ed)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:39.639218 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941ddee-16e6-4371-8c80-a46ed7a12f80 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:39.642120 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 64/130] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:39 2022] GET /identity/v3/users/0a55a1d08bab41e3ac768f97064540ed => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:39.642120 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941ddee-16e6-4371-8c80-a46ed7a12f80 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:39.710916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc98ff-2846-495b-9435-db2963300f7f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:39.749200 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec9fb1-2977-4a63-9eb9-4a84cbda7194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:39.750017 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941ddee-16e6-4371-8c80-a46ed7a12f80 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:39.750579 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec9fb1-2977-4a63-9eb9-4a84cbda7194 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:39.751131 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec9fb1-2977-4a63-9eb9-4a84cbda7194 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:39.751711 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec9fb1-2977-4a63-9eb9-4a84cbda7194 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:39.752848 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec9fb1-2977-4a63-9eb9-4a84cbda7194 None admin] RBAC: Adding query filter params (name=member) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:39.753354 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec9fb1-2977-4a63-9eb9-4a84cbda7194 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:39.754964 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec9fb1-2977-4a63-9eb9-4a84cbda7194 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:39.764989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 67/131] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:50:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:39.766164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec9fb1-2977-4a63-9eb9-4a84cbda7194 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:39.777349 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:39.790518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e460e1-dde8-43fc-88d0-cff301d563de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:39.791110 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e460e1-dde8-43fc-88d0-cff301d563de None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:39.791390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e460e1-dde8-43fc-88d0-cff301d563de None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:39.791690 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e460e1-dde8-43fc-88d0-cff301d563de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:39.792536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e460e1-dde8-43fc-88d0-cff301d563de None admin] RBAC: Adding query filter params (role.id=684d55f3873849f08303658557ed05e8, scope.project.id=95472ace4fc043ed86453b0002951eec, user.id=6a573e6e218a47988d2a1feeb70f90bd) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:39.792851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e460e1-dde8-43fc-88d0-cff301d563de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:39.794316 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e460e1-dde8-43fc-88d0-cff301d563de None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:39.805552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 65/132] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:50:39 2022] GET /identity/v3/role_assignments?user.id=6a573e6e218a47988d2a1feeb70f90bd&scope.project.id=95472ace4fc043ed86453b0002951eec&role.id=684d55f3873849f08303658557ed05e8 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:39.806209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e460e1-dde8-43fc-88d0-cff301d563de None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:39.969086 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e460e1-dde8-43fc-88d0-cff301d563de None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:39.995926 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:40.001110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec9fb1-2977-4a63-9eb9-4a84cbda7194 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:40.014510 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ddaf8-143d-4c48-b8af-f119df939250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:40.015783 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ddaf8-143d-4c48-b8af-f119df939250 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:40.016263 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ddaf8-143d-4c48-b8af-f119df939250 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:40.016753 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ddaf8-143d-4c48-b8af-f119df939250 None admin] PATH_INFO: `/v3/users/0a55a1d08bab41e3ac768f97064540ed` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:40.018687 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ddaf8-143d-4c48-b8af-f119df939250 None admin] RBAC: Authorizing `identity:get_user(user_id=0a55a1d08bab41e3ac768f97064540ed)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:40.020406 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ddaf8-143d-4c48-b8af-f119df939250 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:40.022815 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 66/133] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:39 2022] GET /identity/v3/users/0a55a1d08bab41e3ac768f97064540ed => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:40.028434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ddaf8-143d-4c48-b8af-f119df939250 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:40.101682 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730bf1b-6230-418a-985a-efb3e8b84fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:40.102722 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730bf1b-6230-418a-985a-efb3e8b84fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:40.102830 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730bf1b-6230-418a-985a-efb3e8b84fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:40.103041 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730bf1b-6230-418a-985a-efb3e8b84fd8 None admin] PATH_INFO: `/v3/projects/95472ace4fc043ed86453b0002951eec` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:40.107047 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730bf1b-6230-418a-985a-efb3e8b84fd8 None admin] RBAC: Authorizing `identity:get_project(project_id=95472ace4fc043ed86453b0002951eec)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:40.108471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730bf1b-6230-418a-985a-efb3e8b84fd8 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:40.110419 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 68/134] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:39 2022] GET /identity/v3/projects/95472ace4fc043ed86453b0002951eec => generated 298 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:40.111511 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:40.116786 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730bf1b-6230-418a-985a-efb3e8b84fd8 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:40.164783 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ddaf8-143d-4c48-b8af-f119df939250 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:40.206170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf8c73-0237-4977-a6ab-03d64ccd163a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:40.207612 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf8c73-0237-4977-a6ab-03d64ccd163a None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:40.208648 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf8c73-0237-4977-a6ab-03d64ccd163a None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:40.209128 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf8c73-0237-4977-a6ab-03d64ccd163a None admin] PATH_INFO: `/v3/projects/4cfc36a19e8349e4ad5c522904eda547` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:40.210737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf8c73-0237-4977-a6ab-03d64ccd163a None admin] RBAC: Authorizing `identity:get_project(project_id=4cfc36a19e8349e4ad5c522904eda547)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:40.212610 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf8c73-0237-4977-a6ab-03d64ccd163a None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:40.214649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 67/135] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:40 2022] GET /identity/v3/projects/4cfc36a19e8349e4ad5c522904eda547 => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:40.220368 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf8c73-0237-4977-a6ab-03d64ccd163a None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:40.336419 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf8c73-0237-4977-a6ab-03d64ccd163a None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:40.344600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730bf1b-6230-418a-985a-efb3e8b84fd8 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:40.366517 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:40.377694 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8d9fa-1a7e-4f71-b9fb-e4a3b6214e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:40.379069 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8d9fa-1a7e-4f71-b9fb-e4a3b6214e21 None admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:40.379576 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8d9fa-1a7e-4f71-b9fb-e4a3b6214e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:40.380046 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8d9fa-1a7e-4f71-b9fb-e4a3b6214e21 None admin] PATH_INFO: `/v3/projects/4cfc36a19e8349e4ad5c522904eda547/users/0a55a1d08bab41e3ac768f97064540ed/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:40.382816 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8d9fa-1a7e-4f71-b9fb-e4a3b6214e21 None admin] RBAC: Authorizing `identity:create_grant(project_id=4cfc36a19e8349e4ad5c522904eda547, user_id=0a55a1d08bab41e3ac768f97064540ed, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:40.385005 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8d9fa-1a7e-4f71-b9fb-e4a3b6214e21 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:40.408416 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 68/136] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:50:40 2022] PUT /identity/v3/projects/4cfc36a19e8349e4ad5c522904eda547/users/0a55a1d08bab41e3ac768f97064540ed/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:50:40.410042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a380cfb-8616-4d9d-a44c-c755b3bf2083 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:40.410523 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a380cfb-8616-4d9d-a44c-c755b3bf2083 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:40.411078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a380cfb-8616-4d9d-a44c-c755b3bf2083 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:40.412725 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 69/137] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:40.415965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd822a7-8c13-4a60-99c1-a77b84ca4312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:40.418552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0a91d-b8bb-44fe-be09-119a1eb1c02b None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:40.419045 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0a91d-b8bb-44fe-be09-119a1eb1c02b None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:40.419542 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0a91d-b8bb-44fe-be09-119a1eb1c02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:40.421496 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd822a7-8c13-4a60-99c1-a77b84ca4312 None admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:40.421977 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd822a7-8c13-4a60-99c1-a77b84ca4312 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:40.422443 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd822a7-8c13-4a60-99c1-a77b84ca4312 None admin] PATH_INFO: `/v3/projects/95472ace4fc043ed86453b0002951eec/users/0a55a1d08bab41e3ac768f97064540ed/roles/77aca4b95bbe47cbb528be2615112ac4` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:40.427047 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd822a7-8c13-4a60-99c1-a77b84ca4312 None admin] RBAC: Authorizing `identity:create_grant(project_id=95472ace4fc043ed86453b0002951eec, user_id=0a55a1d08bab41e3ac768f97064540ed, role_id=77aca4b95bbe47cbb528be2615112ac4)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:40.430312 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd822a7-8c13-4a60-99c1-a77b84ca4312 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:40.455238 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 69/138] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:50:40 2022] PUT /identity/v3/projects/95472ace4fc043ed86453b0002951eec/users/0a55a1d08bab41e3ac768f97064540ed/roles/77aca4b95bbe47cbb528be2615112ac4 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:50:40.456135 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-41c0a91d-b8bb-44fe-be09-119a1eb1c02b None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:40.457626 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-41c0a91d-b8bb-44fe-be09-119a1eb1c02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:40.561772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 70/139] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:40.597562 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd822a7-8c13-4a60-99c1-a77b84ca4312 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:40.631345 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:40.720526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd822a7-8c13-4a60-99c1-a77b84ca4312 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:40.758905 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a686f6-1274-4692-948e-7d7da49a02a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:40.759756 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a686f6-1274-4692-948e-7d7da49a02a8 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:40.760042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a686f6-1274-4692-948e-7d7da49a02a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:40.760322 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a686f6-1274-4692-948e-7d7da49a02a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:40.774243 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a686f6-1274-4692-948e-7d7da49a02a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:40.782254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-30a686f6-1274-4692-948e-7d7da49a02a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:50:40.782254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:40.782254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:40.782254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:40.782254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:40.782254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:40.782254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:40.782254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:40.782254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:40.782254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:40.782254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:40.782254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:40.782254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:40.782254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:40.782254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:40.782254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:40.783119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:40.783119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:40.783119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:40.783119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:40.783119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:40.783119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:40.783119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:40.783119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:40.783119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:40.783119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:40.783119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:40.783119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:40.783119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:40.783119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:40.783119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:40.783119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:40.784118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:40.784118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:40.784118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:40.784118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:40.784118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:40.784118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:40.784118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:40.784118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:40.784118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:40.784118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:40.784118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:50:40.784118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:50:40.784118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 70/140] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:50:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:50:40.789802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0a91d-b8bb-44fe-be09-119a1eb1c02b None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:40.900856 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0a91d-b8bb-44fe-be09-119a1eb1c02b None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:40.929565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:40.946177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a458da-4543-4a9b-aebf-40452ac82629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:40.946861 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a458da-4543-4a9b-aebf-40452ac82629 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:40.947147 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a458da-4543-4a9b-aebf-40452ac82629 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:40.947446 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a458da-4543-4a9b-aebf-40452ac82629 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:40.948212 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a458da-4543-4a9b-aebf-40452ac82629 None admin] RBAC: Adding query filter params (name=member) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:40.948525 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a458da-4543-4a9b-aebf-40452ac82629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:40.949925 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a458da-4543-4a9b-aebf-40452ac82629 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:40.963595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 71/141] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:50:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:40.968841 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a686f6-1274-4692-948e-7d7da49a02a8 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:41.078057 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:41.091443 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a686f6-1274-4692-948e-7d7da49a02a8 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:41.138503 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e25888-51fe-417a-bf0c-1cc375c1b0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:41.139422 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e25888-51fe-417a-bf0c-1cc375c1b0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:41.139717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e25888-51fe-417a-bf0c-1cc375c1b0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:41.139995 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e25888-51fe-417a-bf0c-1cc375c1b0c9 None admin] PATH_INFO: `/v3/users/0a55a1d08bab41e3ac768f97064540ed` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:41.141234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e25888-51fe-417a-bf0c-1cc375c1b0c9 None admin] RBAC: Authorizing `identity:get_user(user_id=0a55a1d08bab41e3ac768f97064540ed)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:41.142703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e25888-51fe-417a-bf0c-1cc375c1b0c9 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:41.144796 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 71/142] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:40 2022] GET /identity/v3/users/0a55a1d08bab41e3ac768f97064540ed => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:41.149998 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a458da-4543-4a9b-aebf-40452ac82629 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:41.287489 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a458da-4543-4a9b-aebf-40452ac82629 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:41.327943 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db39684-edc9-4bf3-9ca4-85ae55eba511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:41.328603 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db39684-edc9-4bf3-9ca4-85ae55eba511 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:41.328884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db39684-edc9-4bf3-9ca4-85ae55eba511 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:41.329164 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db39684-edc9-4bf3-9ca4-85ae55eba511 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:41.390860 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:41.424978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db39684-edc9-4bf3-9ca4-85ae55eba511 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:41.426496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db39684-edc9-4bf3-9ca4-85ae55eba511 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:41.564418 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 72/143] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:50:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:50:41.569981 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e25888-51fe-417a-bf0c-1cc375c1b0c9 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:41.735951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e25888-51fe-417a-bf0c-1cc375c1b0c9 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:41.774276 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873ec6c-747b-48eb-bb16-8861545f4027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:41.775156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873ec6c-747b-48eb-bb16-8861545f4027 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:41.779454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873ec6c-747b-48eb-bb16-8861545f4027 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:41.779771 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873ec6c-747b-48eb-bb16-8861545f4027 None admin] PATH_INFO: `/v3/projects/95472ace4fc043ed86453b0002951eec` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:41.781008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873ec6c-747b-48eb-bb16-8861545f4027 None admin] RBAC: Authorizing `identity:get_project(project_id=95472ace4fc043ed86453b0002951eec)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:41.782473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873ec6c-747b-48eb-bb16-8861545f4027 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:41.784214 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 72/144] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:41 2022] GET /identity/v3/projects/95472ace4fc043ed86453b0002951eec => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:41.790151 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db39684-edc9-4bf3-9ca4-85ae55eba511 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:41.932144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:41.956344 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db39684-edc9-4bf3-9ca4-85ae55eba511 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:41.992523 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b37d85-048e-4bb4-bf0a-cefc35a3500c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:41.993576 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b37d85-048e-4bb4-bf0a-cefc35a3500c None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:41.994101 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b37d85-048e-4bb4-bf0a-cefc35a3500c None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:41.994580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b37d85-048e-4bb4-bf0a-cefc35a3500c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:41.995661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b37d85-048e-4bb4-bf0a-cefc35a3500c None admin] RBAC: Adding query filter params (role.id=51b1227b19794e6fb73ae32c4d0165fb, scope.project.id=95472ace4fc043ed86453b0002951eec, user.id=0a55a1d08bab41e3ac768f97064540ed) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:41.996184 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b37d85-048e-4bb4-bf0a-cefc35a3500c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:41.997866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b37d85-048e-4bb4-bf0a-cefc35a3500c None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:42.004348 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 73/145] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:50:41 2022] GET /identity/v3/role_assignments?user.id=0a55a1d08bab41e3ac768f97064540ed&scope.project.id=95472ace4fc043ed86453b0002951eec&role.id=51b1227b19794e6fb73ae32c4d0165fb => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:42.468004 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a182a-ddd3-41d5-b14d-03605f50c699 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:42.469033 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a182a-ddd3-41d5-b14d-03605f50c699 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:42.469518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a182a-ddd3-41d5-b14d-03605f50c699 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:42.471124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 73/146] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:42.477631 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1dbd1-a4db-4a91-870d-5769d3b5b369 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:42.478192 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1dbd1-a4db-4a91-870d-5769d3b5b369 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:42.478665 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1dbd1-a4db-4a91-870d-5769d3b5b369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:42.496221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-3ae1dbd1-a4db-4a91-870d-5769d3b5b369 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:42.497722 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-3ae1dbd1-a4db-4a91-870d-5769d3b5b369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:42.578565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 74/147] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:50:42.604935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a182a-ddd3-41d5-b14d-03605f50c699 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:42.634784 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:42.709878 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91de41-a699-4bdd-a781-3304869b7002 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:42.710192 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91de41-a699-4bdd-a781-3304869b7002 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:42.710435 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91de41-a699-4bdd-a781-3304869b7002 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:42.711893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 75/148] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:50:42.718625 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce68733-087f-49c5-b635-a8ca3810ddc5 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:42.718847 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce68733-087f-49c5-b635-a8ca3810ddc5 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:42.719110 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce68733-087f-49c5-b635-a8ca3810ddc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:42.744915 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-cce68733-087f-49c5-b635-a8ca3810ddc5 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:42.746371 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-cce68733-087f-49c5-b635-a8ca3810ddc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:42.750872 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a182a-ddd3-41d5-b14d-03605f50c699 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:42.816684 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092acff5-e666-4840-b719-0a45f1edc4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:42.817559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092acff5-e666-4840-b719-0a45f1edc4eb None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:42.817890 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092acff5-e666-4840-b719-0a45f1edc4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:42.818194 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092acff5-e666-4840-b719-0a45f1edc4eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:42.821467 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092acff5-e666-4840-b719-0a45f1edc4eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:42.822944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092acff5-e666-4840-b719-0a45f1edc4eb None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:42.824617 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 74/149] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:50:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:42.831311 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092acff5-e666-4840-b719-0a45f1edc4eb None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:42.855176 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 76/150] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:50:42.891601 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce68733-087f-49c5-b635-a8ca3810ddc5 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:42.894084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:42.932867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:42.935966 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092acff5-e666-4840-b719-0a45f1edc4eb None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:42.972242 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bc3d0-1cfb-44bf-90f0-95f59d80e83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:42.972846 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bc3d0-1cfb-44bf-90f0-95f59d80e83d None admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:42.973131 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bc3d0-1cfb-44bf-90f0-95f59d80e83d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:42.973411 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bc3d0-1cfb-44bf-90f0-95f59d80e83d None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:42.974179 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757bc3d0-1cfb-44bf-90f0-95f59d80e83d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:42.975673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757bc3d0-1cfb-44bf-90f0-95f59d80e83d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:42.997184 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 75/151] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 01:50:42 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 01:50:43.109188 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38f0b7-96e6-4eed-bb74-3aaf177ac454 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:43.109534 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38f0b7-96e6-4eed-bb74-3aaf177ac454 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:43.109744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38f0b7-96e6-4eed-bb74-3aaf177ac454 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:43.111312 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 76/152] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:50:43.117090 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb10a1d-b959-4232-b26f-f989c6f85083 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:43.117362 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb10a1d-b959-4232-b26f-f989c6f85083 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:43.117641 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb10a1d-b959-4232-b26f-f989c6f85083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:43.135231 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce68733-087f-49c5-b635-a8ca3810ddc5 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:43.138439 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-fdb10a1d-b959-4232-b26f-f989c6f85083 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:43.139715 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-fdb10a1d-b959-4232-b26f-f989c6f85083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:43.175880 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0a1e2-821c-424f-969f-31446cb7b549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:43.177162 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0a1e2-821c-424f-969f-31446cb7b549 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:43.177612 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0a1e2-821c-424f-969f-31446cb7b549 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:43.178138 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0a1e2-821c-424f-969f-31446cb7b549 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:43.190763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0a1e2-821c-424f-969f-31446cb7b549 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:43.198775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-19b0a1e2-821c-424f-969f-31446cb7b549 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:50:43.198775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:43.198775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:43.198775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:43.198775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:43.198775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:43.198775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:43.198775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:43.198775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:43.198775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:43.198775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:43.198775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:43.198775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:43.198775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:43.198775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:43.198775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:43.199772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:43.199772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:43.199772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:43.199772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:43.199772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:43.199772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:43.199772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:43.199772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:43.199772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:43.199772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:43.199772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:43.199772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:43.199772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:43.199772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:43.199772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:43.199772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:43.201329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:43.201329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:43.201329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:43.201329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:43.201329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:43.201329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:43.201329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:43.201329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:43.201329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:43.201329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:43.201329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:50:43.201329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:50:43.201329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 77/153] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:50:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:50:43.201329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4250f0-8e38-4bf6-81d8-741078de01fc None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:43.202113 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4250f0-8e38-4bf6-81d8-741078de01fc None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:43.202113 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4250f0-8e38-4bf6-81d8-741078de01fc None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:43.203715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 78/154] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:43.208284 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4250f0-8e38-4bf6-81d8-741078de01fc None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:43.232100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 77/155] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:43.233381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a98b7-6d2e-45e0-84ae-71eed7b0a914 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:43.233627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a98b7-6d2e-45e0-84ae-71eed7b0a914 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:43.233854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a98b7-6d2e-45e0-84ae-71eed7b0a914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:43.254522 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-ff3a98b7-6d2e-45e0-84ae-71eed7b0a914 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:43.255874 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-ff3a98b7-6d2e-45e0-84ae-71eed7b0a914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:43.281830 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:43.328362 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4250f0-8e38-4bf6-81d8-741078de01fc None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:43.346499 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 78/156] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:43.347744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a98b7-6d2e-45e0-84ae-71eed7b0a914 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:43.365777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:43.368942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96681280-c827-423a-ac11-c5d1857daf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:43.369813 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96681280-c827-423a-ac11-c5d1857daf68 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:43.370257 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96681280-c827-423a-ac11-c5d1857daf68 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:43.370721 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96681280-c827-423a-ac11-c5d1857daf68 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:43.371741 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96681280-c827-423a-ac11-c5d1857daf68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:43.372447 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96681280-c827-423a-ac11-c5d1857daf68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:43.374551 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96681280-c827-423a-ac11-c5d1857daf68 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:43.387179 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 79/157] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:50:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:43.393225 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96681280-c827-423a-ac11-c5d1857daf68 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:43.500550 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a98b7-6d2e-45e0-84ae-71eed7b0a914 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:43.529532 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96681280-c827-423a-ac11-c5d1857daf68 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:43.548634 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af532f-c245-43a3-8696-f713b8298e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:43.549869 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af532f-c245-43a3-8696-f713b8298e96 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:43.550321 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af532f-c245-43a3-8696-f713b8298e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:43.550726 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af532f-c245-43a3-8696-f713b8298e96 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:43.560311 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:43.567703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af532f-c245-43a3-8696-f713b8298e96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:43.576151 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc74a0-881e-4bff-89c8-72f45e891133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:43.577208 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc74a0-881e-4bff-89c8-72f45e891133 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:43.577580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc74a0-881e-4bff-89c8-72f45e891133 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:43.577758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-48af532f-c245-43a3-8696-f713b8298e96 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 01:50:43.577758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:43.577758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:43.577758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:43.577758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:43.577758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:43.577758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:43.577758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:43.577758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:43.577758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:43.577758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:43.577758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:43.577758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:43.577758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:43.577758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:43.577758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:43.578746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:43.578746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:43.578746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:43.578746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:43.578746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:43.578746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:43.578746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:43.578746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:43.578746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:43.578746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:43.578746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:43.578746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:43.578746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:43.578746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:43.578746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:43.578746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:43.579646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:43.579646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:43.579646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:43.579646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:43.579646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:43.579646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:43.579646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:43.579646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:43.579646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:43.579646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:43.579646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 01:50:43.579646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:50:43.580262 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc74a0-881e-4bff-89c8-72f45e891133 None admin] PATH_INFO: `/v3/users/f8e0f94435f64c67b24912b3d4dbc165` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:43.580262 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc74a0-881e-4bff-89c8-72f45e891133 None admin] RBAC: Authorizing `identity:get_user(user_id=f8e0f94435f64c67b24912b3d4dbc165)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:43.581095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc74a0-881e-4bff-89c8-72f45e891133 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:43.582329 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 79/158] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:50:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:50:43.582840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 80/159] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:43 2022] GET /identity/v3/users/f8e0f94435f64c67b24912b3d4dbc165 => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:43.583849 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af532f-c245-43a3-8696-f713b8298e96 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:43.588284 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc74a0-881e-4bff-89c8-72f45e891133 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:43.673821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:43.725372 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af532f-c245-43a3-8696-f713b8298e96 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:43.727366 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc74a0-881e-4bff-89c8-72f45e891133 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:43.765646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041037c-7f09-42a6-8c41-78fc68c71975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:43.768207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041037c-7f09-42a6-8c41-78fc68c71975 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:43.768804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041037c-7f09-42a6-8c41-78fc68c71975 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:43.769350 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041037c-7f09-42a6-8c41-78fc68c71975 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:43.771601 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabde0b-3e9c-4e14-bf03-2288ca07df5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:43.771864 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabde0b-3e9c-4e14-bf03-2288ca07df5d None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:43.772146 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabde0b-3e9c-4e14-bf03-2288ca07df5d None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:43.772414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabde0b-3e9c-4e14-bf03-2288ca07df5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:43.784032 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041037c-7f09-42a6-8c41-78fc68c71975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:43.793466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-f041037c-7f09-42a6-8c41-78fc68c71975 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:50:43.793466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:43.793466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:43.793466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:43.793466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:43.793466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:43.793466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:43.793466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:43.793466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:43.793466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:43.793466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:43.793466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:43.793466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:43.793466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:43.793466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:43.793466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:43.794407 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:43.794407 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:43.794407 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:43.794407 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:43.794407 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:43.794407 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:43.794407 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:43.794407 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:43.794407 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:43.794407 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:43.794407 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:43.794407 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:43.794407 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:43.794407 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:43.794407 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:43.794407 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:43.795172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:43.795172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:43.795172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:43.795172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:43.795172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:43.795172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:43.795172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:43.795172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:43.795172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:43.795172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:43.795172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:50:43.795172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:50:43.797697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 80/160] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:50:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:50:43.798790 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041037c-7f09-42a6-8c41-78fc68c71975 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:43.844268 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:43.857925 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabde0b-3e9c-4e14-bf03-2288ca07df5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:43.859443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabde0b-3e9c-4e14-bf03-2288ca07df5d None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:43.914707 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041037c-7f09-42a6-8c41-78fc68c71975 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:43.941447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:43.950472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e984d86-b967-4aee-912a-21d021c2177a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:43.951152 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e984d86-b967-4aee-912a-21d021c2177a None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:43.951448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e984d86-b967-4aee-912a-21d021c2177a None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:43.951730 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e984d86-b967-4aee-912a-21d021c2177a None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:43.952487 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e984d86-b967-4aee-912a-21d021c2177a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:43.952792 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e984d86-b967-4aee-912a-21d021c2177a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:43.954191 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e984d86-b967-4aee-912a-21d021c2177a None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:43.967362 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 81/161] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:50:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:43.967362 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e984d86-b967-4aee-912a-21d021c2177a None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:43.989307 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 81/162] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:50:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:50:43.991130 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02090f-3cea-455d-a5aa-a4356c05e2e6 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:43.991683 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02090f-3cea-455d-a5aa-a4356c05e2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:43.992668 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02090f-3cea-455d-a5aa-a4356c05e2e6 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:43.998276 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 82/163] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:43.999356 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02090f-3cea-455d-a5aa-a4356c05e2e6 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:44.073513 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e984d86-b967-4aee-912a-21d021c2177a None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:44.097744 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:44.110640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2acc5-afa7-4c31-bde4-d28570837dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:44.111287 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2acc5-afa7-4c31-bde4-d28570837dfe None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:44.111619 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2acc5-afa7-4c31-bde4-d28570837dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:44.111795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02090f-3cea-455d-a5aa-a4356c05e2e6 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:44.111919 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2acc5-afa7-4c31-bde4-d28570837dfe None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:44.112631 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2acc5-afa7-4c31-bde4-d28570837dfe None admin] RBAC: Adding query filter params (name=member) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:44.112936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2acc5-afa7-4c31-bde4-d28570837dfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:44.114395 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2acc5-afa7-4c31-bde4-d28570837dfe None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:44.124083 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 82/164] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:50:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:44.124921 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2acc5-afa7-4c31-bde4-d28570837dfe None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:44.150303 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198aed5-b39b-4c6e-b51b-694f134c2ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:44.151513 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198aed5-b39b-4c6e-b51b-694f134c2ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:44.151936 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198aed5-b39b-4c6e-b51b-694f134c2ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:44.152556 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198aed5-b39b-4c6e-b51b-694f134c2ad8 None admin] PATH_INFO: `/v3/users/6a573e6e218a47988d2a1feeb70f90bd` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:44.153974 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198aed5-b39b-4c6e-b51b-694f134c2ad8 None admin] RBAC: Authorizing `identity:get_user(user_id=6a573e6e218a47988d2a1feeb70f90bd)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:44.155638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198aed5-b39b-4c6e-b51b-694f134c2ad8 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:44.157445 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 83/165] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:43 2022] GET /identity/v3/users/6a573e6e218a47988d2a1feeb70f90bd => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:44.158813 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd724bfe-9e7f-4d3f-8a58-b58ab07f46d6 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:44.159312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd724bfe-9e7f-4d3f-8a58-b58ab07f46d6 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:44.159742 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd724bfe-9e7f-4d3f-8a58-b58ab07f46d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:44.176783 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-bd724bfe-9e7f-4d3f-8a58-b58ab07f46d6 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:44.178467 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-bd724bfe-9e7f-4d3f-8a58-b58ab07f46d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:44.198344 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:44.249388 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 84/166] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:44.250532 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd724bfe-9e7f-4d3f-8a58-b58ab07f46d6 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:44.291575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2acc5-afa7-4c31-bde4-d28570837dfe None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:44.343930 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:44.352750 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108d894-2064-4e49-91fa-1a2826bfaa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:44.353643 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108d894-2064-4e49-91fa-1a2826bfaa67 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:44.353920 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108d894-2064-4e49-91fa-1a2826bfaa67 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:44.354191 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108d894-2064-4e49-91fa-1a2826bfaa67 None admin] PATH_INFO: `/v3/projects/95472ace4fc043ed86453b0002951eec` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:44.355328 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd724bfe-9e7f-4d3f-8a58-b58ab07f46d6 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:44.357539 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108d894-2064-4e49-91fa-1a2826bfaa67 None admin] RBAC: Authorizing `identity:get_project(project_id=95472ace4fc043ed86453b0002951eec)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:44.359127 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108d894-2064-4e49-91fa-1a2826bfaa67 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:44.361171 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 83/167] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:44 2022] GET /identity/v3/projects/95472ace4fc043ed86453b0002951eec => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:44.361948 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108d894-2064-4e49-91fa-1a2826bfaa67 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:44.392396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459e37c-dc65-4ee4-9532-d8bbbf662bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:44.393590 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459e37c-dc65-4ee4-9532-d8bbbf662bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:44.394017 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459e37c-dc65-4ee4-9532-d8bbbf662bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:44.394475 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459e37c-dc65-4ee4-9532-d8bbbf662bf5 None admin] PATH_INFO: `/v3/users/0a55a1d08bab41e3ac768f97064540ed` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:44.396326 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459e37c-dc65-4ee4-9532-d8bbbf662bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=0a55a1d08bab41e3ac768f97064540ed)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:44.398159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459e37c-dc65-4ee4-9532-d8bbbf662bf5 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:44.400046 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 85/168] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:44 2022] GET /identity/v3/users/0a55a1d08bab41e3ac768f97064540ed => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:44.401055 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459e37c-dc65-4ee4-9532-d8bbbf662bf5 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:44.541964 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459e37c-dc65-4ee4-9532-d8bbbf662bf5 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:44.577774 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f95393-a9d9-4aa9-8bb1-b5d435e11fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:44.578872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f95393-a9d9-4aa9-8bb1-b5d435e11fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:44.579397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f95393-a9d9-4aa9-8bb1-b5d435e11fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:44.579862 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f95393-a9d9-4aa9-8bb1-b5d435e11fe0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:44.591114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f95393-a9d9-4aa9-8bb1-b5d435e11fe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:44.600723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-f5f95393-a9d9-4aa9-8bb1-b5d435e11fe0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:50:44.600723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:44.600723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:44.600723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:44.600723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:44.600723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:44.600723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:44.600723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:44.600723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:44.600723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:44.600723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:44.600723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:44.600723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:44.600723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:44.600723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:44.600723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:44.602011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:44.602011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:44.602011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:44.602011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:44.602011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:44.602011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:44.602011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:44.602011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:44.602011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:44.602011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:44.602011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:44.602011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:44.602011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:44.602011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:44.602011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:44.602011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:44.602937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:44.602937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:44.602937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:44.602937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:44.602937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:44.602937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:44.602937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:44.602937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:44.602937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:44.602937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:44.602937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:50:44.602937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:50:44.605540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 86/169] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 01:50:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:50:44.606488 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f95393-a9d9-4aa9-8bb1-b5d435e11fe0 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:44.633371 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108d894-2064-4e49-91fa-1a2826bfaa67 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:44.643974 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:44.668528 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:44.708209 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a09fa9-1d9e-45ce-882e-d0a8805d769f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:44.709148 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a09fa9-1d9e-45ce-882e-d0a8805d769f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:44.709334 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a09fa9-1d9e-45ce-882e-d0a8805d769f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:44.709617 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a09fa9-1d9e-45ce-882e-d0a8805d769f None admin] PATH_INFO: `/v3/projects/95472ace4fc043ed86453b0002951eec` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:44.715210 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f95393-a9d9-4aa9-8bb1-b5d435e11fe0 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:44.716141 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a09fa9-1d9e-45ce-882e-d0a8805d769f None admin] RBAC: Authorizing `identity:get_project(project_id=95472ace4fc043ed86453b0002951eec)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:44.717621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a09fa9-1d9e-45ce-882e-d0a8805d769f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:44.719356 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 84/170] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:44 2022] GET /identity/v3/projects/95472ace4fc043ed86453b0002951eec => generated 298 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:44.720154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a09fa9-1d9e-45ce-882e-d0a8805d769f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:44.751958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c329ce-6e01-44af-b6a2-f308d01f3f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:44.752985 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c329ce-6e01-44af-b6a2-f308d01f3f3f None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:44.753482 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c329ce-6e01-44af-b6a2-f308d01f3f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:44.754041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c329ce-6e01-44af-b6a2-f308d01f3f3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:44.755286 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c329ce-6e01-44af-b6a2-f308d01f3f3f None admin] RBAC: Adding query filter params (role.id=58e04437159e4eb39aa4a43c213ea34c, scope.project.id=95472ace4fc043ed86453b0002951eec, user.id=f8e0f94435f64c67b24912b3d4dbc165) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:44.755943 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c329ce-6e01-44af-b6a2-f308d01f3f3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:44.757803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c329ce-6e01-44af-b6a2-f308d01f3f3f None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:44.764463 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 87/171] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:50:44 2022] GET /identity/v3/role_assignments?user.id=f8e0f94435f64c67b24912b3d4dbc165&scope.project.id=95472ace4fc043ed86453b0002951eec&role.id=58e04437159e4eb39aa4a43c213ea34c => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:44.765900 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c329ce-6e01-44af-b6a2-f308d01f3f3f None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:44.859893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:44.878601 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c329ce-6e01-44af-b6a2-f308d01f3f3f None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:44.924676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a09fa9-1d9e-45ce-882e-d0a8805d769f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:44.992683 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04399513-7a0b-4868-9043-920daafe6179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:44.993363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04399513-7a0b-4868-9043-920daafe6179 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:44.993643 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04399513-7a0b-4868-9043-920daafe6179 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:44.993915 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04399513-7a0b-4868-9043-920daafe6179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:45.004199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e4acd-b718-42ed-ab10-4a327e760544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:45.004907 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e4acd-b718-42ed-ab10-4a327e760544 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:45.005230 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e4acd-b718-42ed-ab10-4a327e760544 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:45.005570 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e4acd-b718-42ed-ab10-4a327e760544 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:45.006348 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e4acd-b718-42ed-ab10-4a327e760544 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:45.006658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e4acd-b718-42ed-ab10-4a327e760544 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:45.008091 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e4acd-b718-42ed-ab10-4a327e760544 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:45.019227 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 88/172] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:50:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:45.020080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e4acd-b718-42ed-ab10-4a327e760544 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:45.074924 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:45.093958 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04399513-7a0b-4868-9043-920daafe6179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:45.096240 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04399513-7a0b-4868-9043-920daafe6179 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:45.229377 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e4acd-b718-42ed-ab10-4a327e760544 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:45.258564 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 85/173] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:50:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:50:45.260908 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04399513-7a0b-4868-9043-920daafe6179 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:45.299615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc4650-0faa-4594-86a1-b69e72bc5c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:45.303564 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc4650-0faa-4594-86a1-b69e72bc5c0f None admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:45.304072 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc4650-0faa-4594-86a1-b69e72bc5c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:45.304547 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc4650-0faa-4594-86a1-b69e72bc5c0f None admin] PATH_INFO: `/v3/projects/95472ace4fc043ed86453b0002951eec/users/6a573e6e218a47988d2a1feeb70f90bd/roles/684d55f3873849f08303658557ed05e8` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:45.307867 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc4650-0faa-4594-86a1-b69e72bc5c0f None admin] RBAC: Authorizing `identity:create_grant(project_id=95472ace4fc043ed86453b0002951eec, user_id=6a573e6e218a47988d2a1feeb70f90bd, role_id=684d55f3873849f08303658557ed05e8)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:45.309725 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc4650-0faa-4594-86a1-b69e72bc5c0f None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:45.336597 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 89/174] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:50:45 2022] PUT /identity/v3/projects/95472ace4fc043ed86453b0002951eec/users/6a573e6e218a47988d2a1feeb70f90bd/roles/684d55f3873849f08303658557ed05e8 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:50:45.337844 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc4650-0faa-4594-86a1-b69e72bc5c0f None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:45.345776 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:45.444173 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:45.467062 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04399513-7a0b-4868-9043-920daafe6179 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:45.533319 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc4650-0faa-4594-86a1-b69e72bc5c0f None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:45.538898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1432d-6ff3-4df2-b2a3-b5f0d3e66a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:45.540160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1432d-6ff3-4df2-b2a3-b5f0d3e66a9d None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:45.540643 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1432d-6ff3-4df2-b2a3-b5f0d3e66a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:45.541135 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1432d-6ff3-4df2-b2a3-b5f0d3e66a9d None admin] PATH_INFO: `/v3/users/0a55a1d08bab41e3ac768f97064540ed` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:45.543243 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1432d-6ff3-4df2-b2a3-b5f0d3e66a9d None admin] RBAC: Authorizing `identity:get_user(user_id=0a55a1d08bab41e3ac768f97064540ed)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:45.545186 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1432d-6ff3-4df2-b2a3-b5f0d3e66a9d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:45.547155 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 86/175] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:45 2022] GET /identity/v3/users/0a55a1d08bab41e3ac768f97064540ed => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:45.553186 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1432d-6ff3-4df2-b2a3-b5f0d3e66a9d None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:45.600525 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e7a98-f8e3-405c-aa27-b65936ae3476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:45.601412 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e7a98-f8e3-405c-aa27-b65936ae3476 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:45.601695 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e7a98-f8e3-405c-aa27-b65936ae3476 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:45.601973 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e7a98-f8e3-405c-aa27-b65936ae3476 None admin] PATH_INFO: `/v3/projects/4cfc36a19e8349e4ad5c522904eda547` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:45.603364 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e7a98-f8e3-405c-aa27-b65936ae3476 None admin] RBAC: Authorizing `identity:get_project(project_id=4cfc36a19e8349e4ad5c522904eda547)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:45.605728 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e7a98-f8e3-405c-aa27-b65936ae3476 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:45.607547 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 90/176] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:45 2022] GET /identity/v3/projects/4cfc36a19e8349e4ad5c522904eda547 => generated 312 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:45.608921 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56464d-f468-42d5-8416-ae1ba1c6659e None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:45.609208 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56464d-f468-42d5-8416-ae1ba1c6659e None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:45.609485 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56464d-f468-42d5-8416-ae1ba1c6659e None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:45.612014 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 91/177] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:45.622548 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56464d-f468-42d5-8416-ae1ba1c6659e None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:45.719057 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1432d-6ff3-4df2-b2a3-b5f0d3e66a9d None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:45.742739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:45.756312 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63fa82-5d9f-4be8-837e-b75d359d052d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:45.756979 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63fa82-5d9f-4be8-837e-b75d359d052d None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:45.757263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63fa82-5d9f-4be8-837e-b75d359d052d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:45.757541 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63fa82-5d9f-4be8-837e-b75d359d052d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:45.788217 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:45.829511 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63fa82-5d9f-4be8-837e-b75d359d052d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:45.831443 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63fa82-5d9f-4be8-837e-b75d359d052d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:45.848239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56464d-f468-42d5-8416-ae1ba1c6659e None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:45.941130 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92e3bf-76d7-4573-b09e-b8faa777326e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:45.941866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92e3bf-76d7-4573-b09e-b8faa777326e None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:45.942086 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92e3bf-76d7-4573-b09e-b8faa777326e None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:45.942364 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92e3bf-76d7-4573-b09e-b8faa777326e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:45.943477 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92e3bf-76d7-4573-b09e-b8faa777326e None admin] RBAC: Adding query filter params (role.id=51b1227b19794e6fb73ae32c4d0165fb, scope.project.id=4cfc36a19e8349e4ad5c522904eda547, user.id=0a55a1d08bab41e3ac768f97064540ed) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:45.943803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92e3bf-76d7-4573-b09e-b8faa777326e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:45.945294 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92e3bf-76d7-4573-b09e-b8faa777326e None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:45.966025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 92/178] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:50:45 2022] GET /identity/v3/role_assignments?user.id=0a55a1d08bab41e3ac768f97064540ed&scope.project.id=4cfc36a19e8349e4ad5c522904eda547&role.id=51b1227b19794e6fb73ae32c4d0165fb => generated 608 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:45.968180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaf43c-fb36-43ed-a5a5-6eb6fbfa2a69 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:45.968467 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaf43c-fb36-43ed-a5a5-6eb6fbfa2a69 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:45.968742 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaf43c-fb36-43ed-a5a5-6eb6fbfa2a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:45.982273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 87/179] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:50:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:50:45.987439 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63fa82-5d9f-4be8-837e-b75d359d052d None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:46.008634 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-fccaf43c-fb36-43ed-a5a5-6eb6fbfa2a69 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:46.009923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-fccaf43c-fb36-43ed-a5a5-6eb6fbfa2a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:46.154011 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:46.157967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 93/180] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:46.210893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaf43c-fb36-43ed-a5a5-6eb6fbfa2a69 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:46.236539 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63fa82-5d9f-4be8-837e-b75d359d052d None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:46.277893 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630628f9-8bda-4b23-9244-e0109fd338a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:46.279223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630628f9-8bda-4b23-9244-e0109fd338a4 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:46.279223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630628f9-8bda-4b23-9244-e0109fd338a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:46.279401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630628f9-8bda-4b23-9244-e0109fd338a4 None admin] PATH_INFO: `/v3/projects/95472ace4fc043ed86453b0002951eec` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:46.281064 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630628f9-8bda-4b23-9244-e0109fd338a4 None admin] RBAC: Authorizing `identity:get_project(project_id=95472ace4fc043ed86453b0002951eec)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:46.283005 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630628f9-8bda-4b23-9244-e0109fd338a4 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:46.285671 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 88/181] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:45 2022] GET /identity/v3/projects/95472ace4fc043ed86453b0002951eec => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:46.287193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46561959-8cc4-4c62-b93d-8658afa6a408 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:46.291577 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46561959-8cc4-4c62-b93d-8658afa6a408 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:46.292529 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46561959-8cc4-4c62-b93d-8658afa6a408 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:46.294513 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 89/182] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:46.298470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46561959-8cc4-4c62-b93d-8658afa6a408 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:46.305791 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:46.349836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaf43c-fb36-43ed-a5a5-6eb6fbfa2a69 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:46.390786 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b41e7-7753-455e-b245-327adff77b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:46.392062 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b41e7-7753-455e-b245-327adff77b21 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:46.392547 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b41e7-7753-455e-b245-327adff77b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:46.393046 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b41e7-7753-455e-b245-327adff77b21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:46.405807 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b41e7-7753-455e-b245-327adff77b21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:46.414832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-117b41e7-7753-455e-b245-327adff77b21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:50:46.414832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:46.414832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:46.414832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:46.414832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:46.414832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:46.414832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:46.414832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:46.414832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:46.414832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:46.414832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:46.414832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:46.414832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:46.414832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:46.414832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:46.414832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:46.415780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:46.415780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:46.415780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:46.415780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:46.415780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:46.415780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:46.415780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:46.415780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:46.415780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:46.415780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:46.415780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:46.415780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:46.415780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:46.415780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:46.415780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:46.415780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:46.416559 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:46.416559 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:46.416559 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:46.416559 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:46.416559 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:46.416559 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:46.416559 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:46.416559 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:46.416559 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:46.416559 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:46.416559 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:50:46.416559 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:50:46.417156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46561959-8cc4-4c62-b93d-8658afa6a408 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:46.423518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 94/183] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:50:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:50:46.425006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81595172-e67b-4232-b31c-e24f2d700015 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:46.425526 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81595172-e67b-4232-b31c-e24f2d700015 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:46.425937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81595172-e67b-4232-b31c-e24f2d700015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:46.444768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:46.447948 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-81595172-e67b-4232-b31c-e24f2d700015 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:46.449444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-81595172-e67b-4232-b31c-e24f2d700015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:46.456804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be7410-92c0-43bf-992c-4bde7ce12798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:46.457487 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be7410-92c0-43bf-992c-4bde7ce12798 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:46.457772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be7410-92c0-43bf-992c-4bde7ce12798 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:46.458120 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be7410-92c0-43bf-992c-4bde7ce12798 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:46.459363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be7410-92c0-43bf-992c-4bde7ce12798 None admin] RBAC: Adding query filter params (role.id=77aca4b95bbe47cbb528be2615112ac4, scope.project.id=95472ace4fc043ed86453b0002951eec, user.id=0a55a1d08bab41e3ac768f97064540ed) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:46.459737 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be7410-92c0-43bf-992c-4bde7ce12798 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:46.461792 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be7410-92c0-43bf-992c-4bde7ce12798 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:46.471816 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 90/184] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:50:46 2022] GET /identity/v3/role_assignments?user.id=0a55a1d08bab41e3ac768f97064540ed&scope.project.id=95472ace4fc043ed86453b0002951eec&role.id=77aca4b95bbe47cbb528be2615112ac4 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:46.472958 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be7410-92c0-43bf-992c-4bde7ce12798 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:46.578756 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 95/185] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:46.580698 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf2034-a862-4e96-a99c-cf0984fca273 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:46.581203 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf2034-a862-4e96-a99c-cf0984fca273 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:46.581699 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf2034-a862-4e96-a99c-cf0984fca273 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:46.583847 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 96/186] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:46.591445 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f409213-c1ed-424c-8975-f4b91792208e None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:46.592042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f409213-c1ed-424c-8975-f4b91792208e None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:46.592534 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f409213-c1ed-424c-8975-f4b91792208e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:46.633059 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be7410-92c0-43bf-992c-4bde7ce12798 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:46.635344 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-0f409213-c1ed-424c-8975-f4b91792208e None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:46.636921 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-0f409213-c1ed-424c-8975-f4b91792208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:46.678366 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4a93d-24f1-40e0-9b1e-5cfca317f819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:46.679382 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4a93d-24f1-40e0-9b1e-5cfca317f819 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:46.679702 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4a93d-24f1-40e0-9b1e-5cfca317f819 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:46.679979 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4a93d-24f1-40e0-9b1e-5cfca317f819 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:46.680746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4a93d-24f1-40e0-9b1e-5cfca317f819 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:46.681056 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4a93d-24f1-40e0-9b1e-5cfca317f819 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:46.682461 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4a93d-24f1-40e0-9b1e-5cfca317f819 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:46.692124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 91/187] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:50:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:46.693560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4a93d-24f1-40e0-9b1e-5cfca317f819 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:46.699935 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:46.724962 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 97/188] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:50:46.726193 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f409213-c1ed-424c-8975-f4b91792208e None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:46.760639 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:46.822576 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4a93d-24f1-40e0-9b1e-5cfca317f819 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:46.837862 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f409213-c1ed-424c-8975-f4b91792208e None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:46.858408 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a29634-0ad4-44d3-9296-b9834eac07be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:46.859243 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a29634-0ad4-44d3-9296-b9834eac07be None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:46.859563 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a29634-0ad4-44d3-9296-b9834eac07be None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:46.859840 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a29634-0ad4-44d3-9296-b9834eac07be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:46.870807 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a29634-0ad4-44d3-9296-b9834eac07be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:46.873441 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12965b71-d639-4f35-b944-7e3c1784a73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:46.874340 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12965b71-d639-4f35-b944-7e3c1784a73c None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:46.874622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12965b71-d639-4f35-b944-7e3c1784a73c None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:46.874898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12965b71-d639-4f35-b944-7e3c1784a73c None admin] PATH_INFO: `/v3/users/81bb186b0cc646dcbfbb4b9390336436` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:46.879510 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-54a29634-0ad4-44d3-9296-b9834eac07be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:50:46.879510 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:46.879510 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:46.879510 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:46.879510 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:46.879510 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:46.879510 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:46.879510 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:46.879510 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:46.879510 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:46.879510 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:46.879510 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:46.879510 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:46.879510 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:46.879510 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:46.879510 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:46.880472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:46.880472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:46.880472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:46.880472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:46.880472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:46.880472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:46.880472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:46.880472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:46.880472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:46.880472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:46.880472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:46.880472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:46.880472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:46.880472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:46.880472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:46.880472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:46.881273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:46.881273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:46.881273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:46.881273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:46.881273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:46.881273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:46.881273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:46.881273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:46.881273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:46.881273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:46.881273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:50:46.881273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:50:46.881273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 92/189] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 01:50:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:50:46.881906 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a29634-0ad4-44d3-9296-b9834eac07be None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:46.895722 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12965b71-d639-4f35-b944-7e3c1784a73c None admin] RBAC: Authorizing `identity:get_user(user_id=81bb186b0cc646dcbfbb4b9390336436)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:46.897303 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12965b71-d639-4f35-b944-7e3c1784a73c None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:46.899780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 98/190] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:46 2022] GET /identity/v3/users/81bb186b0cc646dcbfbb4b9390336436 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:46.900005 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12965b71-d639-4f35-b944-7e3c1784a73c None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:46.949860 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:47.001508 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a29634-0ad4-44d3-9296-b9834eac07be None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:47.004771 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12965b71-d639-4f35-b944-7e3c1784a73c None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:47.013272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:47.038986 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c067c-024b-40d8-90cd-fa3b73df6d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:47.039672 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c067c-024b-40d8-90cd-fa3b73df6d63 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:47.039960 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c067c-024b-40d8-90cd-fa3b73df6d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:47.040232 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c067c-024b-40d8-90cd-fa3b73df6d63 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:47.040978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c067c-024b-40d8-90cd-fa3b73df6d63 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:47.041072 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a6c20-0742-49cb-af39-93968788a0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:47.041283 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c067c-024b-40d8-90cd-fa3b73df6d63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:47.041838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a6c20-0742-49cb-af39-93968788a0da None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:47.042124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a6c20-0742-49cb-af39-93968788a0da None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:47.042404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a6c20-0742-49cb-af39-93968788a0da None admin] PATH_INFO: `/v3/domains/default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:47.042677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c067c-024b-40d8-90cd-fa3b73df6d63 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:47.043620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a6c20-0742-49cb-af39-93968788a0da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:47.045313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a6c20-0742-49cb-af39-93968788a0da None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:47.051497 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 93/191] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:50:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:47.051497 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a6c20-0742-49cb-af39-93968788a0da None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:47.061388 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 99/192] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:50:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:47.061388 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c067c-024b-40d8-90cd-fa3b73df6d63 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:47.158224 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c067c-024b-40d8-90cd-fa3b73df6d63 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:47.158726 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a6c20-0742-49cb-af39-93968788a0da None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:47.166180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:47.194204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6d834-10cc-426d-9bfe-c66e78d6af71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:47.194880 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6d834-10cc-426d-9bfe-c66e78d6af71 None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:47.195160 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6d834-10cc-426d-9bfe-c66e78d6af71 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:47.195449 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6d834-10cc-426d-9bfe-c66e78d6af71 None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:47.196164 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6d834-10cc-426d-9bfe-c66e78d6af71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:47.197190 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a979b-31cb-4719-ab0b-e2293bb58ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:47.197610 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6d834-10cc-426d-9bfe-c66e78d6af71 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:47.197854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a979b-31cb-4719-ab0b-e2293bb58ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:47.198138 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a979b-31cb-4719-ab0b-e2293bb58ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:47.198416 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a979b-31cb-4719-ab0b-e2293bb58ed4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:47.227537 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 100/193] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 01:50:47 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:50:47.227537 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6d834-10cc-426d-9bfe-c66e78d6af71 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:47.275568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:47.312213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a979b-31cb-4719-ab0b-e2293bb58ed4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:47.314694 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a979b-31cb-4719-ab0b-e2293bb58ed4 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:47.340323 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6d834-10cc-426d-9bfe-c66e78d6af71 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:47.382841 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00f56b-d798-497d-ba8f-accbe4734111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:47.382841 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00f56b-d798-497d-ba8f-accbe4734111 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:47.383141 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00f56b-d798-497d-ba8f-accbe4734111 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:47.383210 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00f56b-d798-497d-ba8f-accbe4734111 None admin] PATH_INFO: `/v3/users/81bb186b0cc646dcbfbb4b9390336436` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:47.384919 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00f56b-d798-497d-ba8f-accbe4734111 None admin] RBAC: Authorizing `identity:get_user(user_id=81bb186b0cc646dcbfbb4b9390336436)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:47.386625 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00f56b-d798-497d-ba8f-accbe4734111 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:47.388685 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 101/194] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:47 2022] GET /identity/v3/users/81bb186b0cc646dcbfbb4b9390336436 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:47.396032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00f56b-d798-497d-ba8f-accbe4734111 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:47.438944 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:47.460329 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 94/195] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:50:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:50:47.465764 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a979b-31cb-4719-ab0b-e2293bb58ed4 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:47.538815 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00f56b-d798-497d-ba8f-accbe4734111 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:47.566708 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:47.587786 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc6cc9-ee48-42f1-8d6b-3321be043ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:47.588481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc6cc9-ee48-42f1-8d6b-3321be043ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:47.588769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc6cc9-ee48-42f1-8d6b-3321be043ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:47.589032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc6cc9-ee48-42f1-8d6b-3321be043ce7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:47.601262 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a979b-31cb-4719-ab0b-e2293bb58ed4 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:47.648573 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fb0f0-d942-4a4b-96da-6a767946a24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:47.649833 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fb0f0-d942-4a4b-96da-6a767946a24f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:47.650111 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fb0f0-d942-4a4b-96da-6a767946a24f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:47.650383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fb0f0-d942-4a4b-96da-6a767946a24f None admin] PATH_INFO: `/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:47.651630 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fb0f0-d942-4a4b-96da-6a767946a24f None admin] RBAC: Authorizing `identity:get_project(project_id=e3059ec0bd6649c8bd24c1e0a5b48c39)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:47.653679 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fb0f0-d942-4a4b-96da-6a767946a24f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:47.656690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 95/196] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:47 2022] GET /identity/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:47.662197 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fb0f0-d942-4a4b-96da-6a767946a24f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:47.676312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc6cc9-ee48-42f1-8d6b-3321be043ce7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:47.678671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc6cc9-ee48-42f1-8d6b-3321be043ce7 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:47.719307 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:47.771768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fb0f0-d942-4a4b-96da-6a767946a24f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:47.804960 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 102/197] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:50:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 01:50:47.810509 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc6cc9-ee48-42f1-8d6b-3321be043ce7 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:47.816725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4acb76-e728-4df6-94d5-45849a691f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:47.818413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4acb76-e728-4df6-94d5-45849a691f9d None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:47.818708 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4acb76-e728-4df6-94d5-45849a691f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:47.818983 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4acb76-e728-4df6-94d5-45849a691f9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:47.820414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4acb76-e728-4df6-94d5-45849a691f9d None admin] RBAC: Adding query filter params (role.id=58e04437159e4eb39aa4a43c213ea34c, scope.project.id=e3059ec0bd6649c8bd24c1e0a5b48c39, user.id=81bb186b0cc646dcbfbb4b9390336436) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:47.820725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4acb76-e728-4df6-94d5-45849a691f9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:47.822671 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4acb76-e728-4df6-94d5-45849a691f9d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:47.831221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 96/198] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:50:47 2022] GET /identity/v3/role_assignments?user.id=81bb186b0cc646dcbfbb4b9390336436&scope.project.id=e3059ec0bd6649c8bd24c1e0a5b48c39&role.id=58e04437159e4eb39aa4a43c213ea34c => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:47.903770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884be3ba-b212-4ebc-b3da-8fabe6242cdd None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:47.904116 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884be3ba-b212-4ebc-b3da-8fabe6242cdd None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:47.904322 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884be3ba-b212-4ebc-b3da-8fabe6242cdd None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:47.905973 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 97/199] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:50:47.915271 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7d1e4-0281-4d2d-9a48-9897f60ce585 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:47.915979 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7d1e4-0281-4d2d-9a48-9897f60ce585 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:47.916377 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7d1e4-0281-4d2d-9a48-9897f60ce585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:47.938788 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-b3f7d1e4-0281-4d2d-9a48-9897f60ce585 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:47.940096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-b3f7d1e4-0281-4d2d-9a48-9897f60ce585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:47.944588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:48.021124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 98/200] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:50:48.039836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc6cc9-ee48-42f1-8d6b-3321be043ce7 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:48.044553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7d1e4-0281-4d2d-9a48-9897f60ce585 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:48.105322 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4a93e-0a5c-43ef-99b6-c36b08dada18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:48.106569 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4a93e-0a5c-43ef-99b6-c36b08dada18 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:48.106846 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4a93e-0a5c-43ef-99b6-c36b08dada18 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:48.107115 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4a93e-0a5c-43ef-99b6-c36b08dada18 None admin] PATH_INFO: `/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:48.108711 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4a93e-0a5c-43ef-99b6-c36b08dada18 None admin] RBAC: Authorizing `identity:get_project(project_id=e3059ec0bd6649c8bd24c1e0a5b48c39)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:48.110783 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4a93e-0a5c-43ef-99b6-c36b08dada18 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:48.112882 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 103/201] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:47 2022] GET /identity/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39 => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:48.115862 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:48.119537 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4a93e-0a5c-43ef-99b6-c36b08dada18 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:48.214172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7d1e4-0281-4d2d-9a48-9897f60ce585 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:48.230065 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4a93e-0a5c-43ef-99b6-c36b08dada18 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:48.266336 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838ed8f-6510-4801-b105-cc876600d4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:48.267102 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838ed8f-6510-4801-b105-cc876600d4ea None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:48.267389 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838ed8f-6510-4801-b105-cc876600d4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:48.267689 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838ed8f-6510-4801-b105-cc876600d4ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:48.268529 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838ed8f-6510-4801-b105-cc876600d4ea None admin] RBAC: Adding query filter params (role.id=77aca4b95bbe47cbb528be2615112ac4, scope.project.id=e3059ec0bd6649c8bd24c1e0a5b48c39, user.id=81bb186b0cc646dcbfbb4b9390336436) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:48.268838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838ed8f-6510-4801-b105-cc876600d4ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:48.270301 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838ed8f-6510-4801-b105-cc876600d4ea None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:48.276485 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 104/202] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:50:48 2022] GET /identity/v3/role_assignments?user.id=81bb186b0cc646dcbfbb4b9390336436&scope.project.id=e3059ec0bd6649c8bd24c1e0a5b48c39&role.id=77aca4b95bbe47cbb528be2615112ac4 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:48.301962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422a8fd-9eb9-46cf-aafb-141512ada4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:48.302822 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422a8fd-9eb9-46cf-aafb-141512ada4fb None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:48.303110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422a8fd-9eb9-46cf-aafb-141512ada4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:48.303387 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422a8fd-9eb9-46cf-aafb-141512ada4fb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:48.324748 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:48.328871 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422a8fd-9eb9-46cf-aafb-141512ada4fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:48.344283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-8422a8fd-9eb9-46cf-aafb-141512ada4fb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 01:50:48.344283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:48.344283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:48.344283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:48.344283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:48.344283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:48.344283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:48.344283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:48.344283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:48.344283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:48.344283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:48.344283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:48.344283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:48.344283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:48.344283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:48.344283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:48.345286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:48.345286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:48.345286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:48.345286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:48.345286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:48.345286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:48.345286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:48.345286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:48.345286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:48.345286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:48.345286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:48.345286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:48.345286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:48.345286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:48.345286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:48.345286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:48.346813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:48.346813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:48.346813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:48.346813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:48.346813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:48.346813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:48.346813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:48.346813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:48.346813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:48.346813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:48.346813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 01:50:48.346813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:50:48.346813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 99/203] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:50:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:50:48.351853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838ed8f-6510-4801-b105-cc876600d4ea None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:48.464923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:48.510266 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838ed8f-6510-4801-b105-cc876600d4ea None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:48.550978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28619813-8b4c-4609-9e47-7b668faa392b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:48.551737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28619813-8b4c-4609-9e47-7b668faa392b None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:48.552184 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28619813-8b4c-4609-9e47-7b668faa392b None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:48.552593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28619813-8b4c-4609-9e47-7b668faa392b None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:48.553367 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28619813-8b4c-4609-9e47-7b668faa392b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:48.553671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28619813-8b4c-4609-9e47-7b668faa392b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:48.555053 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28619813-8b4c-4609-9e47-7b668faa392b None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:48.569863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 105/204] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:50:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:48.575394 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422a8fd-9eb9-46cf-aafb-141512ada4fb None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:48.711299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422a8fd-9eb9-46cf-aafb-141512ada4fb None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:48.757712 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a74b1-d17d-4e80-bab2-7b800bd85104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:48.758643 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a74b1-d17d-4e80-bab2-7b800bd85104 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:48.758979 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a74b1-d17d-4e80-bab2-7b800bd85104 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:48.759251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a74b1-d17d-4e80-bab2-7b800bd85104 None admin] PATH_INFO: `/v3/users/6a573e6e218a47988d2a1feeb70f90bd` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:48.760644 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a74b1-d17d-4e80-bab2-7b800bd85104 None admin] RBAC: Authorizing `identity:get_user(user_id=6a573e6e218a47988d2a1feeb70f90bd)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:48.762145 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a74b1-d17d-4e80-bab2-7b800bd85104 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:48.763931 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 100/205] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:48 2022] GET /identity/v3/users/6a573e6e218a47988d2a1feeb70f90bd => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:48.772593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28619813-8b4c-4609-9e47-7b668faa392b None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:48.903118 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28619813-8b4c-4609-9e47-7b668faa392b None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:48.947899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:48.960061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1153d-84c7-4b1e-b040-4b02b72fbb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:48.960764 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1153d-84c7-4b1e-b040-4b02b72fbb24 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:48.961049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1153d-84c7-4b1e-b040-4b02b72fbb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:48.961317 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1153d-84c7-4b1e-b040-4b02b72fbb24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:49.056849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1153d-84c7-4b1e-b040-4b02b72fbb24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:49.058243 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1153d-84c7-4b1e-b040-4b02b72fbb24 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:49.179231 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 106/206] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:50:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:50:49.184845 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a74b1-d17d-4e80-bab2-7b800bd85104 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:49.268631 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:49.319480 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a74b1-d17d-4e80-bab2-7b800bd85104 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:49.372697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec564a2d-a742-46a4-b734-3f9df69b302b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:49.373598 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec564a2d-a742-46a4-b734-3f9df69b302b None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:49.373878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec564a2d-a742-46a4-b734-3f9df69b302b None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:49.374155 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec564a2d-a742-46a4-b734-3f9df69b302b None admin] PATH_INFO: `/v3/projects/95472ace4fc043ed86453b0002951eec` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:49.375368 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec564a2d-a742-46a4-b734-3f9df69b302b None admin] RBAC: Authorizing `identity:get_project(project_id=95472ace4fc043ed86453b0002951eec)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:49.376856 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec564a2d-a742-46a4-b734-3f9df69b302b None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:49.378577 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 101/207] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:49 2022] GET /identity/v3/projects/95472ace4fc043ed86453b0002951eec => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:49.384512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1153d-84c7-4b1e-b040-4b02b72fbb24 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:49.430857 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:49.509010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1153d-84c7-4b1e-b040-4b02b72fbb24 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:49.553323 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187471f-bd78-4e43-9ddc-0f0385a25084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:49.553992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187471f-bd78-4e43-9ddc-0f0385a25084 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:49.554269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187471f-bd78-4e43-9ddc-0f0385a25084 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:49.554541 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187471f-bd78-4e43-9ddc-0f0385a25084 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:49.555373 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187471f-bd78-4e43-9ddc-0f0385a25084 None admin] RBAC: Adding query filter params (role.id=684d55f3873849f08303658557ed05e8, scope.project.id=95472ace4fc043ed86453b0002951eec, user.id=6a573e6e218a47988d2a1feeb70f90bd) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:49.555703 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187471f-bd78-4e43-9ddc-0f0385a25084 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:49.557171 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187471f-bd78-4e43-9ddc-0f0385a25084 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:49.566737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 107/208] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:50:49 2022] GET /identity/v3/role_assignments?user.id=6a573e6e218a47988d2a1feeb70f90bd&scope.project.id=95472ace4fc043ed86453b0002951eec&role.id=684d55f3873849f08303658557ed05e8 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:49.815762 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48439ea-e1bf-4fb9-b379-7ab9ee22ce1a None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:49.816044 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48439ea-e1bf-4fb9-b379-7ab9ee22ce1a None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:49.816585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48439ea-e1bf-4fb9-b379-7ab9ee22ce1a None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:49.818422 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 102/209] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:49.824208 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb82cb6-812b-456a-a170-c336145366e7 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:49.824769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb82cb6-812b-456a-a170-c336145366e7 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:49.825256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb82cb6-812b-456a-a170-c336145366e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:49.843099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-ccb82cb6-812b-456a-a170-c336145366e7 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:49.844678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-ccb82cb6-812b-456a-a170-c336145366e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:49.919021 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 108/210] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:50:49.947995 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48439ea-e1bf-4fb9-b379-7ab9ee22ce1a None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:50.066190 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48439ea-e1bf-4fb9-b379-7ab9ee22ce1a None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:50.106076 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f14836-77b8-468d-a8e7-818ca58b856e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:50.107264 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f14836-77b8-468d-a8e7-818ca58b856e None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:50.107774 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f14836-77b8-468d-a8e7-818ca58b856e None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:50.108262 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f14836-77b8-468d-a8e7-818ca58b856e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:50.111245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:50.122805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f14836-77b8-468d-a8e7-818ca58b856e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:50.131318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-55f14836-77b8-468d-a8e7-818ca58b856e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:50:50.131318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:50.131318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:50.131318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:50.131318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:50.131318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:50.131318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:50.131318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:50.131318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:50.131318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:50.131318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:50.131318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:50.131318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:50.131318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:50.131318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:50.131318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:50.132275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:50.132275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:50.132275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:50.132275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:50.132275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:50.132275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:50.132275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:50.132275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:50.132275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:50.132275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:50.132275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:50.132275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:50.132275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:50.132275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:50.132275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:50.132275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:50.133052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:50.133052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:50.133052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:50.133052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:50.133052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:50.133052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:50.133052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:50.133052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:50.133052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:50.133052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:50.133052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:50:50.133052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:50:50.135442 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 103/211] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:50:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:50:50.141438 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb82cb6-812b-456a-a170-c336145366e7 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:50.161736 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:50.225599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dfd22-25d2-48c7-86a5-470b979c57b0 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:50.226110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dfd22-25d2-48c7-86a5-470b979c57b0 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:50.226181 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dfd22-25d2-48c7-86a5-470b979c57b0 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:50.227886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 104/212] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:50.235305 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8789f8-689b-4229-af9e-20b32dfaaf5e None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:50.235648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8789f8-689b-4229-af9e-20b32dfaaf5e None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:50.235930 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8789f8-689b-4229-af9e-20b32dfaaf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:50.256347 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-fe8789f8-689b-4229-af9e-20b32dfaaf5e None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:50.257863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-fe8789f8-689b-4229-af9e-20b32dfaaf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:50.258590 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb82cb6-812b-456a-a170-c336145366e7 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:50.307572 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38a7b9-21d3-4ac1-adf3-6e16265ba1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:50.307572 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38a7b9-21d3-4ac1-adf3-6e16265ba1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:50.307572 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38a7b9-21d3-4ac1-adf3-6e16265ba1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:50.307572 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38a7b9-21d3-4ac1-adf3-6e16265ba1b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:50.308276 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38a7b9-21d3-4ac1-adf3-6e16265ba1b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:50.308925 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38a7b9-21d3-4ac1-adf3-6e16265ba1b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:50.310635 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38a7b9-21d3-4ac1-adf3-6e16265ba1b9 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:50.325200 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 109/213] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:50:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:50:50.330423 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38a7b9-21d3-4ac1-adf3-6e16265ba1b9 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:50.337240 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 105/214] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:50:50.361118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8789f8-689b-4229-af9e-20b32dfaaf5e None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:50.429570 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:50.451480 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38a7b9-21d3-4ac1-adf3-6e16265ba1b9 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:50.478362 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8789f8-689b-4229-af9e-20b32dfaaf5e None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:50.488093 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6d1d1-1298-48af-a2e1-0b5a0f562640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:50.489001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6d1d1-1298-48af-a2e1-0b5a0f562640 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:50.489707 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6d1d1-1298-48af-a2e1-0b5a0f562640 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:50.490042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6d1d1-1298-48af-a2e1-0b5a0f562640 None admin] PATH_INFO: `/v3/users/e417a8906aa64d86a7cd115f4a6720ec` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:50.504041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6d1d1-1298-48af-a2e1-0b5a0f562640 None admin] RBAC: Authorizing `identity:get_user(user_id=e417a8906aa64d86a7cd115f4a6720ec)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:50.505626 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6d1d1-1298-48af-a2e1-0b5a0f562640 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:50.505986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:50.511676 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 110/215] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:50 2022] GET /identity/v3/users/e417a8906aa64d86a7cd115f4a6720ec => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:50.511676 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6956fd-11bf-4dda-a996-241bad813232 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:50.511676 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6956fd-11bf-4dda-a996-241bad813232 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:50.511676 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6956fd-11bf-4dda-a996-241bad813232 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:50.511676 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 111/216] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:50.515986 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6956fd-11bf-4dda-a996-241bad813232 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:50.520627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabe49f-94dc-4c68-8b6a-6b2839885212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:50.521696 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabe49f-94dc-4c68-8b6a-6b2839885212 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:50.521981 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabe49f-94dc-4c68-8b6a-6b2839885212 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:50.522255 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabe49f-94dc-4c68-8b6a-6b2839885212 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:50.523491 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabe49f-94dc-4c68-8b6a-6b2839885212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:50.524959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabe49f-94dc-4c68-8b6a-6b2839885212 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:50.526611 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 106/217] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:50:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:50.527824 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4107f98-6877-4e55-8f42-5650dcae38cd None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:50.528106 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4107f98-6877-4e55-8f42-5650dcae38cd None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:50.528379 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4107f98-6877-4e55-8f42-5650dcae38cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:50.548291 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-c4107f98-6877-4e55-8f42-5650dcae38cd None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:50.549488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-c4107f98-6877-4e55-8f42-5650dcae38cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:50.627534 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 107/218] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:50.627534 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4107f98-6877-4e55-8f42-5650dcae38cd None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:50.638533 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6956fd-11bf-4dda-a996-241bad813232 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:50.674590 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5137e5a-fb8a-49d9-874c-eec7452ad1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:50.675255 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5137e5a-fb8a-49d9-874c-eec7452ad1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:50.675573 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5137e5a-fb8a-49d9-874c-eec7452ad1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:50.675865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5137e5a-fb8a-49d9-874c-eec7452ad1a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:50.684282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:50.728091 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4107f98-6877-4e55-8f42-5650dcae38cd None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:50.745609 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5137e5a-fb8a-49d9-874c-eec7452ad1a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:50.747104 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5137e5a-fb8a-49d9-874c-eec7452ad1a0 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:50.752738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:50.764768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbecf8-6a4f-42e6-92ea-523644412f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:50.765556 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbecf8-6a4f-42e6-92ea-523644412f0d None admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:50.765836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbecf8-6a4f-42e6-92ea-523644412f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:50.766206 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbecf8-6a4f-42e6-92ea-523644412f0d None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:50.766935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbecf8-6a4f-42e6-92ea-523644412f0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:50.768418 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbecf8-6a4f-42e6-92ea-523644412f0d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:50.789981 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 108/219] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 01:50:50 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:50:50.790807 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbecf8-6a4f-42e6-92ea-523644412f0d None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:50.878245 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 112/220] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:50:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:50:50.880990 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812d3c2-e413-4910-9659-90c91a4ebc6f None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:50.881570 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812d3c2-e413-4910-9659-90c91a4ebc6f None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:50.881856 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812d3c2-e413-4910-9659-90c91a4ebc6f None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:50.883643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 113/221] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:50.889261 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812d3c2-e413-4910-9659-90c91a4ebc6f None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:50.921733 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbecf8-6a4f-42e6-92ea-523644412f0d None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:50.948872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:50.961864 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad088c54-63a8-4e07-a236-660adc3fdd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:50.962719 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad088c54-63a8-4e07-a236-660adc3fdd17 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:50.962981 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad088c54-63a8-4e07-a236-660adc3fdd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:50.963344 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad088c54-63a8-4e07-a236-660adc3fdd17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:50.973987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad088c54-63a8-4e07-a236-660adc3fdd17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:50.982484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-ad088c54-63a8-4e07-a236-660adc3fdd17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:50:50.982484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:50.982484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:50.982484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:50.982484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:50.982484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:50.982484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:50.982484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:50.982484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:50.982484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:50.982484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:50.982484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:50.982484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:50.982484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:50.982484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:50.982484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:50.983390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:50.983390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:50.983390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:50.983390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:50.983390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:50.983390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:50.983390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:50.983390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:50.983390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:50.983390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:50.983390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:50.983390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:50.983390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:50.983390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:50.983390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:50.983390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:50.984220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:50.984220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:50.984220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:50.984220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:50.984220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:50.984220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:50.984220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:50.984220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:50.984220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:50.984220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:50.984220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:50:50.984220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:50:50.984220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 109/222] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:50:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:50:50.984920 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58999ee8-3001-4ce0-8cd2-fd4a08c2d7fc None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:50.985203 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58999ee8-3001-4ce0-8cd2-fd4a08c2d7fc None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:50.985475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58999ee8-3001-4ce0-8cd2-fd4a08c2d7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:51.003387 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-58999ee8-3001-4ce0-8cd2-fd4a08c2d7fc None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:51.004930 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-58999ee8-3001-4ce0-8cd2-fd4a08c2d7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:51.027432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812d3c2-e413-4910-9659-90c91a4ebc6f None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:51.050236 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:51.075915 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575822a-9320-45fd-a2d8-830f6001e211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:51.076853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575822a-9320-45fd-a2d8-830f6001e211 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:51.077140 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575822a-9320-45fd-a2d8-830f6001e211 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:51.077417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575822a-9320-45fd-a2d8-830f6001e211 None admin] PATH_INFO: `/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:51.078702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575822a-9320-45fd-a2d8-830f6001e211 None admin] RBAC: Authorizing `identity:get_project(project_id=e3059ec0bd6649c8bd24c1e0a5b48c39)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:51.081096 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575822a-9320-45fd-a2d8-830f6001e211 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:51.087555 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 114/223] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:50 2022] GET /identity/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:51.088466 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575822a-9320-45fd-a2d8-830f6001e211 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:51.094781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 110/224] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:51.095697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58999ee8-3001-4ce0-8cd2-fd4a08c2d7fc None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:51.210173 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58999ee8-3001-4ce0-8cd2-fd4a08c2d7fc None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:51.228364 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575822a-9320-45fd-a2d8-830f6001e211 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:51.238189 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:51.249995 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a9f5d-61bb-4da5-b4b0-8a140173cbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:51.251406 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a9f5d-61bb-4da5-b4b0-8a140173cbee None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:51.251881 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a9f5d-61bb-4da5-b4b0-8a140173cbee None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:51.252476 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a9f5d-61bb-4da5-b4b0-8a140173cbee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:51.253487 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a9f5d-61bb-4da5-b4b0-8a140173cbee None admin] RBAC: Adding query filter params (role.id=51b1227b19794e6fb73ae32c4d0165fb, scope.project.id=e3059ec0bd6649c8bd24c1e0a5b48c39, user.id=e417a8906aa64d86a7cd115f4a6720ec) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:51.253970 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a9f5d-61bb-4da5-b4b0-8a140173cbee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:51.256138 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a9f5d-61bb-4da5-b4b0-8a140173cbee None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:51.263121 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 111/225] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:50:51 2022] GET /identity/v3/role_assignments?user.id=e417a8906aa64d86a7cd115f4a6720ec&scope.project.id=e3059ec0bd6649c8bd24c1e0a5b48c39&role.id=51b1227b19794e6fb73ae32c4d0165fb => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:51.264252 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a9f5d-61bb-4da5-b4b0-8a140173cbee None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:51.271049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52450efd-4f4d-43fe-aee9-8d5ddf5518e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:51.271872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52450efd-4f4d-43fe-aee9-8d5ddf5518e3 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:51.272212 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52450efd-4f4d-43fe-aee9-8d5ddf5518e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:51.272547 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52450efd-4f4d-43fe-aee9-8d5ddf5518e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:51.273400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52450efd-4f4d-43fe-aee9-8d5ddf5518e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:51.273775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52450efd-4f4d-43fe-aee9-8d5ddf5518e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:51.276124 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52450efd-4f4d-43fe-aee9-8d5ddf5518e3 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:51.291463 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 115/226] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:50:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:51.293514 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52450efd-4f4d-43fe-aee9-8d5ddf5518e3 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:51.317400 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:51.400550 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a9f5d-61bb-4da5-b4b0-8a140173cbee None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:51.413946 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52450efd-4f4d-43fe-aee9-8d5ddf5518e3 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:51.454683 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65d7c4-99db-4be8-9e10-0f4b6334a2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:51.454683 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65d7c4-99db-4be8-9e10-0f4b6334a2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:51.454683 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65d7c4-99db-4be8-9e10-0f4b6334a2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:51.454683 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65d7c4-99db-4be8-9e10-0f4b6334a2e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:51.464073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceef350-5e83-439d-b643-1481f01b270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:51.465229 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceef350-5e83-439d-b643-1481f01b270d None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:51.465700 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceef350-5e83-439d-b643-1481f01b270d None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:51.466372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceef350-5e83-439d-b643-1481f01b270d None admin] PATH_INFO: `/v3/users/81bb186b0cc646dcbfbb4b9390336436` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:51.475105 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceef350-5e83-439d-b643-1481f01b270d None admin] RBAC: Authorizing `identity:get_user(user_id=81bb186b0cc646dcbfbb4b9390336436)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:51.476905 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceef350-5e83-439d-b643-1481f01b270d None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:51.482517 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 116/227] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:51 2022] GET /identity/v3/users/81bb186b0cc646dcbfbb4b9390336436 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:50:51.483634 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65d7c4-99db-4be8-9e10-0f4b6334a2e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:51.492446 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceef350-5e83-439d-b643-1481f01b270d None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:51.497087 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-2f65d7c4-99db-4be8-9e10-0f4b6334a2e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:50:51.497087 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:51.497087 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:51.497087 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:51.497087 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:51.497087 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:51.497087 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:51.497087 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:51.497087 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:51.497087 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:51.497087 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:51.497087 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:51.497087 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:51.497087 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:51.497087 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:51.497087 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:51.498161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:51.498161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:51.498161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:51.498161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:51.498161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:51.498161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:51.498161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:51.498161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:51.498161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:51.498161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:51.498161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:51.498161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:51.498161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:51.498161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:51.498161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:51.498161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:51.498928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:51.498928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:51.498928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:51.498928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:51.498928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:51.498928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:51.498928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:51.498928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:51.498928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:51.498928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:51.498928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:50:51.498928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:50:51.508062 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 112/228] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 01:50:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:50:51.512641 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65d7c4-99db-4be8-9e10-0f4b6334a2e9 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:51.559775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:51.671340 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceef350-5e83-439d-b643-1481f01b270d None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:51.679770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:51.691268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65d7c4-99db-4be8-9e10-0f4b6334a2e9 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:51.734812 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ee13b-fd01-4cea-9c17-278f10ac3500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:51.735554 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ee13b-fd01-4cea-9c17-278f10ac3500 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:51.735844 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ee13b-fd01-4cea-9c17-278f10ac3500 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:51.736123 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ee13b-fd01-4cea-9c17-278f10ac3500 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:51.736891 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ee13b-fd01-4cea-9c17-278f10ac3500 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:51.737201 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ee13b-fd01-4cea-9c17-278f10ac3500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:51.739568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ee13b-fd01-4cea-9c17-278f10ac3500 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:51.754531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 113/229] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:50:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:50:51.755699 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec35ee-0ca0-4af1-be1c-020113e72225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:51.756578 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec35ee-0ca0-4af1-be1c-020113e72225 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:51.756858 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec35ee-0ca0-4af1-be1c-020113e72225 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:51.757131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec35ee-0ca0-4af1-be1c-020113e72225 None admin] PATH_INFO: `/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:51.758351 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec35ee-0ca0-4af1-be1c-020113e72225 None admin] RBAC: Authorizing `identity:get_project(project_id=e3059ec0bd6649c8bd24c1e0a5b48c39)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:51.759846 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec35ee-0ca0-4af1-be1c-020113e72225 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:51.761550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 117/230] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:51 2022] GET /identity/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:51.762470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ee13b-fd01-4cea-9c17-278f10ac3500 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:51.767680 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec35ee-0ca0-4af1-be1c-020113e72225 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:51.909526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ee13b-fd01-4cea-9c17-278f10ac3500 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:51.943347 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b1565-6269-4f05-b4d1-6ba3803835b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:51.944271 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b1565-6269-4f05-b4d1-6ba3803835b2 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:51.944553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b1565-6269-4f05-b4d1-6ba3803835b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:51.944830 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b1565-6269-4f05-b4d1-6ba3803835b2 None admin] PATH_INFO: `/v3/users/81bb186b0cc646dcbfbb4b9390336436` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:51.946088 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b1565-6269-4f05-b4d1-6ba3803835b2 None admin] RBAC: Authorizing `identity:get_user(user_id=81bb186b0cc646dcbfbb4b9390336436)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:51.947626 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b1565-6269-4f05-b4d1-6ba3803835b2 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:51.953856 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 114/231] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:51 2022] GET /identity/v3/users/81bb186b0cc646dcbfbb4b9390336436 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:51.954694 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b1565-6269-4f05-b4d1-6ba3803835b2 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:51.957453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec35ee-0ca0-4af1-be1c-020113e72225 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:51.963894 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:51.999919 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:52.062853 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b1565-6269-4f05-b4d1-6ba3803835b2 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:52.089024 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce9956-e791-4e0c-9fc4-c6fc75217bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:52.089949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce9956-e791-4e0c-9fc4-c6fc75217bed None admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:52.090279 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce9956-e791-4e0c-9fc4-c6fc75217bed None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:52.090554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce9956-e791-4e0c-9fc4-c6fc75217bed None admin] PATH_INFO: `/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39/users/81bb186b0cc646dcbfbb4b9390336436/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:52.096768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce9956-e791-4e0c-9fc4-c6fc75217bed None admin] RBAC: Authorizing `identity:create_grant(project_id=e3059ec0bd6649c8bd24c1e0a5b48c39, user_id=81bb186b0cc646dcbfbb4b9390336436, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:52.096907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ec31f-d897-45ab-96ea-afe03412a22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:52.097746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ec31f-d897-45ab-96ea-afe03412a22e None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:52.098035 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ec31f-d897-45ab-96ea-afe03412a22e None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:52.098241 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce9956-e791-4e0c-9fc4-c6fc75217bed None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:52.098341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ec31f-d897-45ab-96ea-afe03412a22e None admin] PATH_INFO: `/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:52.099803 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ec31f-d897-45ab-96ea-afe03412a22e None admin] RBAC: Authorizing `identity:get_project(project_id=e3059ec0bd6649c8bd24c1e0a5b48c39)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:52.101276 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ec31f-d897-45ab-96ea-afe03412a22e None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:52.103350 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 115/232] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:51 2022] GET /identity/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:52.108898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ec31f-d897-45ab-96ea-afe03412a22e None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:52.128288 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 118/233] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:50:51 2022] PUT /identity/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39/users/81bb186b0cc646dcbfbb4b9390336436/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:50:52.213324 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:52.222489 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ec31f-d897-45ab-96ea-afe03412a22e None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:52.259916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc168896-de28-469e-be47-623853c72d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:52.260753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc168896-de28-469e-be47-623853c72d26 None admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:52.261033 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc168896-de28-469e-be47-623853c72d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:52.261308 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc168896-de28-469e-be47-623853c72d26 None admin] PATH_INFO: `/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39/users/81bb186b0cc646dcbfbb4b9390336436/roles/77aca4b95bbe47cbb528be2615112ac4` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:52.263592 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc168896-de28-469e-be47-623853c72d26 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3059ec0bd6649c8bd24c1e0a5b48c39, user_id=81bb186b0cc646dcbfbb4b9390336436, role_id=77aca4b95bbe47cbb528be2615112ac4)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:52.265082 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc168896-de28-469e-be47-623853c72d26 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:52.293492 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 116/234] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:50:52 2022] PUT /identity/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39/users/81bb186b0cc646dcbfbb4b9390336436/roles/77aca4b95bbe47cbb528be2615112ac4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 01:50:53.221810 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15fb5c-5761-44ea-8d13-f3bfe3204690 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:53.222794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15fb5c-5761-44ea-8d13-f3bfe3204690 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:53.223278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15fb5c-5761-44ea-8d13-f3bfe3204690 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:53.225306 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 119/235] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:53.231057 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb0f9c-9a34-4809-9284-652dd2c273ca None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:53.231636 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb0f9c-9a34-4809-9284-652dd2c273ca None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:53.232129 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb0f9c-9a34-4809-9284-652dd2c273ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:53.260504 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-facb0f9c-9a34-4809-9284-652dd2c273ca None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:53.262488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-facb0f9c-9a34-4809-9284-652dd2c273ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:53.353135 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 117/236] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:50:53.400949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15fb5c-5761-44ea-8d13-f3bfe3204690 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:53.458340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44aad6-a544-4fc3-af81-74692d39445b None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:53.459126 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44aad6-a544-4fc3-af81-74692d39445b None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:53.459657 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44aad6-a544-4fc3-af81-74692d39445b None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:53.461263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 118/237] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:50:53.467532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5340e9-c1eb-436e-af9a-159a6b62ad4f None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:53.468066 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5340e9-c1eb-436e-af9a-159a6b62ad4f None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:53.468539 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5340e9-c1eb-436e-af9a-159a6b62ad4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:53.486746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-7c5340e9-c1eb-436e-af9a-159a6b62ad4f None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:53.488695 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-7c5340e9-c1eb-436e-af9a-159a6b62ad4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:53.568078 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 119/238] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:50:53.591286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5340e9-c1eb-436e-af9a-159a6b62ad4f None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:53.599001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15fb5c-5761-44ea-8d13-f3bfe3204690 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:53.631798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:53.659976 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd358b-eef4-4fe6-8518-2eb69b326d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:53.660788 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd358b-eef4-4fe6-8518-2eb69b326d07 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:53.661209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd358b-eef4-4fe6-8518-2eb69b326d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:53.661491 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd358b-eef4-4fe6-8518-2eb69b326d07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:53.662689 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd358b-eef4-4fe6-8518-2eb69b326d07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:53.664188 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd358b-eef4-4fe6-8518-2eb69b326d07 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:53.665950 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 120/239] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:50:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:53.671550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd358b-eef4-4fe6-8518-2eb69b326d07 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:53.705483 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:53.781350 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd358b-eef4-4fe6-8518-2eb69b326d07 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:53.814580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5340e9-c1eb-436e-af9a-159a6b62ad4f None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:53.817098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d6277-92e6-420d-bf2f-94a73ad9a2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:53.817937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d6277-92e6-420d-bf2f-94a73ad9a2b6 None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:53.818220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d6277-92e6-420d-bf2f-94a73ad9a2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:53.818504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d6277-92e6-420d-bf2f-94a73ad9a2b6 None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:53.819238 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d6277-92e6-420d-bf2f-94a73ad9a2b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:53.820872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d6277-92e6-420d-bf2f-94a73ad9a2b6 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:53.851579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 121/240] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 01:50:53 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:50:53.858442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8a6b0-8ccc-4d3e-88e3-f49cc15a1021 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:53.859047 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8a6b0-8ccc-4d3e-88e3-f49cc15a1021 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:53.859555 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8a6b0-8ccc-4d3e-88e3-f49cc15a1021 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:53.861273 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 122/241] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:50:53.867236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45eba7a-02cd-43fe-8272-29a498276a50 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:53.867911 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45eba7a-02cd-43fe-8272-29a498276a50 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:53.868381 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45eba7a-02cd-43fe-8272-29a498276a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:53.896967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-e45eba7a-02cd-43fe-8272-29a498276a50 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:53.897945 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9610d-7825-4d41-a098-248f599a2776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:53.899024 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9610d-7825-4d41-a098-248f599a2776 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:53.899600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9610d-7825-4d41-a098-248f599a2776 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:53.900067 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9610d-7825-4d41-a098-248f599a2776 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:53.902318 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-e45eba7a-02cd-43fe-8272-29a498276a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:53.936584 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9610d-7825-4d41-a098-248f599a2776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:53.948980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-f2b9610d-7825-4d41-a098-248f599a2776 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 01:50:53.948980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:53.948980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:53.948980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:53.948980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:53.948980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:53.948980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:53.948980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:53.948980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:53.948980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:53.948980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:53.948980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:53.948980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:53.948980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:53.948980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:53.948980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:53.949961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:53.949961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:53.949961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:53.949961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:53.949961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:53.949961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:53.949961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:53.949961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:53.949961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:53.949961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:53.949961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:53.949961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:53.949961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:53.949961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:53.949961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:53.949961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:53.950777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:53.950777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:53.950777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:53.950777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:53.950777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:53.950777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:53.950777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:53.950777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:53.950777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:53.950777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:53.950777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 01:50:53.950777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:50:53.959779 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 120/242] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:50:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:50:53.965455 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9610d-7825-4d41-a098-248f599a2776 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:54.059142 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 123/243] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:50:54.092550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45eba7a-02cd-43fe-8272-29a498276a50 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:54.095722 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:54.115063 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:54.138522 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9610d-7825-4d41-a098-248f599a2776 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:54.182447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5e4a0-663b-4eff-9968-f90f44d83d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:54.184116 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5e4a0-663b-4eff-9968-f90f44d83d3f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:54.184633 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5e4a0-663b-4eff-9968-f90f44d83d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:54.185109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5e4a0-663b-4eff-9968-f90f44d83d3f None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:54.186829 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5e4a0-663b-4eff-9968-f90f44d83d3f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:54.187768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5e4a0-663b-4eff-9968-f90f44d83d3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:54.189549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5e4a0-663b-4eff-9968-f90f44d83d3f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:54.203607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 121/244] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:50:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:54.208315 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5e4a0-663b-4eff-9968-f90f44d83d3f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:54.220900 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45eba7a-02cd-43fe-8272-29a498276a50 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:54.267022 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3f303-91fb-4bc9-945c-1f2f8f8aaea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:54.269279 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3f303-91fb-4bc9-945c-1f2f8f8aaea8 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:54.269783 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3f303-91fb-4bc9-945c-1f2f8f8aaea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:54.270254 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3f303-91fb-4bc9-945c-1f2f8f8aaea8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:54.285292 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3f303-91fb-4bc9-945c-1f2f8f8aaea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:54.296169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-fac3f303-91fb-4bc9-945c-1f2f8f8aaea8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:50:54.296169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:54.296169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:54.296169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:54.296169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:54.296169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:54.296169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:54.296169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:54.296169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:54.296169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:54.296169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:54.296169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:54.296169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:54.296169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:54.296169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:54.296169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:54.297137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:54.297137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:54.297137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:54.297137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:54.297137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:54.297137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:54.297137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:54.297137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:54.297137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:54.297137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:54.297137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:54.297137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:54.297137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:54.297137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:54.297137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:54.297137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:54.297928 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:54.297928 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:54.297928 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:54.297928 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:54.297928 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:54.297928 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:54.297928 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:54.297928 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:54.297928 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:54.297928 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:54.297928 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:50:54.297928 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:50:54.300572 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 124/245] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:50:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:50:54.307714 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3f303-91fb-4bc9-945c-1f2f8f8aaea8 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:54.336686 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5e4a0-663b-4eff-9968-f90f44d83d3f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:54.379597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4850c6d-ebf7-4957-97f8-f72a142abce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:54.381646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4850c6d-ebf7-4957-97f8-f72a142abce2 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:54.382227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4850c6d-ebf7-4957-97f8-f72a142abce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:54.382898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4850c6d-ebf7-4957-97f8-f72a142abce2 None admin] PATH_INFO: `/v3/users/f9c01225a5234a5197ecea2bde4b693b` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:54.385944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:54.406375 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4850c6d-ebf7-4957-97f8-f72a142abce2 None admin] RBAC: Authorizing `identity:get_user(user_id=f9c01225a5234a5197ecea2bde4b693b)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:54.408644 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4850c6d-ebf7-4957-97f8-f72a142abce2 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:54.415754 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 122/246] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:54 2022] GET /identity/v3/users/f9c01225a5234a5197ecea2bde4b693b => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:54.417087 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:54.417895 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4850c6d-ebf7-4957-97f8-f72a142abce2 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:54.443536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3f303-91fb-4bc9-945c-1f2f8f8aaea8 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:54.484904 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e4205-3c6f-4bd4-a50f-c17e85ed51a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:54.485580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e4205-3c6f-4bd4-a50f-c17e85ed51a9 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:54.485902 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e4205-3c6f-4bd4-a50f-c17e85ed51a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:54.486176 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e4205-3c6f-4bd4-a50f-c17e85ed51a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:54.487040 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e4205-3c6f-4bd4-a50f-c17e85ed51a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:54.487348 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e4205-3c6f-4bd4-a50f-c17e85ed51a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:54.488945 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e4205-3c6f-4bd4-a50f-c17e85ed51a9 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:54.500167 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 125/247] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:50:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:54.505698 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e4205-3c6f-4bd4-a50f-c17e85ed51a9 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:54.551659 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4850c6d-ebf7-4957-97f8-f72a142abce2 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:54.595301 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd7d2f-3a51-4bff-9c71-943f42630524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:54.596016 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd7d2f-3a51-4bff-9c71-943f42630524 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:54.596299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd7d2f-3a51-4bff-9c71-943f42630524 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:54.596573 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd7d2f-3a51-4bff-9c71-943f42630524 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:54.631847 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e4205-3c6f-4bd4-a50f-c17e85ed51a9 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:54.667029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:54.677711 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c538a7-ed25-44d9-9aec-c22c764b2d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:54.678706 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c538a7-ed25-44d9-9aec-c22c764b2d7a None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:54.679060 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c538a7-ed25-44d9-9aec-c22c764b2d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:54.679685 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c538a7-ed25-44d9-9aec-c22c764b2d7a None admin] PATH_INFO: `/v3/users/e417a8906aa64d86a7cd115f4a6720ec` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:54.680518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd7d2f-3a51-4bff-9c71-943f42630524 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:54.681087 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c538a7-ed25-44d9-9aec-c22c764b2d7a None admin] RBAC: Authorizing `identity:get_user(user_id=e417a8906aa64d86a7cd115f4a6720ec)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:54.682459 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd7d2f-3a51-4bff-9c71-943f42630524 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:54.682653 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c538a7-ed25-44d9-9aec-c22c764b2d7a None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:54.684952 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 126/248] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:54 2022] GET /identity/v3/users/e417a8906aa64d86a7cd115f4a6720ec => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:50:54.687775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8435185-8512-4afb-9852-79ee5f8f7800 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:54.688139 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8435185-8512-4afb-9852-79ee5f8f7800 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:54.688489 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8435185-8512-4afb-9852-79ee5f8f7800 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:54.694059 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 127/249] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:54.694059 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8435185-8512-4afb-9852-79ee5f8f7800 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:54.705672 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:54.813647 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8435185-8512-4afb-9852-79ee5f8f7800 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:54.821839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 123/250] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:50:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:50:54.821839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1e0b8-2912-4316-aac4-2567e99ba01c None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:54.821839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1e0b8-2912-4316-aac4-2567e99ba01c None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:54.821839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1e0b8-2912-4316-aac4-2567e99ba01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:54.844788 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-16e1e0b8-2912-4316-aac4-2567e99ba01c None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:54.847103 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-16e1e0b8-2912-4316-aac4-2567e99ba01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:54.859114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8cb3a8-d7c7-45e6-a63f-35f1298f548d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:54.860214 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cb3a8-d7c7-45e6-a63f-35f1298f548d None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:54.860612 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cb3a8-d7c7-45e6-a63f-35f1298f548d None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:54.860953 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cb3a8-d7c7-45e6-a63f-35f1298f548d None admin] PATH_INFO: `/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:54.862220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8cb3a8-d7c7-45e6-a63f-35f1298f548d None admin] RBAC: Authorizing `identity:get_project(project_id=e3059ec0bd6649c8bd24c1e0a5b48c39)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:54.863865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8cb3a8-d7c7-45e6-a63f-35f1298f548d None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:54.865842 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 128/251] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:54 2022] GET /identity/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:54.866844 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8cb3a8-d7c7-45e6-a63f-35f1298f548d None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:54.939234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 124/252] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:54.940120 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1e0b8-2912-4316-aac4-2567e99ba01c None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:54.967509 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:54.970060 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:54.996177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8cb3a8-d7c7-45e6-a63f-35f1298f548d None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:55.034277 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f5abd-5ea6-4018-9ea4-19dbd0364151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:55.035190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f5abd-5ea6-4018-9ea4-19dbd0364151 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:55.035502 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f5abd-5ea6-4018-9ea4-19dbd0364151 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:55.035782 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f5abd-5ea6-4018-9ea4-19dbd0364151 None admin] PATH_INFO: `/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:55.037105 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f5abd-5ea6-4018-9ea4-19dbd0364151 None admin] RBAC: Authorizing `identity:get_project(project_id=e3059ec0bd6649c8bd24c1e0a5b48c39)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:55.038603 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f5abd-5ea6-4018-9ea4-19dbd0364151 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:55.040874 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 129/253] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:54 2022] GET /identity/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:55.042107 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbd9e9-2b7b-4acf-847f-ba917da1521d None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:55.042386 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbd9e9-2b7b-4acf-847f-ba917da1521d None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:55.042657 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbd9e9-2b7b-4acf-847f-ba917da1521d None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:55.044754 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 130/254] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:55.045467 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbd9e9-2b7b-4acf-847f-ba917da1521d None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:55.059664 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1e0b8-2912-4316-aac4-2567e99ba01c None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:55.095014 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac2569-61a5-4179-925d-3218bb77593b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:55.096021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac2569-61a5-4179-925d-3218bb77593b None admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:55.096303 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac2569-61a5-4179-925d-3218bb77593b None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:55.096578 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac2569-61a5-4179-925d-3218bb77593b None admin] PATH_INFO: `/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39/users/e417a8906aa64d86a7cd115f4a6720ec/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:55.098681 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac2569-61a5-4179-925d-3218bb77593b None admin] RBAC: Authorizing `identity:create_grant(project_id=e3059ec0bd6649c8bd24c1e0a5b48c39, user_id=e417a8906aa64d86a7cd115f4a6720ec, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:55.100184 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac2569-61a5-4179-925d-3218bb77593b None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:55.116387 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 125/255] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:50:54 2022] PUT /identity/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39/users/e417a8906aa64d86a7cd115f4a6720ec/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:50:55.120261 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac2569-61a5-4179-925d-3218bb77593b None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:55.228282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbd9e9-2b7b-4acf-847f-ba917da1521d None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:55.233063 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:55.253251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac2569-61a5-4179-925d-3218bb77593b None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:55.293631 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756e4f7-17c8-412f-90dd-9d0b6eb0e056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:55.294445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756e4f7-17c8-412f-90dd-9d0b6eb0e056 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:55.294798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756e4f7-17c8-412f-90dd-9d0b6eb0e056 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:55.295138 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756e4f7-17c8-412f-90dd-9d0b6eb0e056 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:55.296082 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756e4f7-17c8-412f-90dd-9d0b6eb0e056 None admin] RBAC: Adding query filter params (role.id=684d55f3873849f08303658557ed05e8, scope.project.id=e3059ec0bd6649c8bd24c1e0a5b48c39, user.id=f9c01225a5234a5197ecea2bde4b693b) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:55.296465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756e4f7-17c8-412f-90dd-9d0b6eb0e056 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:55.298051 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756e4f7-17c8-412f-90dd-9d0b6eb0e056 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:55.304516 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56946e2-f4cf-442e-a658-bf34815e6ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:55.305176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 126/256] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:50:55 2022] GET /identity/v3/role_assignments?user.id=f9c01225a5234a5197ecea2bde4b693b&scope.project.id=e3059ec0bd6649c8bd24c1e0a5b48c39&role.id=684d55f3873849f08303658557ed05e8 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:55.305338 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56946e2-f4cf-442e-a658-bf34815e6ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:55.305604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56946e2-f4cf-442e-a658-bf34815e6ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:55.305878 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56946e2-f4cf-442e-a658-bf34815e6ee9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:55.306385 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae57788-6717-4047-a072-645939558bf3 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:55.306671 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae57788-6717-4047-a072-645939558bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:55.306948 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae57788-6717-4047-a072-645939558bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:55.321669 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56946e2-f4cf-442e-a658-bf34815e6ee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:55.325534 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-8ae57788-6717-4047-a072-645939558bf3 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:55.326749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-8ae57788-6717-4047-a072-645939558bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:55.333839 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-b56946e2-f4cf-442e-a658-bf34815e6ee9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:50:55.333839 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:55.333839 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:55.333839 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:55.333839 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:55.333839 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:55.333839 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:55.333839 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:55.333839 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:55.333839 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:55.333839 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:55.333839 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:55.333839 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:55.333839 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:55.333839 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:55.333839 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:55.336209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:55.336209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:55.336209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:55.336209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:55.336209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:55.336209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:55.336209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:55.336209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:55.336209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:55.336209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:55.336209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:55.336209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:55.336209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:55.336209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:55.336209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:55.336209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:55.338174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:55.338174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:55.338174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:55.338174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:55.338174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:55.338174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:55.338174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:55.338174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:55.338174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:55.338174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:55.338174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:50:55.338174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:50:55.338174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 131/257] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:50:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:50:55.343940 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56946e2-f4cf-442e-a658-bf34815e6ee9 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:55.353290 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:55.406987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 127/258] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:55.431710 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae57788-6717-4047-a072-645939558bf3 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:55.487302 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56946e2-f4cf-442e-a658-bf34815e6ee9 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:55.523184 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:55.525686 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24802281-6748-45dd-a65c-4341a0c67f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:55.526392 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24802281-6748-45dd-a65c-4341a0c67f1b None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:55.526674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24802281-6748-45dd-a65c-4341a0c67f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:55.526946 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24802281-6748-45dd-a65c-4341a0c67f1b None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:55.527747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24802281-6748-45dd-a65c-4341a0c67f1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:55.528052 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24802281-6748-45dd-a65c-4341a0c67f1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:55.529489 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24802281-6748-45dd-a65c-4341a0c67f1b None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:55.539773 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 132/259] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:50:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:50:55.545598 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24802281-6748-45dd-a65c-4341a0c67f1b None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:55.554006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae57788-6717-4047-a072-645939558bf3 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:55.590005 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d0f0e-cd3c-4106-989a-08ec9dc7f4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:55.590891 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d0f0e-cd3c-4106-989a-08ec9dc7f4eb None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:55.591177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d0f0e-cd3c-4106-989a-08ec9dc7f4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:55.591563 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d0f0e-cd3c-4106-989a-08ec9dc7f4eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:55.604467 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d0f0e-cd3c-4106-989a-08ec9dc7f4eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:55.614369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-a65d0f0e-cd3c-4106-989a-08ec9dc7f4eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:50:55.614369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:55.614369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:55.614369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:55.614369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:55.614369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:55.614369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:55.614369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:55.614369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:55.614369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:55.614369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:55.614369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:55.614369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:55.614369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:55.614369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:55.614369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:55.616703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:55.616703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:55.616703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:55.616703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:55.616703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:55.616703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:55.616703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:55.616703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:55.616703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:55.616703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:55.616703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:55.616703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:55.616703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:55.616703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:55.616703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:55.616703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:55.619348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:55.619348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:55.619348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:55.619348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:55.619348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:55.619348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:55.619348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:55.619348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:55.619348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:55.619348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:55.619348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:50:55.619348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:50:55.619348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 128/260] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 01:50:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:50:55.622203 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:55.627443 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d0f0e-cd3c-4106-989a-08ec9dc7f4eb None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:55.657738 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24802281-6748-45dd-a65c-4341a0c67f1b None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:55.704561 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c17f45-3b2a-4c3b-a646-95c7d529f474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:55.705453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c17f45-3b2a-4c3b-a646-95c7d529f474 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:55.705731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c17f45-3b2a-4c3b-a646-95c7d529f474 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:55.706004 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c17f45-3b2a-4c3b-a646-95c7d529f474 None admin] PATH_INFO: `/v3/users/81bb186b0cc646dcbfbb4b9390336436` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:55.711153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c17f45-3b2a-4c3b-a646-95c7d529f474 None admin] RBAC: Authorizing `identity:get_user(user_id=81bb186b0cc646dcbfbb4b9390336436)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:55.712694 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c17f45-3b2a-4c3b-a646-95c7d529f474 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:55.714534 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 133/261] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:55 2022] GET /identity/v3/users/81bb186b0cc646dcbfbb4b9390336436 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:50:55.720347 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c17f45-3b2a-4c3b-a646-95c7d529f474 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:55.801588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d0f0e-cd3c-4106-989a-08ec9dc7f4eb None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:55.840089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c17f45-3b2a-4c3b-a646-95c7d529f474 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:55.871177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202cf2d-80b5-405f-876a-45700c19d4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:55.872237 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202cf2d-80b5-405f-876a-45700c19d4cf None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:55.872737 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202cf2d-80b5-405f-876a-45700c19d4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:55.873209 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202cf2d-80b5-405f-876a-45700c19d4cf None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:55.874165 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202cf2d-80b5-405f-876a-45700c19d4cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:55.874685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202cf2d-80b5-405f-876a-45700c19d4cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:55.879102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202cf2d-80b5-405f-876a-45700c19d4cf None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:55.884261 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:55.885500 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd717bb-5e5b-4072-9b61-8e51cdd63109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:55.886161 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd717bb-5e5b-4072-9b61-8e51cdd63109 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:55.888128 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd717bb-5e5b-4072-9b61-8e51cdd63109 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:55.888418 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd717bb-5e5b-4072-9b61-8e51cdd63109 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:55.895141 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:55.904431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 129/262] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:50:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:55.912772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202cf2d-80b5-405f-876a-45700c19d4cf None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:56.024723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202cf2d-80b5-405f-876a-45700c19d4cf None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:56.060287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd717bb-5e5b-4072-9b61-8e51cdd63109 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:56.062126 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd717bb-5e5b-4072-9b61-8e51cdd63109 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:56.071013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a7f05-4560-47d9-8b22-5c5f59cf1433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:56.072828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a7f05-4560-47d9-8b22-5c5f59cf1433 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:56.073161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a7f05-4560-47d9-8b22-5c5f59cf1433 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:56.073442 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a7f05-4560-47d9-8b22-5c5f59cf1433 None admin] PATH_INFO: `/v3/users/81bb186b0cc646dcbfbb4b9390336436` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:56.080263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a7f05-4560-47d9-8b22-5c5f59cf1433 None admin] RBAC: Authorizing `identity:get_user(user_id=81bb186b0cc646dcbfbb4b9390336436)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:56.081757 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a7f05-4560-47d9-8b22-5c5f59cf1433 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:56.084501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 130/263] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:55 2022] GET /identity/v3/users/81bb186b0cc646dcbfbb4b9390336436 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:50:56.090341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a7f05-4560-47d9-8b22-5c5f59cf1433 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:56.226638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:56.269532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a7f05-4560-47d9-8b22-5c5f59cf1433 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:56.306606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 134/264] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:50:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:50:56.312802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd717bb-5e5b-4072-9b61-8e51cdd63109 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:56.314555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51762bda-9d61-43da-a81f-fd1b60bfaa28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:56.315469 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51762bda-9d61-43da-a81f-fd1b60bfaa28 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:56.315759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51762bda-9d61-43da-a81f-fd1b60bfaa28 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:56.316034 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51762bda-9d61-43da-a81f-fd1b60bfaa28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:56.375611 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:56.487066 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51762bda-9d61-43da-a81f-fd1b60bfaa28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:56.488677 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51762bda-9d61-43da-a81f-fd1b60bfaa28 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:56.538166 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd717bb-5e5b-4072-9b61-8e51cdd63109 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:56.601122 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2693c64-cf4e-4faa-9338-9138fb867beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:56.602016 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2693c64-cf4e-4faa-9338-9138fb867beb None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:56.602294 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2693c64-cf4e-4faa-9338-9138fb867beb None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:56.602573 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2693c64-cf4e-4faa-9338-9138fb867beb None admin] PATH_INFO: `/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:56.603822 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2693c64-cf4e-4faa-9338-9138fb867beb None admin] RBAC: Authorizing `identity:get_project(project_id=e3059ec0bd6649c8bd24c1e0a5b48c39)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:56.605299 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2693c64-cf4e-4faa-9338-9138fb867beb None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:56.607342 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 135/265] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:56 2022] GET /identity/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39 => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:50:56.613063 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2693c64-cf4e-4faa-9338-9138fb867beb None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:56.642364 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:56.723293 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 131/266] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:50:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 01:50:56.729451 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51762bda-9d61-43da-a81f-fd1b60bfaa28 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:56.869268 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2693c64-cf4e-4faa-9338-9138fb867beb None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:56.871150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:56.918132 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51762bda-9d61-43da-a81f-fd1b60bfaa28 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:56.976028 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc7be7-13bc-45ef-9504-14e28ec91acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:56.976922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc7be7-13bc-45ef-9504-14e28ec91acb None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:56.977203 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc7be7-13bc-45ef-9504-14e28ec91acb None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:56.977475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc7be7-13bc-45ef-9504-14e28ec91acb None admin] PATH_INFO: `/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:56.981071 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc7be7-13bc-45ef-9504-14e28ec91acb None admin] RBAC: Authorizing `identity:get_project(project_id=e3059ec0bd6649c8bd24c1e0a5b48c39)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:56.981918 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01e34c-cb5c-4bdc-a704-d007e7c27146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:56.982546 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc7be7-13bc-45ef-9504-14e28ec91acb None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:56.983032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01e34c-cb5c-4bdc-a704-d007e7c27146 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:56.983552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01e34c-cb5c-4bdc-a704-d007e7c27146 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:56.984038 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01e34c-cb5c-4bdc-a704-d007e7c27146 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:56.984617 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 132/267] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:56 2022] GET /identity/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:56.985356 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01e34c-cb5c-4bdc-a704-d007e7c27146 None admin] RBAC: Adding query filter params (role.id=58e04437159e4eb39aa4a43c213ea34c, scope.project.id=e3059ec0bd6649c8bd24c1e0a5b48c39, user.id=81bb186b0cc646dcbfbb4b9390336436) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:56.985881 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01e34c-cb5c-4bdc-a704-d007e7c27146 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:56.987551 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01e34c-cb5c-4bdc-a704-d007e7c27146 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:57.000739 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc7be7-13bc-45ef-9504-14e28ec91acb None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:57.005322 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 136/268] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:50:56 2022] GET /identity/v3/role_assignments?user.id=81bb186b0cc646dcbfbb4b9390336436&scope.project.id=e3059ec0bd6649c8bd24c1e0a5b48c39&role.id=58e04437159e4eb39aa4a43c213ea34c => generated 608 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:50:57.075763 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:57.148015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc7be7-13bc-45ef-9504-14e28ec91acb None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:57.191121 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aecedd7-740e-47a5-9864-6ef0257e2c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:57.191836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecedd7-740e-47a5-9864-6ef0257e2c5f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:57.192145 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecedd7-740e-47a5-9864-6ef0257e2c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:57.192430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecedd7-740e-47a5-9864-6ef0257e2c5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:57.193348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aecedd7-740e-47a5-9864-6ef0257e2c5f None admin] RBAC: Adding query filter params (role.id=77aca4b95bbe47cbb528be2615112ac4, scope.project.id=e3059ec0bd6649c8bd24c1e0a5b48c39, user.id=81bb186b0cc646dcbfbb4b9390336436) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:57.193664 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aecedd7-740e-47a5-9864-6ef0257e2c5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:57.195189 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aecedd7-740e-47a5-9864-6ef0257e2c5f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:57.202351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 133/269] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:50:56 2022] GET /identity/v3/role_assignments?user.id=81bb186b0cc646dcbfbb4b9390336436&scope.project.id=e3059ec0bd6649c8bd24c1e0a5b48c39&role.id=77aca4b95bbe47cbb528be2615112ac4 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:50:57.391439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5304f70-1fa2-416e-a648-ecbed4f219eb None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:57.391950 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5304f70-1fa2-416e-a648-ecbed4f219eb None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:57.392024 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5304f70-1fa2-416e-a648-ecbed4f219eb None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:57.393516 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 137/270] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:57.399638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83921e2-bec6-4c8c-a4f0-b59dc508ebc3 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:57.399902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83921e2-bec6-4c8c-a4f0-b59dc508ebc3 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:57.400130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83921e2-bec6-4c8c-a4f0-b59dc508ebc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:57.427336 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-e83921e2-bec6-4c8c-a4f0-b59dc508ebc3 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:57.428589 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-e83921e2-bec6-4c8c-a4f0-b59dc508ebc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:57.505373 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 134/271] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:57.530905 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5304f70-1fa2-416e-a648-ecbed4f219eb None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:57.638357 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5304f70-1fa2-416e-a648-ecbed4f219eb None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:57.674489 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e623d-8104-4e30-b81f-ca6021ca651f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:57.675263 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e623d-8104-4e30-b81f-ca6021ca651f None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:57.675577 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e623d-8104-4e30-b81f-ca6021ca651f None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:57.675849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e623d-8104-4e30-b81f-ca6021ca651f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:57.677249 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e623d-8104-4e30-b81f-ca6021ca651f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:57.678789 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e623d-8104-4e30-b81f-ca6021ca651f None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:57.680681 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 138/272] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:50:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:57.686479 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83921e2-bec6-4c8c-a4f0-b59dc508ebc3 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:57.730368 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:57.732018 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8030ce-b683-45c6-a962-990443660233 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:57.732304 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8030ce-b683-45c6-a962-990443660233 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:57.732633 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8030ce-b683-45c6-a962-990443660233 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:57.734013 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 139/273] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:50:57.740204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a51cc-48df-4edb-b6a7-de7cda2a7921 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:57.740570 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a51cc-48df-4edb-b6a7-de7cda2a7921 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:57.741275 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a51cc-48df-4edb-b6a7-de7cda2a7921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:57.761819 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-532a51cc-48df-4edb-b6a7-de7cda2a7921 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:57.764029 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-532a51cc-48df-4edb-b6a7-de7cda2a7921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:57.797023 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:57.820461 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83921e2-bec6-4c8c-a4f0-b59dc508ebc3 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:57.851390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 140/274] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:50:57.853318 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f515db-d3e0-48ec-8205-ef1243a48fe0 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:57.853609 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f515db-d3e0-48ec-8205-ef1243a48fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:57.853888 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f515db-d3e0-48ec-8205-ef1243a48fe0 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:57.855603 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 141/275] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:57.860626 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08657418-cdce-4f58-94b3-b9fcbf8f6210 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:57.860904 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08657418-cdce-4f58-94b3-b9fcbf8f6210 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:57.861175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08657418-cdce-4f58-94b3-b9fcbf8f6210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:57.871223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07149586-8987-426d-954a-47ceb17a98a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:57.872480 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07149586-8987-426d-954a-47ceb17a98a0 None admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:57.872480 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07149586-8987-426d-954a-47ceb17a98a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:57.872667 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07149586-8987-426d-954a-47ceb17a98a0 None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:57.873278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07149586-8987-426d-954a-47ceb17a98a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:57.874737 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07149586-8987-426d-954a-47ceb17a98a0 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:57.885561 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-08657418-cdce-4f58-94b3-b9fcbf8f6210 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:57.887108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-08657418-cdce-4f58-94b3-b9fcbf8f6210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:57.897244 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 135/276] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 01:50:57 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:50:57.898081 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07149586-8987-426d-954a-47ceb17a98a0 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:58.000178 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 142/277] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:50:58.018289 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:58.023371 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08657418-cdce-4f58-94b3-b9fcbf8f6210 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:58.043115 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07149586-8987-426d-954a-47ceb17a98a0 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:58.097620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927d5c9-99e7-43c6-8243-fbb965943825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:58.098600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927d5c9-99e7-43c6-8243-fbb965943825 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:58.099586 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927d5c9-99e7-43c6-8243-fbb965943825 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:58.099942 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927d5c9-99e7-43c6-8243-fbb965943825 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:58.111522 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927d5c9-99e7-43c6-8243-fbb965943825 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:58.121094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-5927d5c9-99e7-43c6-8243-fbb965943825 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:50:58.121094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:58.121094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:58.121094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:58.121094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:58.121094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:58.121094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:58.121094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:58.121094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:58.121094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:58.121094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:58.121094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:58.121094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:58.121094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:58.121094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:58.121094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:58.122055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:58.122055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:58.122055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:58.122055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:58.122055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:58.122055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:58.122055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:58.122055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:58.122055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:58.122055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:58.122055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:58.122055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:58.122055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:58.122055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:58.122055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:58.122055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:58.123444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:58.123444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:58.123444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:58.123444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:58.123444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:58.123444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:58.123444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:58.123444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:58.123444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:58.123444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:58.123444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:50:58.123444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:50:58.123444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 136/278] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:50:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:50:58.127786 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491f73e-5256-4834-a4c6-be31ad3fed4c None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:58.128344 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491f73e-5256-4834-a4c6-be31ad3fed4c None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:58.128776 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491f73e-5256-4834-a4c6-be31ad3fed4c None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:58.131110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 137/279] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:50:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:50:58.135964 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491f73e-5256-4834-a4c6-be31ad3fed4c None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:58.137114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:58.144559 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08657418-cdce-4f58-94b3-b9fcbf8f6210 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:58.185325 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da783cd-5645-42b3-87fa-9fe00a8c87f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:58.186463 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da783cd-5645-42b3-87fa-9fe00a8c87f1 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:58.186738 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da783cd-5645-42b3-87fa-9fe00a8c87f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:58.187008 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da783cd-5645-42b3-87fa-9fe00a8c87f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:58.200568 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da783cd-5645-42b3-87fa-9fe00a8c87f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:58.208436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-8da783cd-5645-42b3-87fa-9fe00a8c87f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:50:58.208436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:58.208436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:58.208436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:58.208436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:58.208436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:58.208436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:58.208436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:58.208436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:58.208436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:58.208436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:58.208436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:58.208436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:58.208436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:58.208436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:58.208436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:58.209361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:58.209361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:58.209361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:58.209361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:58.209361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:58.209361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:58.209361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:58.209361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:58.209361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:58.209361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:58.209361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:58.209361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:58.209361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:58.209361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:58.209361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:58.209361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:58.210425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:58.210425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:58.210425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:58.210425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:58.210425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:58.210425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:58.210425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:58.210425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:58.210425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:58.210425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:58.210425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:50:58.210425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:50:58.210425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 143/280] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:50:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:50:58.211085 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b647d3c-b9d4-4cbe-b42b-117ea10ee48e None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:58.211149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b647d3c-b9d4-4cbe-b42b-117ea10ee48e None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:58.211670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b647d3c-b9d4-4cbe-b42b-117ea10ee48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:58.235376 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-4b647d3c-b9d4-4cbe-b42b-117ea10ee48e None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:50:58.236313 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-4b647d3c-b9d4-4cbe-b42b-117ea10ee48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:50:58.265100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491f73e-5256-4834-a4c6-be31ad3fed4c None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:58.301825 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41908a12-e181-40de-a78a-7fc4d49dcb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:58.303062 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41908a12-e181-40de-a78a-7fc4d49dcb3d None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:58.303705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41908a12-e181-40de-a78a-7fc4d49dcb3d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:58.304297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41908a12-e181-40de-a78a-7fc4d49dcb3d None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:58.305159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41908a12-e181-40de-a78a-7fc4d49dcb3d None admin] RBAC: Adding query filter params (name=member) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:58.305527 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41908a12-e181-40de-a78a-7fc4d49dcb3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:58.307202 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41908a12-e181-40de-a78a-7fc4d49dcb3d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:58.316978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 144/281] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:50:58.318148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b647d3c-b9d4-4cbe-b42b-117ea10ee48e None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:58.323784 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 138/282] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:50:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:58.327447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41908a12-e181-40de-a78a-7fc4d49dcb3d None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:58.342986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:58.430503 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:58.451537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41908a12-e181-40de-a78a-7fc4d49dcb3d None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:58.461315 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b647d3c-b9d4-4cbe-b42b-117ea10ee48e None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:58.493041 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc3c38-969b-40fd-b760-33e786f385ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:58.494059 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc3c38-969b-40fd-b760-33e786f385ee None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:58.494342 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc3c38-969b-40fd-b760-33e786f385ee None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:58.494614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc3c38-969b-40fd-b760-33e786f385ee None admin] PATH_INFO: `/v3/users/38e4758875da42fe97e87c2c32f7fb23` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:58.507580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1361f0-c498-45fb-a9de-dda89f27fb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:58.508892 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1361f0-c498-45fb-a9de-dda89f27fb70 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:58.509290 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc3c38-969b-40fd-b760-33e786f385ee None admin] RBAC: Authorizing `identity:get_user(user_id=38e4758875da42fe97e87c2c32f7fb23)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:58.509895 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1361f0-c498-45fb-a9de-dda89f27fb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:58.510378 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1361f0-c498-45fb-a9de-dda89f27fb70 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:58.510769 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc3c38-969b-40fd-b760-33e786f385ee None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:58.511553 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1361f0-c498-45fb-a9de-dda89f27fb70 None admin] RBAC: Adding query filter params (name=member) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:58.512070 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1361f0-c498-45fb-a9de-dda89f27fb70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:58.517379 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 139/283] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:58 2022] GET /identity/v3/users/38e4758875da42fe97e87c2c32f7fb23 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:58.517379 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc3c38-969b-40fd-b760-33e786f385ee None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:58.519816 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1361f0-c498-45fb-a9de-dda89f27fb70 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:58.532933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 145/284] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:50:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:58.534676 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1361f0-c498-45fb-a9de-dda89f27fb70 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:58.586277 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:58.627968 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc3c38-969b-40fd-b760-33e786f385ee None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:58.645218 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1361f0-c498-45fb-a9de-dda89f27fb70 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:58.664446 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc454a6-2ac1-4861-a637-7e6db5d16a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:58.665266 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc454a6-2ac1-4861-a637-7e6db5d16a31 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:58.665547 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc454a6-2ac1-4861-a637-7e6db5d16a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:58.665821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc454a6-2ac1-4861-a637-7e6db5d16a31 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:58.678022 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc454a6-2ac1-4861-a637-7e6db5d16a31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:50:58.682878 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba1f1a-68b9-47fe-b9d5-033a5a60e505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:58.683795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba1f1a-68b9-47fe-b9d5-033a5a60e505 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:58.684420 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba1f1a-68b9-47fe-b9d5-033a5a60e505 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:58.684921 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba1f1a-68b9-47fe-b9d5-033a5a60e505 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:58.685804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-1cc454a6-2ac1-4861-a637-7e6db5d16a31 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 01:50:58.685804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:50:58.685804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:50:58.685804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:50:58.685804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:50:58.685804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:50:58.685804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:50:58.685804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:50:58.685804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:50:58.685804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:50:58.685804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:50:58.685804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:50:58.685804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:50:58.685804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:50:58.685804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:50:58.685804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:50:58.686963 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:50:58.686963 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:50:58.686963 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:50:58.686963 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:50:58.686963 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:50:58.686963 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:50:58.686963 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:50:58.686963 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:50:58.686963 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:50:58.686963 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:50:58.686963 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:50:58.686963 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:50:58.686963 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:50:58.686963 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:50:58.686963 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:50:58.686963 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:50:58.688117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:50:58.688117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:50:58.688117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:50:58.688117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:50:58.688117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:50:58.688117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:50:58.688117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:50:58.688117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:50:58.688117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:50:58.688117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:50:58.688117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 01:50:58.688117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:50:58.689126 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba1f1a-68b9-47fe-b9d5-033a5a60e505 None admin] RBAC: Adding query filter params (role.id=51b1227b19794e6fb73ae32c4d0165fb, user.id=38e4758875da42fe97e87c2c32f7fb23, scope.system=all) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:58.689638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba1f1a-68b9-47fe-b9d5-033a5a60e505 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:58.691299 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba1f1a-68b9-47fe-b9d5-033a5a60e505 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:58.692395 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 140/285] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:50:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:50:58.693353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc454a6-2ac1-4861-a637-7e6db5d16a31 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:58.697917 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 146/286] 10.222.0.13 () {56 vars in 1308 bytes} [Thu Jun 23 01:50:58 2022] GET /identity/v3/role_assignments?user.id=38e4758875da42fe97e87c2c32f7fb23&scope.system=all&role.id=51b1227b19794e6fb73ae32c4d0165fb => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:58.707574 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba1f1a-68b9-47fe-b9d5-033a5a60e505 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:58.733475 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:58.834104 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc454a6-2ac1-4861-a637-7e6db5d16a31 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:58.860373 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:58.878704 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc8ada-aa27-4211-bd11-416f71e4c84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:58.879699 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc8ada-aa27-4211-bd11-416f71e4c84c None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:58.879983 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc8ada-aa27-4211-bd11-416f71e4c84c None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:58.880256 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc8ada-aa27-4211-bd11-416f71e4c84c None admin] PATH_INFO: `/v3/users/e417a8906aa64d86a7cd115f4a6720ec` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:58.881618 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc8ada-aa27-4211-bd11-416f71e4c84c None admin] RBAC: Authorizing `identity:get_user(user_id=e417a8906aa64d86a7cd115f4a6720ec)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:58.883095 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc8ada-aa27-4211-bd11-416f71e4c84c None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:58.884787 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 141/287] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:58 2022] GET /identity/v3/users/e417a8906aa64d86a7cd115f4a6720ec => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:58.890280 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc8ada-aa27-4211-bd11-416f71e4c84c None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:58.951585 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba1f1a-68b9-47fe-b9d5-033a5a60e505 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:59.005414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc8ada-aa27-4211-bd11-416f71e4c84c None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:59.007338 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686b3ab-2cbf-4ddb-8be5-ea7ac350abd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:59.008257 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686b3ab-2cbf-4ddb-8be5-ea7ac350abd7 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:59.008759 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686b3ab-2cbf-4ddb-8be5-ea7ac350abd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:59.009231 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686b3ab-2cbf-4ddb-8be5-ea7ac350abd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:59.010174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686b3ab-2cbf-4ddb-8be5-ea7ac350abd7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:59.010672 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686b3ab-2cbf-4ddb-8be5-ea7ac350abd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:59.012309 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686b3ab-2cbf-4ddb-8be5-ea7ac350abd7 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:59.023225 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 147/288] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:50:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:59.027995 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686b3ab-2cbf-4ddb-8be5-ea7ac350abd7 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:59.072129 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47031c-4e2b-4183-bd18-cdae27c6acfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:59.073140 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47031c-4e2b-4183-bd18-cdae27c6acfc None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:59.074685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47031c-4e2b-4183-bd18-cdae27c6acfc None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:59.075177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47031c-4e2b-4183-bd18-cdae27c6acfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:59.146622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:59.178740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686b3ab-2cbf-4ddb-8be5-ea7ac350abd7 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:59.199793 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:59.214252 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173e8bd-b585-4ea5-8cbb-30c396694582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:59.215150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173e8bd-b585-4ea5-8cbb-30c396694582 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:59.215460 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173e8bd-b585-4ea5-8cbb-30c396694582 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:59.215746 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173e8bd-b585-4ea5-8cbb-30c396694582 None admin] PATH_INFO: `/v3/users/f9c01225a5234a5197ecea2bde4b693b` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:59.216063 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47031c-4e2b-4183-bd18-cdae27c6acfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:59.216957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173e8bd-b585-4ea5-8cbb-30c396694582 None admin] RBAC: Authorizing `identity:get_user(user_id=f9c01225a5234a5197ecea2bde4b693b)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:59.217957 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47031c-4e2b-4183-bd18-cdae27c6acfc None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:59.218401 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173e8bd-b585-4ea5-8cbb-30c396694582 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:59.223431 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 148/289] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:50:59 2022] GET /identity/v3/users/f9c01225a5234a5197ecea2bde4b693b => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:59.230766 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173e8bd-b585-4ea5-8cbb-30c396694582 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:59.332327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173e8bd-b585-4ea5-8cbb-30c396694582 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:59.399448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210c98c-cda3-4d44-9270-07be87e29f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:59.400354 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210c98c-cda3-4d44-9270-07be87e29f17 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:59.400636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210c98c-cda3-4d44-9270-07be87e29f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:59.400913 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210c98c-cda3-4d44-9270-07be87e29f17 None admin] PATH_INFO: `/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:59.403692 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210c98c-cda3-4d44-9270-07be87e29f17 None admin] RBAC: Authorizing `identity:get_project(project_id=e3059ec0bd6649c8bd24c1e0a5b48c39)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:59.405181 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210c98c-cda3-4d44-9270-07be87e29f17 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:59.408181 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 149/290] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:59 2022] GET /identity/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:50:59.412470 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210c98c-cda3-4d44-9270-07be87e29f17 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:59.429476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:59.455425 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 142/291] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:50:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 01:50:59.457369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47031c-4e2b-4183-bd18-cdae27c6acfc None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:59.610137 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47031c-4e2b-4183-bd18-cdae27c6acfc None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:59.615607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:50:59.626377 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210c98c-cda3-4d44-9270-07be87e29f17 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:59.682603 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3749dbb-0029-46c7-9e68-bfcab75598c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:59.683503 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3749dbb-0029-46c7-9e68-bfcab75598c8 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:59.683787 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3749dbb-0029-46c7-9e68-bfcab75598c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:59.684057 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3749dbb-0029-46c7-9e68-bfcab75598c8 None admin] PATH_INFO: `/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:59.688643 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3749dbb-0029-46c7-9e68-bfcab75598c8 None admin] RBAC: Authorizing `identity:get_project(project_id=e3059ec0bd6649c8bd24c1e0a5b48c39)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:59.690114 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3749dbb-0029-46c7-9e68-bfcab75598c8 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:59.697154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 143/292] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:50:59 2022] GET /identity/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:50:59.704350 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3749dbb-0029-46c7-9e68-bfcab75598c8 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:50:59.705501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281100ee-dd85-4528-8802-21870b6e5f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:59.706423 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281100ee-dd85-4528-8802-21870b6e5f05 None admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:59.706705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281100ee-dd85-4528-8802-21870b6e5f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:59.706981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281100ee-dd85-4528-8802-21870b6e5f05 None admin] PATH_INFO: `/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39/users/f9c01225a5234a5197ecea2bde4b693b/roles/684d55f3873849f08303658557ed05e8` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:59.710246 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281100ee-dd85-4528-8802-21870b6e5f05 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3059ec0bd6649c8bd24c1e0a5b48c39, user_id=f9c01225a5234a5197ecea2bde4b693b, role_id=684d55f3873849f08303658557ed05e8)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:59.711772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281100ee-dd85-4528-8802-21870b6e5f05 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:59.735391 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 150/293] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:50:59 2022] PUT /identity/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39/users/f9c01225a5234a5197ecea2bde4b693b/roles/684d55f3873849f08303658557ed05e8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:50:59.830943 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3749dbb-0029-46c7-9e68-bfcab75598c8 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:50:59.869834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63154963-05fb-4ccb-ae96-3ff8d0e09b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:50:59.870422 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63154963-05fb-4ccb-ae96-3ff8d0e09b16 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:50:59.870706 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63154963-05fb-4ccb-ae96-3ff8d0e09b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:50:59.871036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63154963-05fb-4ccb-ae96-3ff8d0e09b16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:50:59.871921 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63154963-05fb-4ccb-ae96-3ff8d0e09b16 None admin] RBAC: Adding query filter params (role.id=51b1227b19794e6fb73ae32c4d0165fb, scope.project.id=e3059ec0bd6649c8bd24c1e0a5b48c39, user.id=e417a8906aa64d86a7cd115f4a6720ec) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:50:59.872235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63154963-05fb-4ccb-ae96-3ff8d0e09b16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:50:59.873701 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63154963-05fb-4ccb-ae96-3ff8d0e09b16 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:50:59.887062 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 144/294] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:50:59 2022] GET /identity/v3/role_assignments?user.id=e417a8906aa64d86a7cd115f4a6720ec&scope.project.id=e3059ec0bd6649c8bd24c1e0a5b48c39&role.id=51b1227b19794e6fb73ae32c4d0165fb => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:00.168408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36b0a6-df2f-42e4-ba42-95dab6350f10 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:00.168759 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36b0a6-df2f-42e4-ba42-95dab6350f10 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:00.168877 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36b0a6-df2f-42e4-ba42-95dab6350f10 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:00.170583 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 151/295] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:00.175713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb184993-5599-4cd1-9e6f-5ab914e34709 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:00.176014 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb184993-5599-4cd1-9e6f-5ab914e34709 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:00.176295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb184993-5599-4cd1-9e6f-5ab914e34709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:00.196182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-fb184993-5599-4cd1-9e6f-5ab914e34709 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:00.197405 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-fb184993-5599-4cd1-9e6f-5ab914e34709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:00.219755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:00.283877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 145/296] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:00.307787 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36b0a6-df2f-42e4-ba42-95dab6350f10 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:00.310443 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fee59-04d4-4e65-b89f-6e6648f0fa1e None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:00.310734 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fee59-04d4-4e65-b89f-6e6648f0fa1e None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:00.311346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fee59-04d4-4e65-b89f-6e6648f0fa1e None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:00.313169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 146/297] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:00.319251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd358ae7-d828-4c1a-b50c-50499be8cd95 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:00.320023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd358ae7-d828-4c1a-b50c-50499be8cd95 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:00.320315 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd358ae7-d828-4c1a-b50c-50499be8cd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:00.340940 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-dd358ae7-d828-4c1a-b50c-50499be8cd95 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:00.342300 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-dd358ae7-d828-4c1a-b50c-50499be8cd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:00.384912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:00.426867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 147/298] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:00.427624 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36b0a6-df2f-42e4-ba42-95dab6350f10 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:00.450132 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd358ae7-d828-4c1a-b50c-50499be8cd95 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:00.469961 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca61f8-2b4b-4ce5-a6ec-6fc650ddc665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:00.470779 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca61f8-2b4b-4ce5-a6ec-6fc650ddc665 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:00.471062 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca61f8-2b4b-4ce5-a6ec-6fc650ddc665 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:00.471340 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca61f8-2b4b-4ce5-a6ec-6fc650ddc665 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:00.484933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca61f8-2b4b-4ce5-a6ec-6fc650ddc665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:00.496248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-d8ca61f8-2b4b-4ce5-a6ec-6fc650ddc665 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 01:51:00.496248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:00.496248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:00.496248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:00.496248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:00.496248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:00.496248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:00.496248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:00.496248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:00.496248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:00.496248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:00.496248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:00.496248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:00.496248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:00.496248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:00.496248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:00.498335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:00.498335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:00.498335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:00.498335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:00.498335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:00.498335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:00.498335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:00.498335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:00.498335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:00.498335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:00.498335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:00.498335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:00.498335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:00.498335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:00.498335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:00.498335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:00.500209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:00.500209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:00.500209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:00.500209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:00.500209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:00.500209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:00.500209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:00.500209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:00.500209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:00.500209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:00.500209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 01:51:00.500209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:00.500209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 152/299] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:00.507435 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca61f8-2b4b-4ce5-a6ec-6fc650ddc665 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:00.542473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:00.561709 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd358ae7-d828-4c1a-b50c-50499be8cd95 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:00.601670 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823e11c-ef92-463d-98ce-a4879696ca73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:00.602810 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823e11c-ef92-463d-98ce-a4879696ca73 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:00.603262 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823e11c-ef92-463d-98ce-a4879696ca73 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:00.603760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823e11c-ef92-463d-98ce-a4879696ca73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:00.605402 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823e11c-ef92-463d-98ce-a4879696ca73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:00.607081 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823e11c-ef92-463d-98ce-a4879696ca73 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:00.609443 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 148/300] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:00.618236 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823e11c-ef92-463d-98ce-a4879696ca73 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:00.626300 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca61f8-2b4b-4ce5-a6ec-6fc650ddc665 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:00.659450 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:00.669532 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd9454-4645-4d59-b8c3-aa2f2dd3aae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:00.670623 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd9454-4645-4d59-b8c3-aa2f2dd3aae9 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:00.670906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd9454-4645-4d59-b8c3-aa2f2dd3aae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:00.671270 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd9454-4645-4d59-b8c3-aa2f2dd3aae9 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:00.672107 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd9454-4645-4d59-b8c3-aa2f2dd3aae9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:00.672418 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd9454-4645-4d59-b8c3-aa2f2dd3aae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:00.674751 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd9454-4645-4d59-b8c3-aa2f2dd3aae9 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:00.687342 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 153/301] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:51:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:00.693296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd9454-4645-4d59-b8c3-aa2f2dd3aae9 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:00.730101 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823e11c-ef92-463d-98ce-a4879696ca73 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:00.769064 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6b5df-98ea-4c35-8e6e-31b360c70a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:00.769838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6b5df-98ea-4c35-8e6e-31b360c70a99 None admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:00.770271 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6b5df-98ea-4c35-8e6e-31b360c70a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:00.771180 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6b5df-98ea-4c35-8e6e-31b360c70a99 None admin] PATH_INFO: `/v3/groups` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:00.771931 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6b5df-98ea-4c35-8e6e-31b360c70a99 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:00.773553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6b5df-98ea-4c35-8e6e-31b360c70a99 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:00.795507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 149/302] 10.222.0.13 () {60 vars in 1134 bytes} [Thu Jun 23 01:51:00 2022] POST /identity/v3/groups => generated 229 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 01:51:00.827307 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd9454-4645-4d59-b8c3-aa2f2dd3aae9 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:00.864510 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6418a15-bd63-4c44-ba32-733d5f933b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:00.865598 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6418a15-bd63-4c44-ba32-733d5f933b5c None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:00.865888 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6418a15-bd63-4c44-ba32-733d5f933b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:00.866163 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6418a15-bd63-4c44-ba32-733d5f933b5c None admin] PATH_INFO: `/v3/users/bedcd4cc240941b99bd47efe50680833` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:00.882822 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6418a15-bd63-4c44-ba32-733d5f933b5c None admin] RBAC: Authorizing `identity:get_user(user_id=bedcd4cc240941b99bd47efe50680833)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:00.884472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6418a15-bd63-4c44-ba32-733d5f933b5c None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:00.886786 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 154/303] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:51:00 2022] GET /identity/v3/users/bedcd4cc240941b99bd47efe50680833 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:51:00.896749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6b5df-98ea-4c35-8e6e-31b360c70a99 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:00.917941 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:01.013379 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6b5df-98ea-4c35-8e6e-31b360c70a99 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:01.047808 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc343d6-5d80-4b68-b26c-3cec43201369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:01.048478 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc343d6-5d80-4b68-b26c-3cec43201369 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:01.048764 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc343d6-5d80-4b68-b26c-3cec43201369 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:01.049041 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc343d6-5d80-4b68-b26c-3cec43201369 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:01.049880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc343d6-5d80-4b68-b26c-3cec43201369 None admin] RBAC: Adding query filter params (role.id=684d55f3873849f08303658557ed05e8, user.id=bedcd4cc240941b99bd47efe50680833, scope.system=all) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:01.050195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc343d6-5d80-4b68-b26c-3cec43201369 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:01.051795 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc343d6-5d80-4b68-b26c-3cec43201369 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:01.058512 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 150/304] 10.222.0.13 () {56 vars in 1308 bytes} [Thu Jun 23 01:51:00 2022] GET /identity/v3/role_assignments?user.id=bedcd4cc240941b99bd47efe50680833&scope.system=all&role.id=684d55f3873849f08303658557ed05e8 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:01.110913 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cc697-99ee-4dc0-8ce1-0719c7801cae None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:01.111260 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cc697-99ee-4dc0-8ce1-0719c7801cae None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:01.111489 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cc697-99ee-4dc0-8ce1-0719c7801cae None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:01.113030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 155/305] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:01.119180 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b1579-122c-43ad-8dfe-88016c007626 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:01.119517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b1579-122c-43ad-8dfe-88016c007626 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:01.119779 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b1579-122c-43ad-8dfe-88016c007626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:01.142212 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-3f7b1579-122c-43ad-8dfe-88016c007626 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:01.143851 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-3f7b1579-122c-43ad-8dfe-88016c007626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:01.219609 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 151/306] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:01.242739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cc697-99ee-4dc0-8ce1-0719c7801cae None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:01.295879 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:01.349895 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cc697-99ee-4dc0-8ce1-0719c7801cae None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:01.384767 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f507498-7601-44ee-bbce-b62b065109d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:01.385583 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f507498-7601-44ee-bbce-b62b065109d3 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:01.385859 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f507498-7601-44ee-bbce-b62b065109d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:01.386133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f507498-7601-44ee-bbce-b62b065109d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:01.398775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f507498-7601-44ee-bbce-b62b065109d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:01.406769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-5f507498-7601-44ee-bbce-b62b065109d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:51:01.406769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:01.406769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:01.406769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:01.406769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:01.406769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:01.406769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:01.406769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:01.406769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:01.406769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:01.406769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:01.406769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:01.406769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:01.406769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:01.406769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:01.406769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:01.407678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:01.407678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:01.407678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:01.407678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:01.407678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:01.407678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:01.407678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:01.407678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:01.407678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:01.407678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:01.407678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:01.407678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:01.407678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:01.407678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:01.407678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:01.407678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:01.408496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:01.408496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:01.408496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:01.408496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:01.408496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:01.408496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:01.408496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:01.408496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:01.408496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:01.408496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:01.408496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:51:01.408496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:01.408496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 156/307] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:01.414487 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b1579-122c-43ad-8dfe-88016c007626 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:01.422962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:01.517696 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b1579-122c-43ad-8dfe-88016c007626 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:01.552965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa5725-7859-4e1c-b5a6-c428a09b9720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:01.553577 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa5725-7859-4e1c-b5a6-c428a09b9720 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:01.553862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa5725-7859-4e1c-b5a6-c428a09b9720 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:01.554138 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa5725-7859-4e1c-b5a6-c428a09b9720 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:01.554897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa5725-7859-4e1c-b5a6-c428a09b9720 None admin] RBAC: Adding query filter params (name=member) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:01.555204 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa5725-7859-4e1c-b5a6-c428a09b9720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:01.556786 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa5725-7859-4e1c-b5a6-c428a09b9720 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:01.566381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 152/308] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:51:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:01.572277 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f507498-7601-44ee-bbce-b62b065109d3 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:01.679999 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f507498-7601-44ee-bbce-b62b065109d3 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:01.690870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:01.717951 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b04109-2380-492f-a4ae-b8eef42f563c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:01.719175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b04109-2380-492f-a4ae-b8eef42f563c None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:01.719684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b04109-2380-492f-a4ae-b8eef42f563c None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:01.720181 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b04109-2380-492f-a4ae-b8eef42f563c None admin] PATH_INFO: `/v3/users/38e4758875da42fe97e87c2c32f7fb23` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:01.721585 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b04109-2380-492f-a4ae-b8eef42f563c None admin] RBAC: Authorizing `identity:get_user(user_id=38e4758875da42fe97e87c2c32f7fb23)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:01.723317 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b04109-2380-492f-a4ae-b8eef42f563c None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:01.725545 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 157/309] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:51:01 2022] GET /identity/v3/users/38e4758875da42fe97e87c2c32f7fb23 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:01.731376 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa5725-7859-4e1c-b5a6-c428a09b9720 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:01.799979 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:01.835254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa5725-7859-4e1c-b5a6-c428a09b9720 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:01.869594 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7e43b-20ce-4444-820a-1727a1886ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:01.870478 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7e43b-20ce-4444-820a-1727a1886ae9 None admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:01.870811 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7e43b-20ce-4444-820a-1727a1886ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:01.871093 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7e43b-20ce-4444-820a-1727a1886ae9 None admin] PATH_INFO: `/v3/system/users/38e4758875da42fe97e87c2c32f7fb23/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:01.872674 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7e43b-20ce-4444-820a-1727a1886ae9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=38e4758875da42fe97e87c2c32f7fb23, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:01.874088 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7e43b-20ce-4444-820a-1727a1886ae9 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:01.884982 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 153/310] 10.222.0.13 () {58 vars in 1334 bytes} [Thu Jun 23 01:51:01 2022] PUT /identity/v3/system/users/38e4758875da42fe97e87c2c32f7fb23/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 01:51:02.070012 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc669564-0f84-40f4-a832-82ac92324198 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:02.070691 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc669564-0f84-40f4-a832-82ac92324198 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:02.071161 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc669564-0f84-40f4-a832-82ac92324198 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:02.073116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 158/311] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:02.078642 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67267b67-c54a-416f-b2de-67bf647b3f2d None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:02.078938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67267b67-c54a-416f-b2de-67bf647b3f2d None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:02.079219 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67267b67-c54a-416f-b2de-67bf647b3f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:02.096600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-67267b67-c54a-416f-b2de-67bf647b3f2d None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:02.097715 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-67267b67-c54a-416f-b2de-67bf647b3f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:02.165616 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 154/312] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:02.188982 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc669564-0f84-40f4-a832-82ac92324198 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:02.299665 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc669564-0f84-40f4-a832-82ac92324198 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:02.334480 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bd37d-d82f-4db0-971e-c9e8d86e5746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:02.335647 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bd37d-d82f-4db0-971e-c9e8d86e5746 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:02.336117 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bd37d-d82f-4db0-971e-c9e8d86e5746 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:02.336608 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bd37d-d82f-4db0-971e-c9e8d86e5746 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:02.347295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bd37d-d82f-4db0-971e-c9e8d86e5746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:02.356095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-680bd37d-d82f-4db0-971e-c9e8d86e5746 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 01:51:02.356095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:02.356095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:02.356095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:02.356095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:02.356095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:02.356095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:02.356095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:02.356095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:02.356095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:02.356095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:02.356095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:02.356095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:02.356095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:02.356095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:02.356095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:02.356975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:02.356975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:02.356975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:02.356975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:02.356975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:02.356975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:02.356975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:02.356975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:02.356975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:02.356975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:02.356975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:02.356975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:02.356975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:02.356975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:02.356975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:02.356975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:02.357768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:02.357768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:02.357768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:02.357768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:02.357768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:02.357768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:02.357768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:02.357768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:02.357768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:02.357768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:02.357768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 01:51:02.357768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:02.360449 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 159/313] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:02.366506 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67267b67-c54a-416f-b2de-67bf647b3f2d None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:02.431953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:02.474375 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67267b67-c54a-416f-b2de-67bf647b3f2d None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:02.509778 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01bdfd-5217-476a-8462-32f96ded9cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:02.510467 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01bdfd-5217-476a-8462-32f96ded9cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:02.510753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01bdfd-5217-476a-8462-32f96ded9cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:02.511030 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01bdfd-5217-476a-8462-32f96ded9cd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:02.511885 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01bdfd-5217-476a-8462-32f96ded9cd4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:02.512196 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01bdfd-5217-476a-8462-32f96ded9cd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:02.513611 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01bdfd-5217-476a-8462-32f96ded9cd4 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:02.522986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 155/314] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:51:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:02.528575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bd37d-d82f-4db0-971e-c9e8d86e5746 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:02.566081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:02.641253 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bd37d-d82f-4db0-971e-c9e8d86e5746 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:02.676159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9b9f9-8e0f-40b6-a74d-984a450ee1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:02.677207 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9b9f9-8e0f-40b6-a74d-984a450ee1bb None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:02.677493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9b9f9-8e0f-40b6-a74d-984a450ee1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:02.677777 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9b9f9-8e0f-40b6-a74d-984a450ee1bb None admin] PATH_INFO: `/v3/users/f9c01225a5234a5197ecea2bde4b693b` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:02.679006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9b9f9-8e0f-40b6-a74d-984a450ee1bb None admin] RBAC: Authorizing `identity:get_user(user_id=f9c01225a5234a5197ecea2bde4b693b)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:02.680504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9b9f9-8e0f-40b6-a74d-984a450ee1bb None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:02.682464 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 160/315] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:51:02 2022] GET /identity/v3/users/f9c01225a5234a5197ecea2bde4b693b => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:02.688547 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01bdfd-5217-476a-8462-32f96ded9cd4 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:02.794508 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01bdfd-5217-476a-8462-32f96ded9cd4 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:02.819368 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:02.831216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee195488-2a50-4218-bf21-788cc0c04905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:02.831918 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee195488-2a50-4218-bf21-788cc0c04905 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:02.832204 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee195488-2a50-4218-bf21-788cc0c04905 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:02.832483 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee195488-2a50-4218-bf21-788cc0c04905 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:02.901445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee195488-2a50-4218-bf21-788cc0c04905 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:02.902969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee195488-2a50-4218-bf21-788cc0c04905 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:03.007094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 156/316] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:51:03.012438 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9b9f9-8e0f-40b6-a74d-984a450ee1bb None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:03.017540 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef670cdb-2e44-454d-b601-44738a225cd0 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:03.018045 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef670cdb-2e44-454d-b601-44738a225cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:03.018329 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef670cdb-2e44-454d-b601-44738a225cd0 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:03.019737 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 157/317] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:51:03.025409 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c203f1b-b23f-4cfb-99fc-f45a939c4885 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:03.025409 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c203f1b-b23f-4cfb-99fc-f45a939c4885 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:03.025718 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c203f1b-b23f-4cfb-99fc-f45a939c4885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:03.042772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-1c203f1b-b23f-4cfb-99fc-f45a939c4885 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:03.044015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-1c203f1b-b23f-4cfb-99fc-f45a939c4885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:03.062068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:03.119524 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 158/318] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:51:03.132720 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9b9f9-8e0f-40b6-a74d-984a450ee1bb None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:03.135878 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:03.137076 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c203f1b-b23f-4cfb-99fc-f45a939c4885 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:03.177060 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0390b-c9ea-42cc-a6c6-2093be9592e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:03.178305 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0390b-c9ea-42cc-a6c6-2093be9592e1 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:03.179294 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0390b-c9ea-42cc-a6c6-2093be9592e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:03.179780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0390b-c9ea-42cc-a6c6-2093be9592e1 None admin] PATH_INFO: `/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:03.181632 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0390b-c9ea-42cc-a6c6-2093be9592e1 None admin] RBAC: Authorizing `identity:get_project(project_id=e3059ec0bd6649c8bd24c1e0a5b48c39)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:03.184026 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0390b-c9ea-42cc-a6c6-2093be9592e1 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:03.187625 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 161/319] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:51:03 2022] GET /identity/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:03.199095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0390b-c9ea-42cc-a6c6-2093be9592e1 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:03.242543 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c203f1b-b23f-4cfb-99fc-f45a939c4885 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:03.278832 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908d317-5564-45ab-9741-48166312ac3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:03.279669 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908d317-5564-45ab-9741-48166312ac3a None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:03.279954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908d317-5564-45ab-9741-48166312ac3a None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:03.280228 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908d317-5564-45ab-9741-48166312ac3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:03.281392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908d317-5564-45ab-9741-48166312ac3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:03.282872 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908d317-5564-45ab-9741-48166312ac3a None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:03.287731 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 159/320] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:03.287731 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e0bb3-453d-46e1-abe7-6cf934d4c280 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:03.287731 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e0bb3-453d-46e1-abe7-6cf934d4c280 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:03.287731 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e0bb3-453d-46e1-abe7-6cf934d4c280 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:03.288331 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 160/321] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:03.293394 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf3c39-5a38-4606-a95a-d1820542b4ce None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:03.293751 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf3c39-5a38-4606-a95a-d1820542b4ce None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:03.294040 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf3c39-5a38-4606-a95a-d1820542b4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:03.310209 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-a4bf3c39-5a38-4606-a95a-d1820542b4ce None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:03.311738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a4bf3c39-5a38-4606-a95a-d1820542b4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:03.312850 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0390b-c9ea-42cc-a6c6-2093be9592e1 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:03.331655 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:03.348606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61641e1-a900-45a8-8a7f-758962a3d06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:03.349265 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61641e1-a900-45a8-8a7f-758962a3d06e None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:03.349542 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61641e1-a900-45a8-8a7f-758962a3d06e None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:03.349860 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61641e1-a900-45a8-8a7f-758962a3d06e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:03.350639 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61641e1-a900-45a8-8a7f-758962a3d06e None admin] RBAC: Adding query filter params (role.id=684d55f3873849f08303658557ed05e8, scope.project.id=e3059ec0bd6649c8bd24c1e0a5b48c39, user.id=f9c01225a5234a5197ecea2bde4b693b) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:03.350948 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61641e1-a900-45a8-8a7f-758962a3d06e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:03.352430 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61641e1-a900-45a8-8a7f-758962a3d06e None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:03.358497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 162/322] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:51:03 2022] GET /identity/v3/role_assignments?user.id=f9c01225a5234a5197ecea2bde4b693b&scope.project.id=e3059ec0bd6649c8bd24c1e0a5b48c39&role.id=684d55f3873849f08303658557ed05e8 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:03.364441 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61641e1-a900-45a8-8a7f-758962a3d06e None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:03.395867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 161/323] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:51:03.410390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:03.412404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf3c39-5a38-4606-a95a-d1820542b4ce None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:03.508833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61641e1-a900-45a8-8a7f-758962a3d06e None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:03.532939 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf3c39-5a38-4606-a95a-d1820542b4ce None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:03.550786 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74deb0d2-75e3-4d21-913d-3281bbc915bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:03.551808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74deb0d2-75e3-4d21-913d-3281bbc915bb None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:03.552170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74deb0d2-75e3-4d21-913d-3281bbc915bb None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:03.553544 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74deb0d2-75e3-4d21-913d-3281bbc915bb None admin] PATH_INFO: `/v3/groups` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:03.553544 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74deb0d2-75e3-4d21-913d-3281bbc915bb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:03.555003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74deb0d2-75e3-4d21-913d-3281bbc915bb None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:03.575333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 163/324] 10.222.0.13 () {60 vars in 1134 bytes} [Thu Jun 23 01:51:03 2022] POST /identity/v3/groups => generated 226 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:51:03.577358 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc62f9a-ccd6-4264-be1a-4a3370c36366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:03.578186 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc62f9a-ccd6-4264-be1a-4a3370c36366 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:03.578475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc62f9a-ccd6-4264-be1a-4a3370c36366 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:03.578757 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc62f9a-ccd6-4264-be1a-4a3370c36366 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:03.592237 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc62f9a-ccd6-4264-be1a-4a3370c36366 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:03.600897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-efc62f9a-ccd6-4264-be1a-4a3370c36366 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 01:51:03.600897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:03.600897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:03.600897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:03.600897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:03.600897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:03.600897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:03.600897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:03.600897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:03.600897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:03.600897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:03.600897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:03.600897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:03.600897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:03.600897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:03.600897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:03.601858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:03.601858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:03.601858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:03.601858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:03.601858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:03.601858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:03.601858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:03.601858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:03.601858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:03.601858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:03.601858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:03.601858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:03.601858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:03.601858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:03.601858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:03.601858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:03.602650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:03.602650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:03.602650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:03.602650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:03.602650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:03.602650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:03.602650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:03.602650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:03.602650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:03.602650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:03.602650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 01:51:03.602650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:03.602650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 162/325] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:51:03.611222 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74deb0d2-75e3-4d21-913d-3281bbc915bb None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:03.727996 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:03.735690 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74deb0d2-75e3-4d21-913d-3281bbc915bb None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:03.771610 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b30401-d48e-4bdf-a5dd-b1dd10378339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:03.772209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b30401-d48e-4bdf-a5dd-b1dd10378339 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:03.772488 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b30401-d48e-4bdf-a5dd-b1dd10378339 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:03.772754 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b30401-d48e-4bdf-a5dd-b1dd10378339 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:03.773505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b30401-d48e-4bdf-a5dd-b1dd10378339 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:03.773815 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b30401-d48e-4bdf-a5dd-b1dd10378339 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:03.775226 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b30401-d48e-4bdf-a5dd-b1dd10378339 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:03.785509 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 164/326] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:51:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:03.791615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc62f9a-ccd6-4264-be1a-4a3370c36366 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:03.810524 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:03.902875 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc62f9a-ccd6-4264-be1a-4a3370c36366 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:03.941922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1b84e-11d1-4f2a-9547-9943b9226650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:03.943060 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1b84e-11d1-4f2a-9547-9943b9226650 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:03.943520 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1b84e-11d1-4f2a-9547-9943b9226650 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:03.943929 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1b84e-11d1-4f2a-9547-9943b9226650 None admin] PATH_INFO: `/v3/users/bedcd4cc240941b99bd47efe50680833` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:03.945254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1b84e-11d1-4f2a-9547-9943b9226650 None admin] RBAC: Authorizing `identity:get_user(user_id=bedcd4cc240941b99bd47efe50680833)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:03.946850 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1b84e-11d1-4f2a-9547-9943b9226650 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:03.948969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 163/327] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:51:03 2022] GET /identity/v3/users/bedcd4cc240941b99bd47efe50680833 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:03.954771 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b30401-d48e-4bdf-a5dd-b1dd10378339 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:03.962989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb32bd-9ef5-49b1-8be8-d2e4375e7a27 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:03.963277 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb32bd-9ef5-49b1-8be8-d2e4375e7a27 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:03.963593 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb32bd-9ef5-49b1-8be8-d2e4375e7a27 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:03.965288 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 164/328] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:51:03.974040 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e71c3-09a3-47af-896f-9fb8290f92df None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:03.974040 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e71c3-09a3-47af-896f-9fb8290f92df None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:03.974040 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e71c3-09a3-47af-896f-9fb8290f92df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:03.992655 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-6e6e71c3-09a3-47af-896f-9fb8290f92df None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:03.994039 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-6e6e71c3-09a3-47af-896f-9fb8290f92df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:04.079708 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 165/329] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:51:04.083365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b30401-d48e-4bdf-a5dd-b1dd10378339 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:04.101097 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e71c3-09a3-47af-896f-9fb8290f92df None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:04.122754 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:04.126210 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ac851-3a6f-4a70-8304-cbdad3a2c55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:04.127586 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ac851-3a6f-4a70-8304-cbdad3a2c55b None admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:04.127871 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ac851-3a6f-4a70-8304-cbdad3a2c55b None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:04.128152 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ac851-3a6f-4a70-8304-cbdad3a2c55b None admin] PATH_INFO: `/v3/system/users/bedcd4cc240941b99bd47efe50680833/roles/684d55f3873849f08303658557ed05e8` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:04.131142 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ac851-3a6f-4a70-8304-cbdad3a2c55b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bedcd4cc240941b99bd47efe50680833, role_id=684d55f3873849f08303658557ed05e8)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:04.132872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ac851-3a6f-4a70-8304-cbdad3a2c55b None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:04.147810 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 165/330] 10.222.0.13 () {58 vars in 1334 bytes} [Thu Jun 23 01:51:03 2022] PUT /identity/v3/system/users/bedcd4cc240941b99bd47efe50680833/roles/684d55f3873849f08303658557ed05e8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:51:04.233307 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e71c3-09a3-47af-896f-9fb8290f92df None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:04.270859 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3120ee-da3e-4404-a5c6-ff807a1e7337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:04.271820 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3120ee-da3e-4404-a5c6-ff807a1e7337 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:04.272104 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3120ee-da3e-4404-a5c6-ff807a1e7337 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:04.272379 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3120ee-da3e-4404-a5c6-ff807a1e7337 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:04.288516 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3120ee-da3e-4404-a5c6-ff807a1e7337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:04.296749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-1a3120ee-da3e-4404-a5c6-ff807a1e7337 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:51:04.296749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:04.296749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:04.296749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:04.296749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:04.296749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:04.296749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:04.296749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:04.296749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:04.296749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:04.296749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:04.296749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:04.296749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:04.296749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:04.296749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:04.296749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:04.297725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:04.297725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:04.297725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:04.297725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:04.297725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:04.297725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:04.297725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:04.297725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:04.297725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:04.297725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:04.297725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:04.297725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:04.297725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:04.297725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:04.297725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:04.297725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:04.298517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:04.298517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:04.298517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:04.298517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:04.298517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:04.298517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:04.298517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:04.298517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:04.298517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:04.298517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:04.298517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:51:04.298517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:04.300402 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 166/331] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:04.304781 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ac851-3a6f-4a70-8304-cbdad3a2c55b None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:04.342011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:04.425920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ac851-3a6f-4a70-8304-cbdad3a2c55b None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:04.467041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a1d69-bc01-41d6-9a3e-5209bcd091f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:04.467755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a1d69-bc01-41d6-9a3e-5209bcd091f6 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:04.468039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a1d69-bc01-41d6-9a3e-5209bcd091f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:04.468313 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a1d69-bc01-41d6-9a3e-5209bcd091f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:04.469137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a1d69-bc01-41d6-9a3e-5209bcd091f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:04.469447 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a1d69-bc01-41d6-9a3e-5209bcd091f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:04.470833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a1d69-bc01-41d6-9a3e-5209bcd091f6 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:04.482797 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 166/332] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:51:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:04.490646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3120ee-da3e-4404-a5c6-ff807a1e7337 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:04.587993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:04.629610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3120ee-da3e-4404-a5c6-ff807a1e7337 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:04.676216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d4599-f54c-49ef-877a-2fe43f1b1ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:04.677575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d4599-f54c-49ef-877a-2fe43f1b1ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:04.678079 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d4599-f54c-49ef-877a-2fe43f1b1ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:04.678538 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d4599-f54c-49ef-877a-2fe43f1b1ba0 None admin] PATH_INFO: `/v3/users/38e4758875da42fe97e87c2c32f7fb23` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:04.684118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d4599-f54c-49ef-877a-2fe43f1b1ba0 None admin] RBAC: Authorizing `identity:get_user(user_id=38e4758875da42fe97e87c2c32f7fb23)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:04.685813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d4599-f54c-49ef-877a-2fe43f1b1ba0 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:04.688038 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 167/333] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:51:04 2022] GET /identity/v3/users/38e4758875da42fe97e87c2c32f7fb23 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:04.694335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a1d69-bc01-41d6-9a3e-5209bcd091f6 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:04.821404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:04.840042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a1d69-bc01-41d6-9a3e-5209bcd091f6 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:04.882959 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4379c-6c50-4225-bfad-4557d0f273da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:04.883642 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4379c-6c50-4225-bfad-4557d0f273da None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:04.883926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4379c-6c50-4225-bfad-4557d0f273da None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:04.884202 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4379c-6c50-4225-bfad-4557d0f273da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:04.885042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4379c-6c50-4225-bfad-4557d0f273da None admin] RBAC: Adding query filter params (role.id=51b1227b19794e6fb73ae32c4d0165fb, user.id=38e4758875da42fe97e87c2c32f7fb23, scope.system=all) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:04.885403 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4379c-6c50-4225-bfad-4557d0f273da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:04.886881 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4379c-6c50-4225-bfad-4557d0f273da None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:04.903742 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 167/334] 10.222.0.13 () {56 vars in 1308 bytes} [Thu Jun 23 01:51:04 2022] GET /identity/v3/role_assignments?user.id=38e4758875da42fe97e87c2c32f7fb23&scope.system=all&role.id=51b1227b19794e6fb73ae32c4d0165fb => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:06.423961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a0181-45ed-457d-abb5-3598164f52fe None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:06.424493 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a0181-45ed-457d-abb5-3598164f52fe None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:06.424805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a0181-45ed-457d-abb5-3598164f52fe None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:06.426626 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 168/335] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:06.437509 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4fda6-8a9b-4ba7-a83d-f36a1f49ec64 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:06.437999 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4fda6-8a9b-4ba7-a83d-f36a1f49ec64 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:06.438295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4fda6-8a9b-4ba7-a83d-f36a1f49ec64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:06.470165 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-7de4fda6-8a9b-4ba7-a83d-f36a1f49ec64 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:06.471381 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-7de4fda6-8a9b-4ba7-a83d-f36a1f49ec64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:06.578961 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 168/336] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:51:06.614280 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a0181-45ed-457d-abb5-3598164f52fe None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:06.753717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a0181-45ed-457d-abb5-3598164f52fe None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:06.788874 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c1d83-7d87-4b39-b650-f6401f1868a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:06.789691 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c1d83-7d87-4b39-b650-f6401f1868a3 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:06.789972 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c1d83-7d87-4b39-b650-f6401f1868a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:06.790249 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c1d83-7d87-4b39-b650-f6401f1868a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:06.800742 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:06.804743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c1d83-7d87-4b39-b650-f6401f1868a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:06.813160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-6b7c1d83-7d87-4b39-b650-f6401f1868a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:51:06.813160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:06.813160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:06.813160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:06.813160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:06.813160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:06.813160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:06.813160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:06.813160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:06.813160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:06.813160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:06.813160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:06.813160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:06.813160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:06.813160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:06.813160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:06.814042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:06.814042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:06.814042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:06.814042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:06.814042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:06.814042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:06.814042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:06.814042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:06.814042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:06.814042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:06.814042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:06.814042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:06.814042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:06.814042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:06.814042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:06.814042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:06.814839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:06.814839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:06.814839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:06.814839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:06.814839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:06.814839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:06.814839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:06.814839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:06.814839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:06.814839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:06.814839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:51:06.814839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:06.817142 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 169/337] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:06.822553 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4fda6-8a9b-4ba7-a83d-f36a1f49ec64 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:06.851551 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5c5b2-6008-4150-9296-072d46092f36 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:06.851850 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5c5b2-6008-4150-9296-072d46092f36 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:06.852188 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5c5b2-6008-4150-9296-072d46092f36 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:06.853879 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 170/338] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:51:06.858868 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24889f7-4ab5-439c-8624-7b33166d3fc9 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:06.859227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24889f7-4ab5-439c-8624-7b33166d3fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:06.859538 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24889f7-4ab5-439c-8624-7b33166d3fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:06.882561 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-f24889f7-4ab5-439c-8624-7b33166d3fc9 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:06.883793 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-f24889f7-4ab5-439c-8624-7b33166d3fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:06.959757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:07.002949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4fda6-8a9b-4ba7-a83d-f36a1f49ec64 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:07.018236 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 171/339] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:07.020114 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c7d79-5863-4e20-b7ee-bf5a8b13e64b None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:07.020615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c7d79-5863-4e20-b7ee-bf5a8b13e64b None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:07.021120 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c7d79-5863-4e20-b7ee-bf5a8b13e64b None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:07.023111 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 172/340] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:07.029155 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdd2a8-dbfc-4d3f-b12b-55cab0b27f1d None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:07.029635 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdd2a8-dbfc-4d3f-b12b-55cab0b27f1d None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:07.030060 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdd2a8-dbfc-4d3f-b12b-55cab0b27f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:07.043329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a4789-90e9-4b1c-8057-e571867543a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:07.044339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a4789-90e9-4b1c-8057-e571867543a5 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:07.044832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a4789-90e9-4b1c-8057-e571867543a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:07.045310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a4789-90e9-4b1c-8057-e571867543a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:07.046756 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a4789-90e9-4b1c-8057-e571867543a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:07.047296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a4789-90e9-4b1c-8057-e571867543a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:07.048916 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a4789-90e9-4b1c-8057-e571867543a5 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:07.057098 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-fafdd2a8-dbfc-4d3f-b12b-55cab0b27f1d None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:07.058341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-fafdd2a8-dbfc-4d3f-b12b-55cab0b27f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:07.059434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 169/341] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:51:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:07.065554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a4789-90e9-4b1c-8057-e571867543a5 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:07.182099 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 173/342] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:51:07.182761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafdd2a8-dbfc-4d3f-b12b-55cab0b27f1d None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:07.255548 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a4789-90e9-4b1c-8057-e571867543a5 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:07.293331 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:07.321236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c34b8d-ff7c-4c7c-9392-7c343c879e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:07.321911 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c34b8d-ff7c-4c7c-9392-7c343c879e53 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:07.322197 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c34b8d-ff7c-4c7c-9392-7c343c879e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:07.322471 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c34b8d-ff7c-4c7c-9392-7c343c879e53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:07.327168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:07.362573 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafdd2a8-dbfc-4d3f-b12b-55cab0b27f1d None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:07.409799 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e895d-3ae4-4dd9-a2e8-7b5123c273be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:07.411264 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e895d-3ae4-4dd9-a2e8-7b5123c273be None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:07.411846 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e895d-3ae4-4dd9-a2e8-7b5123c273be None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:07.412298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e895d-3ae4-4dd9-a2e8-7b5123c273be None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:07.416447 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c34b8d-ff7c-4c7c-9392-7c343c879e53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:07.418152 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c34b8d-ff7c-4c7c-9392-7c343c879e53 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:07.425618 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e895d-3ae4-4dd9-a2e8-7b5123c273be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:07.436259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-d72e895d-3ae4-4dd9-a2e8-7b5123c273be None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 01:51:07.436259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:07.436259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:07.436259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:07.436259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:07.436259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:07.436259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:07.436259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:07.436259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:07.436259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:07.436259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:07.436259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:07.436259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:07.436259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:07.436259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:07.436259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:07.437183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:07.437183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:07.437183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:07.437183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:07.437183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:07.437183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:07.437183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:07.437183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:07.437183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:07.437183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:07.437183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:07.437183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:07.437183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:07.437183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:07.437183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:07.437183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:07.437991 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:07.437991 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:07.437991 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:07.437991 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:07.437991 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:07.437991 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:07.437991 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:07.437991 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:07.437991 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:07.437991 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:07.437991 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 01:51:07.437991 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:07.437991 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 174/343] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:07.438632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e895d-3ae4-4dd9-a2e8-7b5123c273be None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:07.540070 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 170/344] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 01:51:07.542098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816750b-f5f7-43a8-b3a7-49d074df2775 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:07.542610 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816750b-f5f7-43a8-b3a7-49d074df2775 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:07.543103 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816750b-f5f7-43a8-b3a7-49d074df2775 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:07.544711 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 171/345] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:07.545605 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816750b-f5f7-43a8-b3a7-49d074df2775 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:07.587605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e895d-3ae4-4dd9-a2e8-7b5123c273be None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:07.604839 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:07.612389 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:07.635267 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1644e-48a1-46b0-a811-5dd32c148cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:07.636753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1644e-48a1-46b0-a811-5dd32c148cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:07.637235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1644e-48a1-46b0-a811-5dd32c148cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:07.637753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1644e-48a1-46b0-a811-5dd32c148cb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:07.652556 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf1644e-48a1-46b0-a811-5dd32c148cb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:07.666158 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-fbf1644e-48a1-46b0-a811-5dd32c148cb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:51:07.666158 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:07.666158 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:07.666158 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:07.666158 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:07.666158 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:07.666158 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:07.666158 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:07.666158 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:07.666158 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:07.666158 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:07.666158 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:07.666158 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:07.666158 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:07.666158 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:07.666158 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:07.667110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:07.667110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:07.667110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:07.667110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:07.667110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:07.667110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:07.667110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:07.667110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:07.667110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:07.667110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:07.667110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:07.667110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:07.667110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:07.667110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:07.667110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:07.667110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:07.668027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:07.668027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:07.668027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:07.668027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:07.668027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:07.668027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:07.668027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:07.668027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:07.668027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:07.668027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:07.668027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:51:07.668027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:07.670549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 175/346] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:07.672240 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ab625-d104-4d63-aeb1-c7224bf73b1a None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:07.672818 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ab625-d104-4d63-aeb1-c7224bf73b1a None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:07.673290 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ab625-d104-4d63-aeb1-c7224bf73b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:07.683769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816750b-f5f7-43a8-b3a7-49d074df2775 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:07.692868 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-e11ab625-d104-4d63-aeb1-c7224bf73b1a None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:07.694496 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-e11ab625-d104-4d63-aeb1-c7224bf73b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:07.728478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd640e9-c383-4367-b5b7-f41a291abcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:07.729718 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd640e9-c383-4367-b5b7-f41a291abcd7 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:07.730002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd640e9-c383-4367-b5b7-f41a291abcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:07.730280 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd640e9-c383-4367-b5b7-f41a291abcd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:07.731042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd640e9-c383-4367-b5b7-f41a291abcd7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:07.731362 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd640e9-c383-4367-b5b7-f41a291abcd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:07.733455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd640e9-c383-4367-b5b7-f41a291abcd7 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:07.744823 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 172/347] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:51:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:07.748542 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd640e9-c383-4367-b5b7-f41a291abcd7 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:07.782146 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 176/348] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:07.783381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ab625-d104-4d63-aeb1-c7224bf73b1a None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:07.886727 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:07.894446 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd640e9-c383-4367-b5b7-f41a291abcd7 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:07.896921 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ab625-d104-4d63-aeb1-c7224bf73b1a None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:07.908007 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:07.948762 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619788ee-d532-4ffc-8e08-9ab36ad61cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:07.949505 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619788ee-d532-4ffc-8e08-9ab36ad61cca None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:07.949785 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619788ee-d532-4ffc-8e08-9ab36ad61cca None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:07.950054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619788ee-d532-4ffc-8e08-9ab36ad61cca None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:07.950657 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af4234-3ba0-4eab-b592-69a3d40d1927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:07.950832 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619788ee-d532-4ffc-8e08-9ab36ad61cca None admin] RBAC: Adding query filter params (name=member) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:07.951112 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619788ee-d532-4ffc-8e08-9ab36ad61cca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:07.952370 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af4234-3ba0-4eab-b592-69a3d40d1927 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:07.952370 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af4234-3ba0-4eab-b592-69a3d40d1927 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:07.952370 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af4234-3ba0-4eab-b592-69a3d40d1927 None admin] PATH_INFO: `/v3/projects/95472ace4fc043ed86453b0002951eec` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:07.952890 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619788ee-d532-4ffc-8e08-9ab36ad61cca None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:07.955352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af4234-3ba0-4eab-b592-69a3d40d1927 None admin] RBAC: Authorizing `identity:get_project(project_id=95472ace4fc043ed86453b0002951eec)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:07.956733 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af4234-3ba0-4eab-b592-69a3d40d1927 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:07.958785 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 173/349] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:51:07 2022] GET /identity/v3/projects/95472ace4fc043ed86453b0002951eec => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:07.959915 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af4234-3ba0-4eab-b592-69a3d40d1927 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:07.965540 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 177/350] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:51:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:07.966262 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619788ee-d532-4ffc-8e08-9ab36ad61cca None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:08.091275 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af4234-3ba0-4eab-b592-69a3d40d1927 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:08.092837 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619788ee-d532-4ffc-8e08-9ab36ad61cca None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:08.134107 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826d3c6-0c0a-4b3e-a5a8-f88fc8a7a3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:08.135004 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826d3c6-0c0a-4b3e-a5a8-f88fc8a7a3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:08.135288 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826d3c6-0c0a-4b3e-a5a8-f88fc8a7a3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:08.135594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826d3c6-0c0a-4b3e-a5a8-f88fc8a7a3f7 None admin] PATH_INFO: `/v3/users/bedcd4cc240941b99bd47efe50680833` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:08.136515 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d96dfc-f015-4c06-9d0a-2b9db9ff47a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:08.136854 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826d3c6-0c0a-4b3e-a5a8-f88fc8a7a3f7 None admin] RBAC: Authorizing `identity:get_user(user_id=bedcd4cc240941b99bd47efe50680833)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:08.137340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d96dfc-f015-4c06-9d0a-2b9db9ff47a7 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:08.137622 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d96dfc-f015-4c06-9d0a-2b9db9ff47a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:08.137895 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d96dfc-f015-4c06-9d0a-2b9db9ff47a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:08.138258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826d3c6-0c0a-4b3e-a5a8-f88fc8a7a3f7 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:08.140034 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 174/351] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:51:07 2022] GET /identity/v3/users/bedcd4cc240941b99bd47efe50680833 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:08.141421 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb546758-114a-412e-b26f-ca7e0317f21f None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:08.141855 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb546758-114a-412e-b26f-ca7e0317f21f None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:08.142295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb546758-114a-412e-b26f-ca7e0317f21f None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:08.143742 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 175/352] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:08.144568 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb546758-114a-412e-b26f-ca7e0317f21f None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:08.158094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d96dfc-f015-4c06-9d0a-2b9db9ff47a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:08.167676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-34d96dfc-f015-4c06-9d0a-2b9db9ff47a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:51:08.167676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:08.167676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:08.167676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:08.167676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:08.167676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:08.167676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:08.167676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:08.167676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:08.167676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:08.167676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:08.167676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:08.167676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:08.167676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:08.167676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:08.167676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:08.168782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:08.168782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:08.168782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:08.168782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:08.168782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:08.168782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:08.168782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:08.168782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:08.168782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:08.168782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:08.168782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:08.168782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:08.168782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:08.168782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:08.168782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:08.168782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:08.169772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:08.169772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:08.169772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:08.169772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:08.169772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:08.169772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:08.169772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:08.169772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:08.169772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:08.169772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:08.169772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:51:08.169772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:08.171809 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 178/353] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 01:51:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:08.172772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d96dfc-f015-4c06-9d0a-2b9db9ff47a7 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:08.187521 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:08.219705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:08.278357 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb546758-114a-412e-b26f-ca7e0317f21f None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:08.321472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e41ac9-7cf6-4ab1-b825-599bee22e0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:08.322443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e41ac9-7cf6-4ab1-b825-599bee22e0bb None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:08.322727 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e41ac9-7cf6-4ab1-b825-599bee22e0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:08.323001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e41ac9-7cf6-4ab1-b825-599bee22e0bb None admin] PATH_INFO: `/v3/groups/c023f797837346d893755684392878df` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:08.323751 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d96dfc-f015-4c06-9d0a-2b9db9ff47a7 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:08.333611 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e41ac9-7cf6-4ab1-b825-599bee22e0bb None admin] RBAC: Authorizing `identity:get_group(group_id=c023f797837346d893755684392878df)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:08.335874 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e41ac9-7cf6-4ab1-b825-599bee22e0bb None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:08.338188 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 176/354] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 01:51:08 2022] GET /identity/v3/groups/c023f797837346d893755684392878df => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:08.339403 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4b3c9-8910-4649-9785-4dbe0090ecec None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:08.339792 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4b3c9-8910-4649-9785-4dbe0090ecec None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:08.340073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4b3c9-8910-4649-9785-4dbe0090ecec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:08.364942 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7f11b-5704-4f7f-9840-c6d238aafba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:08.365654 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7f11b-5704-4f7f-9840-c6d238aafba7 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:08.365961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7f11b-5704-4f7f-9840-c6d238aafba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:08.366241 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7f11b-5704-4f7f-9840-c6d238aafba7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:08.367992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-06d4b3c9-8910-4649-9785-4dbe0090ecec None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:08.369199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-06d4b3c9-8910-4649-9785-4dbe0090ecec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:08.449688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 177/355] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:08.451366 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4b3c9-8910-4649-9785-4dbe0090ecec None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:08.456545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7f11b-5704-4f7f-9840-c6d238aafba7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:08.458109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7f11b-5704-4f7f-9840-c6d238aafba7 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:08.484580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:08.493901 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:08.574734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4b3c9-8910-4649-9785-4dbe0090ecec None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:08.576052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 179/356] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:51:08.577249 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7f11b-5704-4f7f-9840-c6d238aafba7 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:08.620500 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e6bb1-91c1-4a45-9bbc-5f4d5473f0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:08.621273 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e6bb1-91c1-4a45-9bbc-5f4d5473f0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:08.621448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e6bb1-91c1-4a45-9bbc-5f4d5473f0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:08.621715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e6bb1-91c1-4a45-9bbc-5f4d5473f0e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:08.622757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e6bb1-91c1-4a45-9bbc-5f4d5473f0e1 None admin] RBAC: Adding query filter params (role.id=684d55f3873849f08303658557ed05e8, user.id=bedcd4cc240941b99bd47efe50680833, scope.system=all) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:08.622874 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e6bb1-91c1-4a45-9bbc-5f4d5473f0e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:08.625092 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e6bb1-91c1-4a45-9bbc-5f4d5473f0e1 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:08.642114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 178/357] 10.222.0.13 () {56 vars in 1308 bytes} [Thu Jun 23 01:51:08 2022] GET /identity/v3/role_assignments?user.id=bedcd4cc240941b99bd47efe50680833&scope.system=all&role.id=684d55f3873849f08303658557ed05e8 => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:08.643232 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e6bb1-91c1-4a45-9bbc-5f4d5473f0e1 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:08.734545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7f11b-5704-4f7f-9840-c6d238aafba7 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:08.786885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:08.793675 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:08.802883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d72dd9-2f1a-46c1-bc7f-028e7a63cf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:08.803864 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d72dd9-2f1a-46c1-bc7f-028e7a63cf9d None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:08.804157 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d72dd9-2f1a-46c1-bc7f-028e7a63cf9d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:08.804871 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d72dd9-2f1a-46c1-bc7f-028e7a63cf9d None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:08.805917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d72dd9-2f1a-46c1-bc7f-028e7a63cf9d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:08.806227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d72dd9-2f1a-46c1-bc7f-028e7a63cf9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:08.807386 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e6bb1-91c1-4a45-9bbc-5f4d5473f0e1 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:08.807679 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d72dd9-2f1a-46c1-bc7f-028e7a63cf9d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:08.821332 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 180/358] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:08.822994 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd5c64-59c1-46db-a60c-4dbb24744b7d None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:08.822994 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd5c64-59c1-46db-a60c-4dbb24744b7d None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:08.824236 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd5c64-59c1-46db-a60c-4dbb24744b7d None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:08.825697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 181/359] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:08.827702 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd5c64-59c1-46db-a60c-4dbb24744b7d None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:08.871447 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa47d1-7d1a-4134-9dd8-3779cb743ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:08.871447 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa47d1-7d1a-4134-9dd8-3779cb743ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:08.871712 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa47d1-7d1a-4134-9dd8-3779cb743ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:08.871963 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa47d1-7d1a-4134-9dd8-3779cb743ee9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:08.872682 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa47d1-7d1a-4134-9dd8-3779cb743ee9 None admin] RBAC: Adding query filter params (group.id=c023f797837346d893755684392878df, role.id=51b1227b19794e6fb73ae32c4d0165fb, scope.project.id=95472ace4fc043ed86453b0002951eec) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:08.873026 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa47d1-7d1a-4134-9dd8-3779cb743ee9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:08.875683 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa47d1-7d1a-4134-9dd8-3779cb743ee9 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:08.886842 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 179/360] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 23 01:51:08 2022] GET /identity/v3/role_assignments?group.id=c023f797837346d893755684392878df&scope.project.id=95472ace4fc043ed86453b0002951eec&role.id=51b1227b19794e6fb73ae32c4d0165fb => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:08.887740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa47d1-7d1a-4134-9dd8-3779cb743ee9 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:09.018101 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd5c64-59c1-46db-a60c-4dbb24744b7d None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:09.075082 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa47d1-7d1a-4134-9dd8-3779cb743ee9 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:09.083724 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a17f96-dbbf-496a-95f6-df182a61071a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:09.084991 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a17f96-dbbf-496a-95f6-df182a61071a None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:09.085470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a17f96-dbbf-496a-95f6-df182a61071a None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:09.086027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a17f96-dbbf-496a-95f6-df182a61071a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:09.102908 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a17f96-dbbf-496a-95f6-df182a61071a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:09.112246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-90a17f96-dbbf-496a-95f6-df182a61071a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:51:09.112246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:09.112246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:09.112246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:09.112246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:09.112246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:09.112246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:09.112246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:09.112246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:09.112246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:09.112246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:09.112246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:09.112246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:09.112246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:09.112246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:09.112246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:09.113175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:09.113175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:09.113175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:09.113175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:09.113175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:09.113175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:09.113175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:09.113175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:09.113175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:09.113175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:09.113175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:09.113175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:09.113175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:09.113175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:09.113175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:09.113175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:09.114449 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:09.114449 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:09.114449 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:09.114449 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:09.114449 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:09.114449 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:09.114449 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:09.114449 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:09.114449 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:09.114449 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:09.114449 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:51:09.114449 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:09.117398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 182/361] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 01:51:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:09.118444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a17f96-dbbf-496a-95f6-df182a61071a None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:09.120318 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41826fb8-11dc-484c-be74-3a838e02dd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:09.121434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41826fb8-11dc-484c-be74-3a838e02dd14 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:09.121768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41826fb8-11dc-484c-be74-3a838e02dd14 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:09.122045 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41826fb8-11dc-484c-be74-3a838e02dd14 None admin] PATH_INFO: `/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:09.123847 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41826fb8-11dc-484c-be74-3a838e02dd14 None admin] RBAC: Authorizing `identity:get_project(project_id=e3059ec0bd6649c8bd24c1e0a5b48c39)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:09.125545 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41826fb8-11dc-484c-be74-3a838e02dd14 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:09.127401 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 180/362] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:51:08 2022] GET /identity/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:09.131213 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235812a-afee-4c6c-a017-43f5637b7567 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:09.131213 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235812a-afee-4c6c-a017-43f5637b7567 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:09.131213 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235812a-afee-4c6c-a017-43f5637b7567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:09.147632 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-b235812a-afee-4c6c-a017-43f5637b7567 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:09.148826 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-b235812a-afee-4c6c-a017-43f5637b7567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:09.166066 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:09.186311 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:09.241389 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 181/363] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:09.247434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235812a-afee-4c6c-a017-43f5637b7567 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:09.260504 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a17f96-dbbf-496a-95f6-df182a61071a None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:09.306716 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70579ec-40a1-4583-b3ad-8c7546d0543a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:09.307299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70579ec-40a1-4583-b3ad-8c7546d0543a None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:09.307601 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70579ec-40a1-4583-b3ad-8c7546d0543a None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:09.307874 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70579ec-40a1-4583-b3ad-8c7546d0543a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:09.386779 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235812a-afee-4c6c-a017-43f5637b7567 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:09.387847 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70579ec-40a1-4583-b3ad-8c7546d0543a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:09.389404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70579ec-40a1-4583-b3ad-8c7546d0543a None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:09.427958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4f3e3-74a2-42b4-be39-714d9468aa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:09.428656 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4f3e3-74a2-42b4-be39-714d9468aa7d None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:09.428936 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4f3e3-74a2-42b4-be39-714d9468aa7d None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:09.429213 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4f3e3-74a2-42b4-be39-714d9468aa7d None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:09.429969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4f3e3-74a2-42b4-be39-714d9468aa7d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:09.430275 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4f3e3-74a2-42b4-be39-714d9468aa7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:09.431738 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4f3e3-74a2-42b4-be39-714d9468aa7d None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:09.441043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 182/364] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:09.446045 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4f3e3-74a2-42b4-be39-714d9468aa7d None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:09.451983 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:09.457555 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:09.513490 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 183/365] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:51:09.515071 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70579ec-40a1-4583-b3ad-8c7546d0543a None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:09.568881 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4f3e3-74a2-42b4-be39-714d9468aa7d None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:09.609674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c88b6-1530-4821-956d-3c453f9f283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:09.610571 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c88b6-1530-4821-956d-3c453f9f283a None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:09.610865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c88b6-1530-4821-956d-3c453f9f283a None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:09.611124 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c88b6-1530-4821-956d-3c453f9f283a None admin] PATH_INFO: `/v3/groups/c023f797837346d893755684392878df` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:09.612539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c88b6-1530-4821-956d-3c453f9f283a None admin] RBAC: Authorizing `identity:get_group(group_id=c023f797837346d893755684392878df)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:09.614157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c88b6-1530-4821-956d-3c453f9f283a None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:09.615870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 183/366] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 01:51:09 2022] GET /identity/v3/groups/c023f797837346d893755684392878df => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:09.616766 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c88b6-1530-4821-956d-3c453f9f283a None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:09.634322 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70579ec-40a1-4583-b3ad-8c7546d0543a None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:09.681816 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e26ac-a275-42ab-9e43-af67df4a9ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:09.682630 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e26ac-a275-42ab-9e43-af67df4a9ece None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:09.682910 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e26ac-a275-42ab-9e43-af67df4a9ece None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:09.683185 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e26ac-a275-42ab-9e43-af67df4a9ece None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:09.696626 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e26ac-a275-42ab-9e43-af67df4a9ece None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:09.704604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:09.708070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-af7e26ac-a275-42ab-9e43-af67df4a9ece None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:51:09.708070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:09.708070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:09.708070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:09.708070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:09.708070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:09.708070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:09.708070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:09.708070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:09.708070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:09.708070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:09.708070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:09.708070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:09.708070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:09.708070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:09.708070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:09.709130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:09.709130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:09.709130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:09.709130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:09.709130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:09.709130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:09.709130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:09.709130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:09.709130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:09.709130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:09.709130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:09.709130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:09.709130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:09.709130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:09.709130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:09.709130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:09.710451 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:09.710451 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:09.710451 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:09.710451 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:09.710451 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:09.710451 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:09.710451 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:09.710451 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:09.710451 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:09.710451 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:09.710451 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:51:09.710451 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:09.710451 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 184/367] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:51:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:09.710451 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e26ac-a275-42ab-9e43-af67df4a9ece None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:09.735103 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:09.736485 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c88b6-1530-4821-956d-3c453f9f283a None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:09.780775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b60898-f768-4ec4-bf0e-887b79518f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:09.781262 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b60898-f768-4ec4-bf0e-887b79518f1d None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:09.781542 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b60898-f768-4ec4-bf0e-887b79518f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:09.781814 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b60898-f768-4ec4-bf0e-887b79518f1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:09.839519 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e26ac-a275-42ab-9e43-af67df4a9ece None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:09.865646 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b60898-f768-4ec4-bf0e-887b79518f1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:09.867122 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b60898-f768-4ec4-bf0e-887b79518f1d None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:09.881637 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a4e24-3a65-46e2-aa8a-05ec0aed27d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:09.882522 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a4e24-3a65-46e2-aa8a-05ec0aed27d3 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:09.882803 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a4e24-3a65-46e2-aa8a-05ec0aed27d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:09.883168 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a4e24-3a65-46e2-aa8a-05ec0aed27d3 None admin] PATH_INFO: `/v3/projects/95472ace4fc043ed86453b0002951eec` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:09.884302 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a4e24-3a65-46e2-aa8a-05ec0aed27d3 None admin] RBAC: Authorizing `identity:get_project(project_id=95472ace4fc043ed86453b0002951eec)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:09.885742 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a4e24-3a65-46e2-aa8a-05ec0aed27d3 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:09.891580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 185/368] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:51:09 2022] GET /identity/v3/projects/95472ace4fc043ed86453b0002951eec => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:09.891580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a4e24-3a65-46e2-aa8a-05ec0aed27d3 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:09.975544 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:09.998130 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 184/369] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:51:09.998885 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:09.999491 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b60898-f768-4ec4-bf0e-887b79518f1d None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:10.031219 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a4e24-3a65-46e2-aa8a-05ec0aed27d3 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:10.080919 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13947a2-b84b-425a-9edd-2bec3916495c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:10.081695 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13947a2-b84b-425a-9edd-2bec3916495c None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:10.081981 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13947a2-b84b-425a-9edd-2bec3916495c None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:10.082253 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13947a2-b84b-425a-9edd-2bec3916495c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:10.083206 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13947a2-b84b-425a-9edd-2bec3916495c None admin] RBAC: Adding query filter params (group.id=c023f797837346d893755684392878df, role.id=51b1227b19794e6fb73ae32c4d0165fb, scope.project.id=e3059ec0bd6649c8bd24c1e0a5b48c39) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:10.083547 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13947a2-b84b-425a-9edd-2bec3916495c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:10.085004 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13947a2-b84b-425a-9edd-2bec3916495c None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:10.091703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 186/370] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 23 01:51:09 2022] GET /identity/v3/role_assignments?group.id=c023f797837346d893755684392878df&scope.project.id=e3059ec0bd6649c8bd24c1e0a5b48c39&role.id=51b1227b19794e6fb73ae32c4d0165fb => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:10.092510 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13947a2-b84b-425a-9edd-2bec3916495c None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:10.131665 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b60898-f768-4ec4-bf0e-887b79518f1d None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:10.176201 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a346f-6429-404c-8140-b7da4a66de46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:10.176942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a346f-6429-404c-8140-b7da4a66de46 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:10.177220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a346f-6429-404c-8140-b7da4a66de46 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:10.177531 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a346f-6429-404c-8140-b7da4a66de46 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:10.178306 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a346f-6429-404c-8140-b7da4a66de46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:10.178610 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a346f-6429-404c-8140-b7da4a66de46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:10.180170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a346f-6429-404c-8140-b7da4a66de46 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:10.191304 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 185/371] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:10.192467 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a346f-6429-404c-8140-b7da4a66de46 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:10.224617 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13947a2-b84b-425a-9edd-2bec3916495c None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:10.244581 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:10.272759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69c9cc-3b46-4168-9c80-ad4166b04156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:10.273644 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69c9cc-3b46-4168-9c80-ad4166b04156 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:10.273924 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69c9cc-3b46-4168-9c80-ad4166b04156 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:10.274195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69c9cc-3b46-4168-9c80-ad4166b04156 None admin] PATH_INFO: `/v3/groups/c023f797837346d893755684392878df` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:10.276981 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69c9cc-3b46-4168-9c80-ad4166b04156 None admin] RBAC: Authorizing `identity:get_group(group_id=c023f797837346d893755684392878df)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:10.278429 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69c9cc-3b46-4168-9c80-ad4166b04156 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:10.280112 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 187/372] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 01:51:10 2022] GET /identity/v3/groups/c023f797837346d893755684392878df => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:10.284606 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69c9cc-3b46-4168-9c80-ad4166b04156 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:10.300876 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:10.335491 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a346f-6429-404c-8140-b7da4a66de46 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:10.381763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de8d13-012a-45f3-a360-54935adaa960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:10.382608 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de8d13-012a-45f3-a360-54935adaa960 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:10.382934 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de8d13-012a-45f3-a360-54935adaa960 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:10.383206 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de8d13-012a-45f3-a360-54935adaa960 None admin] PATH_INFO: `/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:10.384450 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de8d13-012a-45f3-a360-54935adaa960 None admin] RBAC: Authorizing `identity:get_project(project_id=e3059ec0bd6649c8bd24c1e0a5b48c39)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:10.385921 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de8d13-012a-45f3-a360-54935adaa960 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:10.387721 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 186/373] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:51:10 2022] GET /identity/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:10.392144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de8d13-012a-45f3-a360-54935adaa960 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:10.407856 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69c9cc-3b46-4168-9c80-ad4166b04156 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:10.444888 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f084d-abdc-4ba4-abb7-bbfb16e16656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:10.445552 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f084d-abdc-4ba4-abb7-bbfb16e16656 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:10.445836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f084d-abdc-4ba4-abb7-bbfb16e16656 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:10.446112 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f084d-abdc-4ba4-abb7-bbfb16e16656 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:10.499213 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de8d13-012a-45f3-a360-54935adaa960 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:10.506490 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:10.522320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f084d-abdc-4ba4-abb7-bbfb16e16656 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:10.524036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f084d-abdc-4ba4-abb7-bbfb16e16656 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:10.534626 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c3a41-03ab-430e-931e-57d035985b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:10.535383 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c3a41-03ab-430e-931e-57d035985b5b None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:10.535795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c3a41-03ab-430e-931e-57d035985b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:10.536206 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c3a41-03ab-430e-931e-57d035985b5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:10.537090 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c3a41-03ab-430e-931e-57d035985b5b None admin] RBAC: Adding query filter params (group.id=c023f797837346d893755684392878df, role.id=77aca4b95bbe47cbb528be2615112ac4, scope.project.id=95472ace4fc043ed86453b0002951eec) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:10.537396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c3a41-03ab-430e-931e-57d035985b5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:10.538854 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c3a41-03ab-430e-931e-57d035985b5b None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:10.539862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:10.545282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 187/374] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 23 01:51:10 2022] GET /identity/v3/role_assignments?group.id=c023f797837346d893755684392878df&scope.project.id=95472ace4fc043ed86453b0002951eec&role.id=77aca4b95bbe47cbb528be2615112ac4 => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:10.552455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c3a41-03ab-430e-931e-57d035985b5b None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:10.639454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 188/375] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:51:10.645364 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f084d-abdc-4ba4-abb7-bbfb16e16656 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:10.754772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f084d-abdc-4ba4-abb7-bbfb16e16656 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:10.762806 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c3a41-03ab-430e-931e-57d035985b5b None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:10.769151 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:10.793205 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a0fe7-a1af-4813-9e43-dd15f4201d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:10.794097 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a0fe7-a1af-4813-9e43-dd15f4201d30 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:10.794379 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a0fe7-a1af-4813-9e43-dd15f4201d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:10.794652 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a0fe7-a1af-4813-9e43-dd15f4201d30 None admin] PATH_INFO: `/v3/projects/3c1562009fe043679c20e065b5b0b463` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:10.799462 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a0fe7-a1af-4813-9e43-dd15f4201d30 None admin] RBAC: Authorizing `identity:get_project(project_id=3c1562009fe043679c20e065b5b0b463)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:10.799462 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a0fe7-a1af-4813-9e43-dd15f4201d30 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:10.799674 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 189/376] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:51:10 2022] GET /identity/v3/projects/3c1562009fe043679c20e065b5b0b463 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:10.805662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a0fe7-a1af-4813-9e43-dd15f4201d30 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:10.816329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da92008-5086-4adb-862f-c048d9306cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:10.817663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da92008-5086-4adb-862f-c048d9306cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:10.818571 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da92008-5086-4adb-862f-c048d9306cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:10.819032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da92008-5086-4adb-862f-c048d9306cd1 None admin] PATH_INFO: `/v3/groups/c023f797837346d893755684392878df` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:10.824157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da92008-5086-4adb-862f-c048d9306cd1 None admin] RBAC: Authorizing `identity:get_group(group_id=c023f797837346d893755684392878df)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:10.825638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da92008-5086-4adb-862f-c048d9306cd1 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:10.827312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 188/377] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 01:51:10 2022] GET /identity/v3/groups/c023f797837346d893755684392878df => generated 226 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:10.833431 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da92008-5086-4adb-862f-c048d9306cd1 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:10.918518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:10.949266 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a0fe7-a1af-4813-9e43-dd15f4201d30 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:11.021324 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99309dec-af85-4aa5-a974-3f1c92a07587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:11.022205 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99309dec-af85-4aa5-a974-3f1c92a07587 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:11.022486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99309dec-af85-4aa5-a974-3f1c92a07587 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:11.022755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99309dec-af85-4aa5-a974-3f1c92a07587 None admin] PATH_INFO: `/v3/groups/73e96ed12fde43208df0bb87151b9a09` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:11.031744 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da92008-5086-4adb-862f-c048d9306cd1 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:11.036606 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99309dec-af85-4aa5-a974-3f1c92a07587 None admin] RBAC: Authorizing `identity:get_group(group_id=73e96ed12fde43208df0bb87151b9a09)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:11.038072 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99309dec-af85-4aa5-a974-3f1c92a07587 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:11.039818 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 190/378] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 01:51:10 2022] GET /identity/v3/groups/73e96ed12fde43208df0bb87151b9a09 => generated 229 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:11.051504 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99309dec-af85-4aa5-a974-3f1c92a07587 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:11.075173 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2503993-5090-4140-8632-748136ba81c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:11.075871 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2503993-5090-4140-8632-748136ba81c6 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:11.076158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2503993-5090-4140-8632-748136ba81c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:11.076436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2503993-5090-4140-8632-748136ba81c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:11.077273 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2503993-5090-4140-8632-748136ba81c6 None admin] RBAC: Adding query filter params (group.id=c023f797837346d893755684392878df, role.id=77aca4b95bbe47cbb528be2615112ac4, scope.project.id=e3059ec0bd6649c8bd24c1e0a5b48c39) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:11.077645 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2503993-5090-4140-8632-748136ba81c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:11.079159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2503993-5090-4140-8632-748136ba81c6 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:11.085271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 189/379] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 23 01:51:10 2022] GET /identity/v3/role_assignments?group.id=c023f797837346d893755684392878df&scope.project.id=e3059ec0bd6649c8bd24c1e0a5b48c39&role.id=77aca4b95bbe47cbb528be2615112ac4 => generated 260 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:11.086598 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5f36f-e775-45fa-b96c-2f34e175a199 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:11.086889 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5f36f-e775-45fa-b96c-2f34e175a199 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:11.087168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5f36f-e775-45fa-b96c-2f34e175a199 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:11.088783 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 190/380] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:11.094594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ce8ce-c91c-49db-8971-bb6d61fedefd None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:11.095318 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ce8ce-c91c-49db-8971-bb6d61fedefd None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:11.095816 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ce8ce-c91c-49db-8971-bb6d61fedefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:11.099851 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:11.124764 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-b86ce8ce-c91c-49db-8971-bb6d61fedefd None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:11.126004 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-b86ce8ce-c91c-49db-8971-bb6d61fedefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:11.219254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99309dec-af85-4aa5-a974-3f1c92a07587 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:11.276242 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb47642-81f1-4ede-bff2-d46139667ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:11.276909 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb47642-81f1-4ede-bff2-d46139667ddd None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:11.277187 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb47642-81f1-4ede-bff2-d46139667ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:11.277459 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb47642-81f1-4ede-bff2-d46139667ddd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:11.278297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb47642-81f1-4ede-bff2-d46139667ddd None admin] RBAC: Adding query filter params (group.id=73e96ed12fde43208df0bb87151b9a09, role.id=58e04437159e4eb39aa4a43c213ea34c, scope.project.id=3c1562009fe043679c20e065b5b0b463) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:11.278605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb47642-81f1-4ede-bff2-d46139667ddd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:11.280122 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb47642-81f1-4ede-bff2-d46139667ddd None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:11.283072 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 191/381] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:51:11.286362 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 191/382] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 23 01:51:11 2022] GET /identity/v3/role_assignments?group.id=73e96ed12fde43208df0bb87151b9a09&scope.project.id=3c1562009fe043679c20e065b5b0b463&role.id=58e04437159e4eb39aa4a43c213ea34c => generated 260 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:11.306002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ce8ce-c91c-49db-8971-bb6d61fedefd None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:11.358851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:11.458327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ce8ce-c91c-49db-8971-bb6d61fedefd None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:11.507323 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccfcc4-7bdb-4be5-bf7a-ad14c2c679c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:11.508163 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccfcc4-7bdb-4be5-bf7a-ad14c2c679c2 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:11.508439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccfcc4-7bdb-4be5-bf7a-ad14c2c679c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:11.508708 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccfcc4-7bdb-4be5-bf7a-ad14c2c679c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:11.527366 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feccfcc4-7bdb-4be5-bf7a-ad14c2c679c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:11.535239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-feccfcc4-7bdb-4be5-bf7a-ad14c2c679c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:51:11.535239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:11.535239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:11.535239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:11.535239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:11.535239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:11.535239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:11.535239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:11.535239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:11.535239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:11.535239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:11.535239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:11.535239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:11.535239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:11.535239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:11.535239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:11.536278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:11.536278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:11.536278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:11.536278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:11.536278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:11.536278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:11.536278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:11.536278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:11.536278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:11.536278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:11.536278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:11.536278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:11.536278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:11.536278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:11.536278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:11.536278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:11.538372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:11.538372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:11.538372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:11.538372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:11.538372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:11.538372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:11.538372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:11.538372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:11.538372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:11.538372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:11.538372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:51:11.538372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:11.538372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 192/383] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:11.546042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb47642-81f1-4ede-bff2-d46139667ddd None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:11.650350 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb47642-81f1-4ede-bff2-d46139667ddd None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:11.667441 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:11.698818 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd36ce-c1bc-417e-824d-f99ab918e1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:11.699870 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd36ce-c1bc-417e-824d-f99ab918e1fb None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:11.700385 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd36ce-c1bc-417e-824d-f99ab918e1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:11.700871 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd36ce-c1bc-417e-824d-f99ab918e1fb None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:11.701820 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd36ce-c1bc-417e-824d-f99ab918e1fb None admin] RBAC: Adding query filter params (name=member) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:11.702333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd36ce-c1bc-417e-824d-f99ab918e1fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:11.703984 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd36ce-c1bc-417e-824d-f99ab918e1fb None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:11.719742 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 192/384] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:51:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:11.720780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccfcc4-7bdb-4be5-bf7a-ad14c2c679c2 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:11.842601 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:11.851889 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccfcc4-7bdb-4be5-bf7a-ad14c2c679c2 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:11.885596 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab5d19-62e0-4ab0-83cf-2db95f4500c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:11.886642 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab5d19-62e0-4ab0-83cf-2db95f4500c9 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:11.887015 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab5d19-62e0-4ab0-83cf-2db95f4500c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:11.887381 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab5d19-62e0-4ab0-83cf-2db95f4500c9 None admin] PATH_INFO: `/v3/groups/c023f797837346d893755684392878df` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:11.888675 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab5d19-62e0-4ab0-83cf-2db95f4500c9 None admin] RBAC: Authorizing `identity:get_group(group_id=c023f797837346d893755684392878df)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:11.890213 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab5d19-62e0-4ab0-83cf-2db95f4500c9 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:11.892272 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 193/385] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 01:51:11 2022] GET /identity/v3/groups/c023f797837346d893755684392878df => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:11.898064 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd36ce-c1bc-417e-824d-f99ab918e1fb None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:12.058758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd36ce-c1bc-417e-824d-f99ab918e1fb None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:12.093268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72caa50d-6691-471d-9dee-18b20b908cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:12.094059 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caa50d-6691-471d-9dee-18b20b908cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:12.094341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caa50d-6691-471d-9dee-18b20b908cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:12.094615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caa50d-6691-471d-9dee-18b20b908cd8 None admin] PATH_INFO: `/v3/projects/95472ace4fc043ed86453b0002951eec` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:12.095830 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72caa50d-6691-471d-9dee-18b20b908cd8 None admin] RBAC: Authorizing `identity:get_project(project_id=95472ace4fc043ed86453b0002951eec)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:12.097294 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72caa50d-6691-471d-9dee-18b20b908cd8 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:12.099516 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 193/386] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:51:11 2022] GET /identity/v3/projects/95472ace4fc043ed86453b0002951eec => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:12.105108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab5d19-62e0-4ab0-83cf-2db95f4500c9 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:12.262089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab5d19-62e0-4ab0-83cf-2db95f4500c9 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:12.303057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c7b02-9430-432b-863f-3fd4f84bfb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:12.303977 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c7b02-9430-432b-863f-3fd4f84bfb9e None admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:12.304252 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c7b02-9430-432b-863f-3fd4f84bfb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:12.304572 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c7b02-9430-432b-863f-3fd4f84bfb9e None admin] PATH_INFO: `/v3/projects/95472ace4fc043ed86453b0002951eec/groups/c023f797837346d893755684392878df/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:12.308181 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c7b02-9430-432b-863f-3fd4f84bfb9e None admin] RBAC: Authorizing `identity:create_grant(project_id=95472ace4fc043ed86453b0002951eec, group_id=c023f797837346d893755684392878df, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:12.309653 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c7b02-9430-432b-863f-3fd4f84bfb9e None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:12.340541 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 194/387] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Jun 23 01:51:12 2022] PUT /identity/v3/projects/95472ace4fc043ed86453b0002951eec/groups/c023f797837346d893755684392878df/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:51:12.730998 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2e187-bc92-47c8-aaba-77b495a58e16 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:12.731538 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2e187-bc92-47c8-aaba-77b495a58e16 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:12.731870 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2e187-bc92-47c8-aaba-77b495a58e16 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:12.733610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 194/388] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:12.739092 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da936d-7e78-49f2-9a97-8569f819d0de None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:12.739547 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da936d-7e78-49f2-9a97-8569f819d0de None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:12.739922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da936d-7e78-49f2-9a97-8569f819d0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:12.758434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-85da936d-7e78-49f2-9a97-8569f819d0de None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:12.759645 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-85da936d-7e78-49f2-9a97-8569f819d0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:12.774075 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:12.829106 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 195/389] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:12.851226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2e187-bc92-47c8-aaba-77b495a58e16 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:12.899276 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:12.995032 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2e187-bc92-47c8-aaba-77b495a58e16 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:13.036233 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe4a90-00ea-43a4-ae19-5a40ca1e0d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:13.037051 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe4a90-00ea-43a4-ae19-5a40ca1e0d07 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:13.037382 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe4a90-00ea-43a4-ae19-5a40ca1e0d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:13.037660 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe4a90-00ea-43a4-ae19-5a40ca1e0d07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:13.048128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe4a90-00ea-43a4-ae19-5a40ca1e0d07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:13.056582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-94fe4a90-00ea-43a4-ae19-5a40ca1e0d07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:51:13.056582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:13.056582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:13.056582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:13.056582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:13.056582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:13.056582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:13.056582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:13.056582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:13.056582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:13.056582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:13.056582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:13.056582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:13.056582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:13.056582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:13.056582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:13.057571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:13.057571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:13.057571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:13.057571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:13.057571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:13.057571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:13.057571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:13.057571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:13.057571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:13.057571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:13.057571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:13.057571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:13.057571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:13.057571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:13.057571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:13.057571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:13.058404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:13.058404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:13.058404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:13.058404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:13.058404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:13.058404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:13.058404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:13.058404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:13.058404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:13.058404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:13.058404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:51:13.058404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:13.058404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 195/390] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:13.064456 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da936d-7e78-49f2-9a97-8569f819d0de None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:13.165433 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da936d-7e78-49f2-9a97-8569f819d0de None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:13.184571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7e00c-242a-42ba-a7ba-eb7e95e679ae None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:13.184885 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7e00c-242a-42ba-a7ba-eb7e95e679ae None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:13.185111 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7e00c-242a-42ba-a7ba-eb7e95e679ae None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:13.186970 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 196/391] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:51:13.191874 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b01676-26b6-4d63-94d3-84ef42d9732d None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:13.192160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b01676-26b6-4d63-94d3-84ef42d9732d None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:13.192437 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b01676-26b6-4d63-94d3-84ef42d9732d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:13.204843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b555c-176c-484e-888e-5f3db596f686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:13.205528 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b555c-176c-484e-888e-5f3db596f686 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:13.205807 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b555c-176c-484e-888e-5f3db596f686 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:13.206079 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b555c-176c-484e-888e-5f3db596f686 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:13.206838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b555c-176c-484e-888e-5f3db596f686 None admin] RBAC: Adding query filter params (name=member) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:13.207140 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b555c-176c-484e-888e-5f3db596f686 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:13.208802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b555c-176c-484e-888e-5f3db596f686 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:13.217913 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 196/392] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:51:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:13.223347 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b555c-176c-484e-888e-5f3db596f686 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:13.244443 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-d9b01676-26b6-4d63-94d3-84ef42d9732d None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:13.245712 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-d9b01676-26b6-4d63-94d3-84ef42d9732d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:13.247810 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:13.353969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b555c-176c-484e-888e-5f3db596f686 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:13.381691 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 197/393] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:13.402949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a28a5-1920-488e-b98c-f5401344e9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:13.403856 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a28a5-1920-488e-b98c-f5401344e9da None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:13.404140 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a28a5-1920-488e-b98c-f5401344e9da None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:13.404417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a28a5-1920-488e-b98c-f5401344e9da None admin] PATH_INFO: `/v3/groups/c023f797837346d893755684392878df` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:13.405625 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a28a5-1920-488e-b98c-f5401344e9da None admin] RBAC: Authorizing `identity:get_group(group_id=c023f797837346d893755684392878df)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:13.407081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a28a5-1920-488e-b98c-f5401344e9da None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:13.409042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 197/394] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 01:51:13 2022] GET /identity/v3/groups/c023f797837346d893755684392878df => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:51:13.416698 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b01676-26b6-4d63-94d3-84ef42d9732d None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:13.417954 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a28a5-1920-488e-b98c-f5401344e9da None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:13.472605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:13.506623 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:13.539092 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a28a5-1920-488e-b98c-f5401344e9da None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:13.586903 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b01676-26b6-4d63-94d3-84ef42d9732d None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:13.614425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5bf7a-7d11-46e9-8e5a-cdfcf8ecb9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:13.615249 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5bf7a-7d11-46e9-8e5a-cdfcf8ecb9df None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:13.615572 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5bf7a-7d11-46e9-8e5a-cdfcf8ecb9df None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:13.615842 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5bf7a-7d11-46e9-8e5a-cdfcf8ecb9df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:13.627497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5bf7a-7d11-46e9-8e5a-cdfcf8ecb9df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:13.631515 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6635a-ce5d-4810-a249-14f218e6e52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:13.632403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6635a-ce5d-4810-a249-14f218e6e52b None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:13.632688 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6635a-ce5d-4810-a249-14f218e6e52b None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:13.632966 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6635a-ce5d-4810-a249-14f218e6e52b None admin] PATH_INFO: `/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:13.634157 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6635a-ce5d-4810-a249-14f218e6e52b None admin] RBAC: Authorizing `identity:get_project(project_id=e3059ec0bd6649c8bd24c1e0a5b48c39)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:13.635652 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6635a-ce5d-4810-a249-14f218e6e52b None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:13.636061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-fad5bf7a-7d11-46e9-8e5a-cdfcf8ecb9df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:51:13.636061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:13.636061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:13.636061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:13.636061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:13.636061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:13.636061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:13.636061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:13.636061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:13.636061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:13.636061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:13.636061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:13.636061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:13.636061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:13.636061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:13.636061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:13.636997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:13.636997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:13.636997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:13.636997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:13.636997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:13.636997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:13.636997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:13.636997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:13.636997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:13.636997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:13.636997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:13.636997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:13.636997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:13.636997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:13.636997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:13.636997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:13.637781 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:13.637781 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:13.637781 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:13.637781 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:13.637781 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:13.637781 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:13.637781 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:13.637781 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:13.637781 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:13.637781 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:13.637781 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:51:13.637781 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:13.638408 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 198/395] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:51:13 2022] GET /identity/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:13.639934 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9b84c-b6e7-44d9-8818-c3730e99b83d None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:13.642152 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9b84c-b6e7-44d9-8818-c3730e99b83d None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:13.642152 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9b84c-b6e7-44d9-8818-c3730e99b83d None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:13.642464 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 198/396] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 01:51:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:51:13.643727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 199/397] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:13.643989 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5bf7a-7d11-46e9-8e5a-cdfcf8ecb9df None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:13.648484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9b84c-b6e7-44d9-8818-c3730e99b83d None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:13.757546 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5bf7a-7d11-46e9-8e5a-cdfcf8ecb9df None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:13.758641 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:13.766563 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9b84c-b6e7-44d9-8818-c3730e99b83d None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:13.791607 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabd24e-623c-48fb-bddf-857b1ae74007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:13.792280 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabd24e-623c-48fb-bddf-857b1ae74007 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:13.792559 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabd24e-623c-48fb-bddf-857b1ae74007 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:13.792831 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabd24e-623c-48fb-bddf-857b1ae74007 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:13.793575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeabd24e-623c-48fb-bddf-857b1ae74007 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:13.793882 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeabd24e-623c-48fb-bddf-857b1ae74007 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:13.795260 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeabd24e-623c-48fb-bddf-857b1ae74007 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:13.803227 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 199/398] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:51:13.804994 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762f08a-e4fe-4406-9122-c3fa1b72e1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:13.806242 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762f08a-e4fe-4406-9122-c3fa1b72e1ff None admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:13.806722 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762f08a-e4fe-4406-9122-c3fa1b72e1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:13.807272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762f08a-e4fe-4406-9122-c3fa1b72e1ff None admin] PATH_INFO: `/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39/groups/c023f797837346d893755684392878df/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:13.808755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049c5fe-48cc-4257-b714-2ff3348a4053 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:13.809068 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049c5fe-48cc-4257-b714-2ff3348a4053 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:13.809314 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049c5fe-48cc-4257-b714-2ff3348a4053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:13.810224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762f08a-e4fe-4406-9122-c3fa1b72e1ff None admin] RBAC: Authorizing `identity:create_grant(project_id=e3059ec0bd6649c8bd24c1e0a5b48c39, group_id=c023f797837346d893755684392878df, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:13.812338 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762f08a-e4fe-4406-9122-c3fa1b72e1ff None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:13.815031 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:13.826901 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 200/399] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Jun 23 01:51:13 2022] PUT /identity/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39/groups/c023f797837346d893755684392878df/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:51:13.828513 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-b049c5fe-48cc-4257-b714-2ff3348a4053 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:13.829715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-b049c5fe-48cc-4257-b714-2ff3348a4053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:13.837182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350a7aa-4ba0-4903-ba07-cdce37513cfd None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:13.837891 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350a7aa-4ba0-4903-ba07-cdce37513cfd None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:13.839118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350a7aa-4ba0-4903-ba07-cdce37513cfd None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:13.841082 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 201/400] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:13 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:13.842132 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350a7aa-4ba0-4903-ba07-cdce37513cfd None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:13.931562 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 200/401] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:13.931562 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea680b-e79a-4df6-8dd4-1484407f66b3 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:13.931562 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea680b-e79a-4df6-8dd4-1484407f66b3 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:13.931562 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea680b-e79a-4df6-8dd4-1484407f66b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:13.956643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-3eea680b-e79a-4df6-8dd4-1484407f66b3 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:13.958154 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-3eea680b-e79a-4df6-8dd4-1484407f66b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:13.999128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350a7aa-4ba0-4903-ba07-cdce37513cfd None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:14.037143 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 201/402] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:14.037961 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea680b-e79a-4df6-8dd4-1484407f66b3 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:14.054106 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7940cc-5d22-490b-b766-abf91c8a55ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:14.055344 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7940cc-5d22-490b-b766-abf91c8a55ea None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:14.055912 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7940cc-5d22-490b-b766-abf91c8a55ea None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:14.056390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7940cc-5d22-490b-b766-abf91c8a55ea None admin] PATH_INFO: `/v3/groups/c023f797837346d893755684392878df` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:14.057859 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7940cc-5d22-490b-b766-abf91c8a55ea None admin] RBAC: Authorizing `identity:get_group(group_id=c023f797837346d893755684392878df)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:14.060303 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7940cc-5d22-490b-b766-abf91c8a55ea None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:14.062495 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 202/403] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 01:51:13 2022] GET /identity/v3/groups/c023f797837346d893755684392878df => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:14.065619 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7940cc-5d22-490b-b766-abf91c8a55ea None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:14.102945 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:14.124783 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:14.166265 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea680b-e79a-4df6-8dd4-1484407f66b3 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:14.194710 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7940cc-5d22-490b-b766-abf91c8a55ea None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:14.203745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f38ebd-a9c2-47b5-8189-f43c792caf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:14.204673 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f38ebd-a9c2-47b5-8189-f43c792caf2c None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:14.204953 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f38ebd-a9c2-47b5-8189-f43c792caf2c None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:14.205221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f38ebd-a9c2-47b5-8189-f43c792caf2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:14.218648 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f38ebd-a9c2-47b5-8189-f43c792caf2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:14.226947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-51f38ebd-a9c2-47b5-8189-f43c792caf2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:51:14.226947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:14.226947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:14.226947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:14.226947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:14.226947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:14.226947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:14.226947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:14.226947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:14.226947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:14.226947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:14.226947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:14.226947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:14.226947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:14.226947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:14.226947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:14.227851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:14.227851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:14.227851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:14.227851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:14.227851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:14.227851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:14.227851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:14.227851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:14.227851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:14.227851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:14.227851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:14.227851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:14.227851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:14.227851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:14.227851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:14.227851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:14.229078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:14.229078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:14.229078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:14.229078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:14.229078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:14.229078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:14.229078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:14.229078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:14.229078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:14.229078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:14.229078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:51:14.229078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:14.229078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 202/404] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:51:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:14.229730 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f38ebd-a9c2-47b5-8189-f43c792caf2c None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:14.237631 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e414116-0c56-49b0-90fd-48a21f3a2572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:14.238543 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e414116-0c56-49b0-90fd-48a21f3a2572 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:14.239379 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e414116-0c56-49b0-90fd-48a21f3a2572 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:14.239703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e414116-0c56-49b0-90fd-48a21f3a2572 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:14.253179 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e414116-0c56-49b0-90fd-48a21f3a2572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:14.264907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-0e414116-0c56-49b0-90fd-48a21f3a2572 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:51:14.264907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:14.264907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:14.264907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:14.264907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:14.264907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:14.264907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:14.264907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:14.264907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:14.264907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:14.264907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:14.264907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:14.264907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:14.264907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:14.264907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:14.264907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:14.265944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:14.265944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:14.265944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:14.265944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:14.265944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:14.265944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:14.265944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:14.265944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:14.265944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:14.265944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:14.265944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:14.265944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:14.265944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:14.265944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:14.265944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:14.265944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:14.267002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:14.267002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:14.267002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:14.267002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:14.267002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:14.267002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:14.267002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:14.267002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:14.267002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:14.267002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:14.267002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:51:14.267002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:14.267002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 203/405] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 01:51:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:14.267758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e414116-0c56-49b0-90fd-48a21f3a2572 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:14.353860 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f38ebd-a9c2-47b5-8189-f43c792caf2c None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:14.363726 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:14.381198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e414116-0c56-49b0-90fd-48a21f3a2572 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:14.382648 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:14.398136 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b412e-bd11-4718-a84b-808cc1352676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:14.399258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b412e-bd11-4718-a84b-808cc1352676 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:14.399568 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b412e-bd11-4718-a84b-808cc1352676 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:14.399842 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b412e-bd11-4718-a84b-808cc1352676 None admin] PATH_INFO: `/v3/projects/95472ace4fc043ed86453b0002951eec` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:14.401198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b412e-bd11-4718-a84b-808cc1352676 None admin] RBAC: Authorizing `identity:get_project(project_id=95472ace4fc043ed86453b0002951eec)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:14.402976 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b412e-bd11-4718-a84b-808cc1352676 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:14.409131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 203/406] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:51:14 2022] GET /identity/v3/projects/95472ace4fc043ed86453b0002951eec => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:14.409131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b412e-bd11-4718-a84b-808cc1352676 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:14.428211 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711722b-5b22-4421-b1ed-04bd5458daf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:14.429256 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711722b-5b22-4421-b1ed-04bd5458daf8 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:14.429538 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711722b-5b22-4421-b1ed-04bd5458daf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:14.429811 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711722b-5b22-4421-b1ed-04bd5458daf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:14.430569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711722b-5b22-4421-b1ed-04bd5458daf8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:14.430874 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711722b-5b22-4421-b1ed-04bd5458daf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:14.432789 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711722b-5b22-4421-b1ed-04bd5458daf8 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:14.444554 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 204/407] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:14.445380 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711722b-5b22-4421-b1ed-04bd5458daf8 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:14.517340 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b412e-bd11-4718-a84b-808cc1352676 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:14.553967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244392d3-07f8-4335-b9b5-f57d4063b2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:14.555098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244392d3-07f8-4335-b9b5-f57d4063b2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:14.555698 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244392d3-07f8-4335-b9b5-f57d4063b2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:14.556196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244392d3-07f8-4335-b9b5-f57d4063b2c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:14.557278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244392d3-07f8-4335-b9b5-f57d4063b2c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:14.557844 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244392d3-07f8-4335-b9b5-f57d4063b2c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:14.559550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244392d3-07f8-4335-b9b5-f57d4063b2c0 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:14.564711 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711722b-5b22-4421-b1ed-04bd5458daf8 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:14.574282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 204/408] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:14.575637 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244392d3-07f8-4335-b9b5-f57d4063b2c0 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:14.605529 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c09b12-7ccd-4c16-af50-f267d5803eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:14.606357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c09b12-7ccd-4c16-af50-f267d5803eb8 None admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:14.606867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c09b12-7ccd-4c16-af50-f267d5803eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:14.607148 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c09b12-7ccd-4c16-af50-f267d5803eb8 None admin] PATH_INFO: `/v3/projects/95472ace4fc043ed86453b0002951eec/groups/c023f797837346d893755684392878df/roles/77aca4b95bbe47cbb528be2615112ac4` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:14.610127 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c09b12-7ccd-4c16-af50-f267d5803eb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=95472ace4fc043ed86453b0002951eec, group_id=c023f797837346d893755684392878df, role_id=77aca4b95bbe47cbb528be2615112ac4)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:14.611984 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c09b12-7ccd-4c16-af50-f267d5803eb8 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:14.628747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 205/409] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Jun 23 01:51:14 2022] PUT /identity/v3/projects/95472ace4fc043ed86453b0002951eec/groups/c023f797837346d893755684392878df/roles/77aca4b95bbe47cbb528be2615112ac4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:51:14.630107 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c09b12-7ccd-4c16-af50-f267d5803eb8 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:14.640830 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:14.643843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:14.717060 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244392d3-07f8-4335-b9b5-f57d4063b2c0 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:14.749637 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c09b12-7ccd-4c16-af50-f267d5803eb8 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:14.771247 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fa008-7e7e-4a82-8c60-96c1bb785261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:14.772548 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fa008-7e7e-4a82-8c60-96c1bb785261 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:14.773266 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fa008-7e7e-4a82-8c60-96c1bb785261 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:14.774524 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fa008-7e7e-4a82-8c60-96c1bb785261 None admin] PATH_INFO: `/v3/groups/73e96ed12fde43208df0bb87151b9a09` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:14.777425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066fa008-7e7e-4a82-8c60-96c1bb785261 None admin] RBAC: Authorizing `identity:get_group(group_id=73e96ed12fde43208df0bb87151b9a09)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:14.780811 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066fa008-7e7e-4a82-8c60-96c1bb785261 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:14.787542 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 205/410] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 01:51:14 2022] GET /identity/v3/groups/73e96ed12fde43208df0bb87151b9a09 => generated 229 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:14.790649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fa008-7e7e-4a82-8c60-96c1bb785261 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:14.821204 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c4d4b-d8e9-4c72-9697-bb6c4bb59e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:14.822885 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c4d4b-d8e9-4c72-9697-bb6c4bb59e6b None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:14.823433 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c4d4b-d8e9-4c72-9697-bb6c4bb59e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:14.824014 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c4d4b-d8e9-4c72-9697-bb6c4bb59e6b None admin] PATH_INFO: `/v3/groups/c023f797837346d893755684392878df` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:14.825716 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c4d4b-d8e9-4c72-9697-bb6c4bb59e6b None admin] RBAC: Authorizing `identity:get_group(group_id=c023f797837346d893755684392878df)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:14.828388 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c4d4b-d8e9-4c72-9697-bb6c4bb59e6b None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:14.832459 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 206/411] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 01:51:14 2022] GET /identity/v3/groups/c023f797837346d893755684392878df => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:14.836937 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c4d4b-d8e9-4c72-9697-bb6c4bb59e6b None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:14.944546 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:14.955813 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fa008-7e7e-4a82-8c60-96c1bb785261 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:14.972433 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c4d4b-d8e9-4c72-9697-bb6c4bb59e6b None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:14.981715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:15.002065 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8329632-457f-40b4-900d-ad1d92cc7f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:15.003202 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8329632-457f-40b4-900d-ad1d92cc7f12 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:15.003513 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8329632-457f-40b4-900d-ad1d92cc7f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:15.003792 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8329632-457f-40b4-900d-ad1d92cc7f12 None admin] PATH_INFO: `/v3/projects/3c1562009fe043679c20e065b5b0b463` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:15.006003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8329632-457f-40b4-900d-ad1d92cc7f12 None admin] RBAC: Authorizing `identity:get_project(project_id=3c1562009fe043679c20e065b5b0b463)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:15.007898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8329632-457f-40b4-900d-ad1d92cc7f12 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:15.010138 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 206/412] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:51:14 2022] GET /identity/v3/projects/3c1562009fe043679c20e065b5b0b463 => generated 344 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:15.011023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648bba5-57ed-469b-8b45-692ca6ea0435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:15.011447 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3742e65-8435-4df2-9c69-70d530061eaa None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:15.011736 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3742e65-8435-4df2-9c69-70d530061eaa None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:15.012011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3742e65-8435-4df2-9c69-70d530061eaa None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:15.012783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648bba5-57ed-469b-8b45-692ca6ea0435 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:15.013246 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 207/413] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:15.013487 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648bba5-57ed-469b-8b45-692ca6ea0435 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:15.013951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648bba5-57ed-469b-8b45-692ca6ea0435 None admin] PATH_INFO: `/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:15.015447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648bba5-57ed-469b-8b45-692ca6ea0435 None admin] RBAC: Authorizing `identity:get_project(project_id=e3059ec0bd6649c8bd24c1e0a5b48c39)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:15.017351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648bba5-57ed-469b-8b45-692ca6ea0435 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:15.017957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3742e65-8435-4df2-9c69-70d530061eaa None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:15.019889 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 207/414] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:51:14 2022] GET /identity/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:51:15.021479 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdf8f4-8b94-4e38-8ac6-6dc4539c816f None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:15.021996 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdf8f4-8b94-4e38-8ac6-6dc4539c816f None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:15.022363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdf8f4-8b94-4e38-8ac6-6dc4539c816f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:15.039534 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-07cdf8f4-8b94-4e38-8ac6-6dc4539c816f None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:15.040898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-07cdf8f4-8b94-4e38-8ac6-6dc4539c816f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:15.123436 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 208/415] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:15.123436 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdf8f4-8b94-4e38-8ac6-6dc4539c816f None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:15.174929 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3742e65-8435-4df2-9c69-70d530061eaa None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:15.205424 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:15.224490 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a0e5d-d07a-4799-8956-6afd971deef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:15.226268 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a0e5d-d07a-4799-8956-6afd971deef5 None admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:15.226764 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a0e5d-d07a-4799-8956-6afd971deef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:15.227533 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a0e5d-d07a-4799-8956-6afd971deef5 None admin] PATH_INFO: `/v3/projects/3c1562009fe043679c20e065b5b0b463/groups/73e96ed12fde43208df0bb87151b9a09/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:15.230698 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a0e5d-d07a-4799-8956-6afd971deef5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c1562009fe043679c20e065b5b0b463, group_id=73e96ed12fde43208df0bb87151b9a09, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:15.233068 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a0e5d-d07a-4799-8956-6afd971deef5 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:15.239719 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdf8f4-8b94-4e38-8ac6-6dc4539c816f None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:15.252695 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 208/416] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Jun 23 01:51:15 2022] PUT /identity/v3/projects/3c1562009fe043679c20e065b5b0b463/groups/73e96ed12fde43208df0bb87151b9a09/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:51:15.254675 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a0e5d-d07a-4799-8956-6afd971deef5 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:15.280871 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c7148-b19f-4fa1-a3dc-a86f1fb502b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:15.281788 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c7148-b19f-4fa1-a3dc-a86f1fb502b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:15.282129 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c7148-b19f-4fa1-a3dc-a86f1fb502b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:15.282403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c7148-b19f-4fa1-a3dc-a86f1fb502b1 None admin] PATH_INFO: `/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39/groups/c023f797837346d893755684392878df/roles/77aca4b95bbe47cbb528be2615112ac4` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:15.284988 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c7148-b19f-4fa1-a3dc-a86f1fb502b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3059ec0bd6649c8bd24c1e0a5b48c39, group_id=c023f797837346d893755684392878df, role_id=77aca4b95bbe47cbb528be2615112ac4)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:15.286587 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c7148-b19f-4fa1-a3dc-a86f1fb502b1 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:15.314209 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 209/417] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Jun 23 01:51:15 2022] PUT /identity/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39/groups/c023f797837346d893755684392878df/roles/77aca4b95bbe47cbb528be2615112ac4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:51:15.327288 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:15.385225 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a0e5d-d07a-4799-8956-6afd971deef5 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:15.426608 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e62683-32e8-4e94-962c-586d52a96cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:15.427838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e62683-32e8-4e94-962c-586d52a96cca None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:15.428366 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e62683-32e8-4e94-962c-586d52a96cca None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:15.428833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e62683-32e8-4e94-962c-586d52a96cca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:15.442590 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e62683-32e8-4e94-962c-586d52a96cca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:15.451149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-e0e62683-32e8-4e94-962c-586d52a96cca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:51:15.451149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:15.451149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:15.451149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:15.451149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:15.451149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:15.451149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:15.451149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:15.451149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:15.451149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:15.451149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:15.451149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:15.451149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:15.451149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:15.451149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:15.451149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:15.452169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:15.452169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:15.452169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:15.452169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:15.452169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:15.452169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:15.452169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:15.452169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:15.452169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:15.452169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:15.452169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:15.452169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:15.452169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:15.452169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:15.452169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:15.452169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:15.452958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:15.452958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:15.452958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:15.452958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:15.452958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:15.452958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:15.452958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:15.452958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:15.452958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:15.452958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:15.452958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:51:15.452958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:15.455948 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 209/418] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:15.462595 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c7148-b19f-4fa1-a3dc-a86f1fb502b1 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:15.578501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c7148-b19f-4fa1-a3dc-a86f1fb502b1 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:15.611747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:15.618838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f23331-e2bb-485f-8d3d-07250527e075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:15.619603 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f23331-e2bb-485f-8d3d-07250527e075 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:15.619898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f23331-e2bb-485f-8d3d-07250527e075 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:15.620210 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f23331-e2bb-485f-8d3d-07250527e075 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:15.621110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f23331-e2bb-485f-8d3d-07250527e075 None admin] RBAC: Adding query filter params (name=member) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:15.621425 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f23331-e2bb-485f-8d3d-07250527e075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:15.622970 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f23331-e2bb-485f-8d3d-07250527e075 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:15.635427 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 210/419] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:51:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:15.641211 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e62683-32e8-4e94-962c-586d52a96cca None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:15.756708 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e62683-32e8-4e94-962c-586d52a96cca None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:15.767753 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:15.792572 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c0a5d-4c63-463a-a0e4-09f8927d0877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:15.793242 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c0a5d-4c63-463a-a0e4-09f8927d0877 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:15.793528 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c0a5d-4c63-463a-a0e4-09f8927d0877 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:15.793812 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c0a5d-4c63-463a-a0e4-09f8927d0877 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:15.864442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c0a5d-4c63-463a-a0e4-09f8927d0877 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:15.865815 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c0a5d-4c63-463a-a0e4-09f8927d0877 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:15.968327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 210/420] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:51:15.974055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f23331-e2bb-485f-8d3d-07250527e075 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:16.111663 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f23331-e2bb-485f-8d3d-07250527e075 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:16.161552 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de53533-7bf5-4ba1-b0e5-82ee2c58291f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:16.162453 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de53533-7bf5-4ba1-b0e5-82ee2c58291f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:16.162738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de53533-7bf5-4ba1-b0e5-82ee2c58291f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:16.163018 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de53533-7bf5-4ba1-b0e5-82ee2c58291f None admin] PATH_INFO: `/v3/projects/95472ace4fc043ed86453b0002951eec` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:16.164262 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de53533-7bf5-4ba1-b0e5-82ee2c58291f None admin] RBAC: Authorizing `identity:get_project(project_id=95472ace4fc043ed86453b0002951eec)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:16.165725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de53533-7bf5-4ba1-b0e5-82ee2c58291f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:16.167802 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 211/421] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:51:15 2022] GET /identity/v3/projects/95472ace4fc043ed86453b0002951eec => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:16.173512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c0a5d-4c63-463a-a0e4-09f8927d0877 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:16.199775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:16.277867 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c0a5d-4c63-463a-a0e4-09f8927d0877 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:16.313347 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3ddce-9f5b-4608-98cf-a84c53f998c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:16.314229 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3ddce-9f5b-4608-98cf-a84c53f998c4 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:16.314509 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3ddce-9f5b-4608-98cf-a84c53f998c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:16.314783 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3ddce-9f5b-4608-98cf-a84c53f998c4 None admin] PATH_INFO: `/v3/groups/c023f797837346d893755684392878df` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:16.316009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3ddce-9f5b-4608-98cf-a84c53f998c4 None admin] RBAC: Authorizing `identity:get_group(group_id=c023f797837346d893755684392878df)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:16.317743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3ddce-9f5b-4608-98cf-a84c53f998c4 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:16.319697 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 211/422] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 01:51:16 2022] GET /identity/v3/groups/c023f797837346d893755684392878df => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:16.328574 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de53533-7bf5-4ba1-b0e5-82ee2c58291f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:16.421716 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:16.441304 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323ff57-95e5-409a-a179-c3a5b883fdb1 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:16.441670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323ff57-95e5-409a-a179-c3a5b883fdb1 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:16.441942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323ff57-95e5-409a-a179-c3a5b883fdb1 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:16.443704 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 212/423] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:16.448937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e87cf8-7549-490b-94bd-d44227097287 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:16.449230 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e87cf8-7549-490b-94bd-d44227097287 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:16.449513 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e87cf8-7549-490b-94bd-d44227097287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:16.466023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de53533-7bf5-4ba1-b0e5-82ee2c58291f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:16.484173 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-77e87cf8-7549-490b-94bd-d44227097287 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:16.485384 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-77e87cf8-7549-490b-94bd-d44227097287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:16.500855 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcd145-562b-44c9-a965-950a74cc846f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:16.501881 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcd145-562b-44c9-a965-950a74cc846f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:16.502412 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcd145-562b-44c9-a965-950a74cc846f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:16.502894 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcd145-562b-44c9-a965-950a74cc846f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:16.504583 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efcd145-562b-44c9-a965-950a74cc846f None admin] RBAC: Adding query filter params (group.id=c023f797837346d893755684392878df, role.id=51b1227b19794e6fb73ae32c4d0165fb, scope.project.id=95472ace4fc043ed86453b0002951eec) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:16.505246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efcd145-562b-44c9-a965-950a74cc846f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:16.506901 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efcd145-562b-44c9-a965-950a74cc846f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:16.514854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 212/424] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 23 01:51:16 2022] GET /identity/v3/role_assignments?group.id=c023f797837346d893755684392878df&scope.project.id=95472ace4fc043ed86453b0002951eec&role.id=51b1227b19794e6fb73ae32c4d0165fb => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:16.661584 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 213/425] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:51:16.687012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcd145-562b-44c9-a965-950a74cc846f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:16.801402 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcd145-562b-44c9-a965-950a74cc846f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:16.831500 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:16.846607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824f38c-636d-4517-81f9-c9922c6d60a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:16.847959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824f38c-636d-4517-81f9-c9922c6d60a0 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:16.848464 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824f38c-636d-4517-81f9-c9922c6d60a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:16.848962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824f38c-636d-4517-81f9-c9922c6d60a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:16.861984 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824f38c-636d-4517-81f9-c9922c6d60a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:16.870343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-9824f38c-636d-4517-81f9-c9922c6d60a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:51:16.870343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:16.870343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:16.870343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:16.870343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:16.870343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:16.870343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:16.870343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:16.870343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:16.870343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:16.870343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:16.870343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:16.870343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:16.870343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:16.870343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:16.870343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:16.871251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:16.871251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:16.871251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:16.871251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:16.871251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:16.871251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:16.871251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:16.871251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:16.871251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:16.871251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:16.871251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:16.871251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:16.871251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:16.871251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:16.871251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:16.871251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:16.872105 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:16.872105 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:16.872105 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:16.872105 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:16.872105 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:16.872105 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:16.872105 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:16.872105 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:16.872105 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:16.872105 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:16.872105 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 01:51:16.872105 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:16.874797 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 213/426] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:16.880503 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e87cf8-7549-490b-94bd-d44227097287 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:16.889228 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:16.997625 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e87cf8-7549-490b-94bd-d44227097287 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:17.026557 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209e721-c172-4920-91b8-1473f9d696a5 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:17.027093 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209e721-c172-4920-91b8-1473f9d696a5 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:17.027093 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209e721-c172-4920-91b8-1473f9d696a5 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:17.030533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 214/427] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:51:17.034339 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61f15a-b7f0-4632-bacb-1df10093d129 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:17.034616 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61f15a-b7f0-4632-bacb-1df10093d129 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:17.034886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61f15a-b7f0-4632-bacb-1df10093d129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:17.044244 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120118b-2025-4e89-95d3-43e953471567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:17.044933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120118b-2025-4e89-95d3-43e953471567 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:17.045217 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120118b-2025-4e89-95d3-43e953471567 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:17.045493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120118b-2025-4e89-95d3-43e953471567 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:17.046249 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120118b-2025-4e89-95d3-43e953471567 None admin] RBAC: Adding query filter params (name=member) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:17.046561 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120118b-2025-4e89-95d3-43e953471567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:17.050649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120118b-2025-4e89-95d3-43e953471567 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:17.056032 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-9c61f15a-b7f0-4632-bacb-1df10093d129 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:17.057924 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-9c61f15a-b7f0-4632-bacb-1df10093d129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:17.061646 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 214/428] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:51:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:17.067301 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120118b-2025-4e89-95d3-43e953471567 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:17.143218 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 215/429] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:51:17.149625 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:17.181217 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120118b-2025-4e89-95d3-43e953471567 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:17.182851 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61f15a-b7f0-4632-bacb-1df10093d129 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:17.231361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaabb04-35b1-4c99-9e13-30ecc0dd09e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:17.232063 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaabb04-35b1-4c99-9e13-30ecc0dd09e0 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:17.232317 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaabb04-35b1-4c99-9e13-30ecc0dd09e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:17.232589 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaabb04-35b1-4c99-9e13-30ecc0dd09e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:17.331648 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaabb04-35b1-4c99-9e13-30ecc0dd09e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:17.333998 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaabb04-35b1-4c99-9e13-30ecc0dd09e0 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:17.348870 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61f15a-b7f0-4632-bacb-1df10093d129 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:17.371828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:17.400291 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20423c-86d9-44f9-80f4-7ba111e9a399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:17.401486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20423c-86d9-44f9-80f4-7ba111e9a399 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:17.401962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20423c-86d9-44f9-80f4-7ba111e9a399 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:17.402413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20423c-86d9-44f9-80f4-7ba111e9a399 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:17.416313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20423c-86d9-44f9-80f4-7ba111e9a399 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:17.424819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-5a20423c-86d9-44f9-80f4-7ba111e9a399 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:51:17.424819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:17.424819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:17.424819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:17.424819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:17.424819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:17.424819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:17.424819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:17.424819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:17.424819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:17.424819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:17.424819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:17.424819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:17.424819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:17.424819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:17.424819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:17.425700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:17.425700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:17.425700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:17.425700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:17.425700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:17.425700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:17.425700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:17.425700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:17.425700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:17.425700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:17.425700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:17.425700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:17.425700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:17.425700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:17.425700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:17.425700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:17.426588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:17.426588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:17.426588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:17.426588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:17.426588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:17.426588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:17.426588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:17.426588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:17.426588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:17.426588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:17.426588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:51:17.426588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:17.433884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 216/430] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 01:51:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:51:17.435371 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20423c-86d9-44f9-80f4-7ba111e9a399 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:17.447833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:17.467367 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 215/431] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 01:51:17.475731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaabb04-35b1-4c99-9e13-30ecc0dd09e0 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:17.546559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20423c-86d9-44f9-80f4-7ba111e9a399 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:17.581021 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaabb04-35b1-4c99-9e13-30ecc0dd09e0 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:17.583074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec3bb1-9d9c-41b7-b5a9-d6499f81f708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:17.583930 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec3bb1-9d9c-41b7-b5a9-d6499f81f708 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:17.584287 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec3bb1-9d9c-41b7-b5a9-d6499f81f708 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:17.584665 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec3bb1-9d9c-41b7-b5a9-d6499f81f708 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:17.585610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec3bb1-9d9c-41b7-b5a9-d6499f81f708 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:17.585913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec3bb1-9d9c-41b7-b5a9-d6499f81f708 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:17.587390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec3bb1-9d9c-41b7-b5a9-d6499f81f708 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:17.601286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 217/432] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:51:17.604748 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec3bb1-9d9c-41b7-b5a9-d6499f81f708 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:17.624964 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e6e23-6cee-480a-8cd5-28120c41e51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:17.626153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e6e23-6cee-480a-8cd5-28120c41e51e None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:17.626571 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e6e23-6cee-480a-8cd5-28120c41e51e None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:17.626980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e6e23-6cee-480a-8cd5-28120c41e51e None admin] PATH_INFO: `/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:17.628351 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e6e23-6cee-480a-8cd5-28120c41e51e None admin] RBAC: Authorizing `identity:get_project(project_id=e3059ec0bd6649c8bd24c1e0a5b48c39)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:17.630122 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e6e23-6cee-480a-8cd5-28120c41e51e None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:17.632426 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 216/433] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:51:17 2022] GET /identity/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:17.637698 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e6e23-6cee-480a-8cd5-28120c41e51e None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:17.655681 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:17.679143 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:17.719384 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec3bb1-9d9c-41b7-b5a9-d6499f81f708 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:17.753550 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6873dc-16f1-4447-9313-bd9497a8ac1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:17.754277 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6873dc-16f1-4447-9313-bd9497a8ac1d None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:17.754557 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6873dc-16f1-4447-9313-bd9497a8ac1d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:17.754977 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6873dc-16f1-4447-9313-bd9497a8ac1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:17.755905 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e6e23-6cee-480a-8cd5-28120c41e51e None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:17.796020 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd688b-7872-4b3e-9832-21d738b726d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:17.797351 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd688b-7872-4b3e-9832-21d738b726d1 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:17.798037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd688b-7872-4b3e-9832-21d738b726d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:17.798412 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd688b-7872-4b3e-9832-21d738b726d1 None admin] PATH_INFO: `/v3/groups/c023f797837346d893755684392878df` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:17.799803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd688b-7872-4b3e-9832-21d738b726d1 None admin] RBAC: Authorizing `identity:get_group(group_id=c023f797837346d893755684392878df)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:17.802240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd688b-7872-4b3e-9832-21d738b726d1 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:17.807705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 217/434] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 01:51:17 2022] GET /identity/v3/groups/c023f797837346d893755684392878df => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:51:17.808903 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84557aed-76c9-4197-9039-dc2d6388bc65 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:17.809323 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84557aed-76c9-4197-9039-dc2d6388bc65 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:17.809539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84557aed-76c9-4197-9039-dc2d6388bc65 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:17.811262 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 218/435] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:17.811905 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84557aed-76c9-4197-9039-dc2d6388bc65 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:17.834484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6873dc-16f1-4447-9313-bd9497a8ac1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:17.835970 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6873dc-16f1-4447-9313-bd9497a8ac1d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:17.874867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:17.923748 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84557aed-76c9-4197-9039-dc2d6388bc65 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:17.932177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:17.946690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 218/436] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 01:51:17.948848 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d02c9-f4cb-4035-b0f6-38efb03df003 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:17.949208 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d02c9-f4cb-4035-b0f6-38efb03df003 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:17.949491 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d02c9-f4cb-4035-b0f6-38efb03df003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:17.959777 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c5718-bd5d-458a-9041-e0718fc612af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:17.960444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c5718-bd5d-458a-9041-e0718fc612af None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:17.960726 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c5718-bd5d-458a-9041-e0718fc612af None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:17.960997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c5718-bd5d-458a-9041-e0718fc612af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:17.961860 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c5718-bd5d-458a-9041-e0718fc612af None admin] RBAC: Adding query filter params (group.id=c023f797837346d893755684392878df, role.id=51b1227b19794e6fb73ae32c4d0165fb, scope.project.id=e3059ec0bd6649c8bd24c1e0a5b48c39) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:17.962169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c5718-bd5d-458a-9041-e0718fc612af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:17.963731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c5718-bd5d-458a-9041-e0718fc612af None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:17.965282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-fd2d02c9-f4cb-4035-b0f6-38efb03df003 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:17.966462 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-fd2d02c9-f4cb-4035-b0f6-38efb03df003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:17.970013 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 219/437] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 23 01:51:17 2022] GET /identity/v3/role_assignments?group.id=c023f797837346d893755684392878df&scope.project.id=e3059ec0bd6649c8bd24c1e0a5b48c39&role.id=51b1227b19794e6fb73ae32c4d0165fb => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:17.971240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b61e4-9199-4760-9165-960878c6a350 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:17.971554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b61e4-9199-4760-9165-960878c6a350 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:17.971830 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b61e4-9199-4760-9165-960878c6a350 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:17.973405 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 220/438] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:17.973946 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b61e4-9199-4760-9165-960878c6a350 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:18.055612 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 219/439] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:18.055612 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d1f53-50e0-4bb5-b120-77570e7c700d None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:18.055612 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d1f53-50e0-4bb5-b120-77570e7c700d None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:18.055612 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d1f53-50e0-4bb5-b120-77570e7c700d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:18.070431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-043d1f53-50e0-4bb5-b120-77570e7c700d None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:18.071892 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-043d1f53-50e0-4bb5-b120-77570e7c700d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:18.098125 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b61e4-9199-4760-9165-960878c6a350 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:18.141421 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:18.141989 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db4065-f6a3-4659-b41e-76e0432b8100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:18.142918 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db4065-f6a3-4659-b41e-76e0432b8100 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:18.143143 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db4065-f6a3-4659-b41e-76e0432b8100 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:18.143511 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db4065-f6a3-4659-b41e-76e0432b8100 None admin] PATH_INFO: `/v3/projects/95472ace4fc043ed86453b0002951eec` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:18.144926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db4065-f6a3-4659-b41e-76e0432b8100 None admin] RBAC: Authorizing `identity:get_project(project_id=95472ace4fc043ed86453b0002951eec)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:18.146396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db4065-f6a3-4659-b41e-76e0432b8100 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:18.151434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 221/440] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:51:17 2022] GET /identity/v3/projects/95472ace4fc043ed86453b0002951eec => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:18.151434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db4065-f6a3-4659-b41e-76e0432b8100 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:18.155091 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 220/441] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:18.155995 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d1f53-50e0-4bb5-b120-77570e7c700d None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:18.187073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:18.251857 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db4065-f6a3-4659-b41e-76e0432b8100 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:18.258176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d1f53-50e0-4bb5-b120-77570e7c700d None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:18.285317 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8159912-c0e4-4a86-a03d-e91e13267d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:18.286230 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8159912-c0e4-4a86-a03d-e91e13267d5d None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:18.286512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8159912-c0e4-4a86-a03d-e91e13267d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:18.286784 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8159912-c0e4-4a86-a03d-e91e13267d5d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:18.291618 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b759e-71ab-4611-9931-7e0473b66b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:18.292479 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b759e-71ab-4611-9931-7e0473b66b3c None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:18.292781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b759e-71ab-4611-9931-7e0473b66b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:18.293053 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b759e-71ab-4611-9931-7e0473b66b3c None admin] PATH_INFO: `/v3/groups/c023f797837346d893755684392878df` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:18.294208 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b759e-71ab-4611-9931-7e0473b66b3c None admin] RBAC: Authorizing `identity:get_group(group_id=c023f797837346d893755684392878df)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:18.295671 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b759e-71ab-4611-9931-7e0473b66b3c None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:18.296741 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8159912-c0e4-4a86-a03d-e91e13267d5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:18.297285 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 221/442] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 01:51:18 2022] GET /identity/v3/groups/c023f797837346d893755684392878df => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:18.298028 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b759e-71ab-4611-9931-7e0473b66b3c None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:18.304969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-a8159912-c0e4-4a86-a03d-e91e13267d5d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:51:18.304969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:18.304969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:18.304969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:18.304969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:18.304969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:18.304969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:18.304969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:18.304969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:18.304969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:18.304969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:18.304969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:18.304969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:18.304969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:18.304969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:18.304969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:18.306073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:18.306073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:18.306073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:18.306073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:18.306073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:18.306073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:18.306073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:18.306073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:18.306073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:18.306073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:18.306073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:18.306073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:18.306073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:18.306073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:18.306073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:18.306073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:18.306993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:18.306993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:18.306993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:18.306993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:18.306993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:18.306993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:18.306993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:18.306993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:18.306993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:18.306993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:18.306993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:51:18.306993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:18.306993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 222/443] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 01:51:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:18.307686 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8159912-c0e4-4a86-a03d-e91e13267d5d None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:18.370799 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:18.400957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:18.405829 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b759e-71ab-4611-9931-7e0473b66b3c None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:18.407043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8159912-c0e4-4a86-a03d-e91e13267d5d None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:18.439439 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4836b06-c4db-4829-9f2c-326186e9922f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:18.440258 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4836b06-c4db-4829-9f2c-326186e9922f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:18.440511 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4836b06-c4db-4829-9f2c-326186e9922f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:18.440781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4836b06-c4db-4829-9f2c-326186e9922f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:18.441739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda80c0a-6c04-423b-b5cc-af961be031ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:18.442425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda80c0a-6c04-423b-b5cc-af961be031ff None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:18.442701 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda80c0a-6c04-423b-b5cc-af961be031ff None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:18.442970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda80c0a-6c04-423b-b5cc-af961be031ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:18.443855 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda80c0a-6c04-423b-b5cc-af961be031ff None admin] RBAC: Adding query filter params (group.id=c023f797837346d893755684392878df, role.id=77aca4b95bbe47cbb528be2615112ac4, scope.project.id=95472ace4fc043ed86453b0002951eec) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:18.444165 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda80c0a-6c04-423b-b5cc-af961be031ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:18.445641 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda80c0a-6c04-423b-b5cc-af961be031ff None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:18.450821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4836b06-c4db-4829-9f2c-326186e9922f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:18.451866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 223/444] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 23 01:51:18 2022] GET /identity/v3/role_assignments?group.id=c023f797837346d893755684392878df&scope.project.id=95472ace4fc043ed86453b0002951eec&role.id=77aca4b95bbe47cbb528be2615112ac4 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:18.456059 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda80c0a-6c04-423b-b5cc-af961be031ff None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:18.458999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-e4836b06-c4db-4829-9f2c-326186e9922f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:51:18.458999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:18.458999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:18.458999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:18.458999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:18.458999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:18.458999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:18.458999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:18.458999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:18.458999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:18.458999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:18.458999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:18.458999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:18.458999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:18.458999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:18.458999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:18.460139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:18.460139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:18.460139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:18.460139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:18.460139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:18.460139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:18.460139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:18.460139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:18.460139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:18.460139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:18.460139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:18.460139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:18.460139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:18.460139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:18.460139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:18.460139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:18.460952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:18.460952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:18.460952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:18.460952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:18.460952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:18.460952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:18.460952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:18.460952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:18.460952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:18.460952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:18.460952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:51:18.460952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:18.460952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 222/445] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:51:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:18.466267 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4836b06-c4db-4829-9f2c-326186e9922f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:18.575306 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda80c0a-6c04-423b-b5cc-af961be031ff None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:18.580636 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4836b06-c4db-4829-9f2c-326186e9922f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:18.610618 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:18.614877 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c310f77-bf91-482a-ae78-79f7883dc6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:18.615606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c310f77-bf91-482a-ae78-79f7883dc6fc None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:18.615895 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c310f77-bf91-482a-ae78-79f7883dc6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:18.616170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c310f77-bf91-482a-ae78-79f7883dc6fc None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:18.617056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c310f77-bf91-482a-ae78-79f7883dc6fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:18.617424 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c310f77-bf91-482a-ae78-79f7883dc6fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:18.618881 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c310f77-bf91-482a-ae78-79f7883dc6fc None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:18.621504 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31f0bd-93e2-4fa9-8347-bfa43df0ab36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:18.622126 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31f0bd-93e2-4fa9-8347-bfa43df0ab36 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:18.622408 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31f0bd-93e2-4fa9-8347-bfa43df0ab36 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:18.622689 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31f0bd-93e2-4fa9-8347-bfa43df0ab36 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:18.623464 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31f0bd-93e2-4fa9-8347-bfa43df0ab36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:18.623776 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31f0bd-93e2-4fa9-8347-bfa43df0ab36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:18.625142 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31f0bd-93e2-4fa9-8347-bfa43df0ab36 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:18.631735 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 224/446] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:18.634112 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 223/447] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:51:18.637585 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c310f77-bf91-482a-ae78-79f7883dc6fc None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:18.639596 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31f0bd-93e2-4fa9-8347-bfa43df0ab36 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:18.666906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:18.760521 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c310f77-bf91-482a-ae78-79f7883dc6fc None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:18.764574 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31f0bd-93e2-4fa9-8347-bfa43df0ab36 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:18.800263 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb52428-7595-4ba7-8ba1-2b885abd544b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:18.800982 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb52428-7595-4ba7-8ba1-2b885abd544b None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:18.801309 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb52428-7595-4ba7-8ba1-2b885abd544b None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:18.801681 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb52428-7595-4ba7-8ba1-2b885abd544b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:18.803165 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac16ced-040e-4ac1-8a8e-7c77028e3639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:18.803860 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac16ced-040e-4ac1-8a8e-7c77028e3639 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:18.804154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac16ced-040e-4ac1-8a8e-7c77028e3639 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:18.804436 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac16ced-040e-4ac1-8a8e-7c77028e3639 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:18.872607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:18.885874 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac16ced-040e-4ac1-8a8e-7c77028e3639 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:18.887810 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac16ced-040e-4ac1-8a8e-7c77028e3639 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:18.892158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb52428-7595-4ba7-8ba1-2b885abd544b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:18.893637 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb52428-7595-4ba7-8ba1-2b885abd544b None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:18.920019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:19.004811 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 224/448] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:51:19.007239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 225/449] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 01:51:19.010516 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac16ced-040e-4ac1-8a8e-7c77028e3639 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:19.012698 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb52428-7595-4ba7-8ba1-2b885abd544b None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:19.094545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:19.107392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac16ced-040e-4ac1-8a8e-7c77028e3639 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:19.108573 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb52428-7595-4ba7-8ba1-2b885abd544b None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:19.131639 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:19.141862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98054aa-dde1-4387-8c1d-c9e6fb22c4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:19.142742 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98054aa-dde1-4387-8c1d-c9e6fb22c4ec None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:19.143022 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98054aa-dde1-4387-8c1d-c9e6fb22c4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:19.143112 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe98a54-06d8-49a1-8468-cd588cdf2e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:19.143298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98054aa-dde1-4387-8c1d-c9e6fb22c4ec None admin] PATH_INFO: `/v3/projects/3c1562009fe043679c20e065b5b0b463` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:19.143927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe98a54-06d8-49a1-8468-cd588cdf2e8b None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:19.144206 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe98a54-06d8-49a1-8468-cd588cdf2e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:19.144476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe98a54-06d8-49a1-8468-cd588cdf2e8b None admin] PATH_INFO: `/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:19.144602 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98054aa-dde1-4387-8c1d-c9e6fb22c4ec None admin] RBAC: Authorizing `identity:get_project(project_id=3c1562009fe043679c20e065b5b0b463)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:19.145678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe98a54-06d8-49a1-8468-cd588cdf2e8b None admin] RBAC: Authorizing `identity:get_project(project_id=e3059ec0bd6649c8bd24c1e0a5b48c39)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:19.145953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98054aa-dde1-4387-8c1d-c9e6fb22c4ec None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:19.147107 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe98a54-06d8-49a1-8468-cd588cdf2e8b None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:19.147693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 225/450] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:51:19 2022] GET /identity/v3/projects/3c1562009fe043679c20e065b5b0b463 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:51:19.153130 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 226/451] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:51:19 2022] GET /identity/v3/projects/e3059ec0bd6649c8bd24c1e0a5b48c39 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:19.153257 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98054aa-dde1-4387-8c1d-c9e6fb22c4ec None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:19.153968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe98a54-06d8-49a1-8468-cd588cdf2e8b None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:19.251314 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98054aa-dde1-4387-8c1d-c9e6fb22c4ec None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:19.251924 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe98a54-06d8-49a1-8468-cd588cdf2e8b None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:19.286277 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55479c77-5ce4-4204-939e-416a6926b90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:19.286469 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c0ad9-5138-4723-b89a-8fdabc2d32b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:19.287139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55479c77-5ce4-4204-939e-416a6926b90e None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:19.287232 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c0ad9-5138-4723-b89a-8fdabc2d32b0 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:19.287448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55479c77-5ce4-4204-939e-416a6926b90e None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:19.287551 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c0ad9-5138-4723-b89a-8fdabc2d32b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:19.287727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55479c77-5ce4-4204-939e-416a6926b90e None admin] PATH_INFO: `/v3/groups/73e96ed12fde43208df0bb87151b9a09` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:19.287824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c0ad9-5138-4723-b89a-8fdabc2d32b0 None admin] PATH_INFO: `/v3/groups/c023f797837346d893755684392878df` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:19.288910 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c0ad9-5138-4723-b89a-8fdabc2d32b0 None admin] RBAC: Authorizing `identity:get_group(group_id=c023f797837346d893755684392878df)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:19.289003 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55479c77-5ce4-4204-939e-416a6926b90e None admin] RBAC: Authorizing `identity:get_group(group_id=73e96ed12fde43208df0bb87151b9a09)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:19.290369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55479c77-5ce4-4204-939e-416a6926b90e None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:19.290453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c0ad9-5138-4723-b89a-8fdabc2d32b0 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:19.292234 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 227/453] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 01:51:19 2022] GET /identity/v3/groups/c023f797837346d893755684392878df => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:19.292337 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 226/453] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 23 01:51:19 2022] GET /identity/v3/groups/73e96ed12fde43208df0bb87151b9a09 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:19.297724 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c0ad9-5138-4723-b89a-8fdabc2d32b0 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:19.301095 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55479c77-5ce4-4204-939e-416a6926b90e None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:19.326071 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:19.358421 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:19.398909 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55479c77-5ce4-4204-939e-416a6926b90e None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:19.400097 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c0ad9-5138-4723-b89a-8fdabc2d32b0 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:19.434625 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da569b9-e249-421d-a6f0-651ba7dd1eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:19.435007 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09e4ff-c6f4-4272-9aba-9b98d687d60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:19.435267 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da569b9-e249-421d-a6f0-651ba7dd1eaa None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:19.435582 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da569b9-e249-421d-a6f0-651ba7dd1eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:19.435674 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09e4ff-c6f4-4272-9aba-9b98d687d60e None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:19.436169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da569b9-e249-421d-a6f0-651ba7dd1eaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:19.436261 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09e4ff-c6f4-4272-9aba-9b98d687d60e None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:19.436547 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09e4ff-c6f4-4272-9aba-9b98d687d60e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:19.436991 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da569b9-e249-421d-a6f0-651ba7dd1eaa None admin] RBAC: Adding query filter params (group.id=c023f797837346d893755684392878df, role.id=77aca4b95bbe47cbb528be2615112ac4, scope.project.id=e3059ec0bd6649c8bd24c1e0a5b48c39) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:19.437301 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da569b9-e249-421d-a6f0-651ba7dd1eaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:19.437387 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b09e4ff-c6f4-4272-9aba-9b98d687d60e None admin] RBAC: Adding query filter params (group.id=73e96ed12fde43208df0bb87151b9a09, role.id=58e04437159e4eb39aa4a43c213ea34c, scope.project.id=3c1562009fe043679c20e065b5b0b463) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:19.437682 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b09e4ff-c6f4-4272-9aba-9b98d687d60e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:19.438752 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da569b9-e249-421d-a6f0-651ba7dd1eaa None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:19.439099 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b09e4ff-c6f4-4272-9aba-9b98d687d60e None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:19.444668 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 228/454] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 23 01:51:19 2022] GET /identity/v3/role_assignments?group.id=c023f797837346d893755684392878df&scope.project.id=e3059ec0bd6649c8bd24c1e0a5b48c39&role.id=77aca4b95bbe47cbb528be2615112ac4 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:19.445090 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 227/455] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 23 01:51:19 2022] GET /identity/v3/role_assignments?group.id=73e96ed12fde43208df0bb87151b9a09&scope.project.id=3c1562009fe043679c20e065b5b0b463&role.id=58e04437159e4eb39aa4a43c213ea34c => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:21.979804 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3dd946-0513-4f3e-ba81-66ff0208a679 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:21.980321 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3dd946-0513-4f3e-ba81-66ff0208a679 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:21.980582 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3dd946-0513-4f3e-ba81-66ff0208a679 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:21.982439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 229/456] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:21.987596 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa16d8-c547-4f9e-89cf-b6e49dcd279f None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:21.988027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa16d8-c547-4f9e-89cf-b6e49dcd279f None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:21.988150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa16d8-c547-4f9e-89cf-b6e49dcd279f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:22.017044 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-8daa16d8-c547-4f9e-89cf-b6e49dcd279f None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:22.018498 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-8daa16d8-c547-4f9e-89cf-b6e49dcd279f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:22.110006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 228/457] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:22.149978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3dd946-0513-4f3e-ba81-66ff0208a679 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:22.309054 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3dd946-0513-4f3e-ba81-66ff0208a679 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:22.338224 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:22.352188 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58c77e-992e-4ea9-8e34-1633968f41b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:22.353017 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58c77e-992e-4ea9-8e34-1633968f41b0 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:22.353306 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58c77e-992e-4ea9-8e34-1633968f41b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:22.353587 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58c77e-992e-4ea9-8e34-1633968f41b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:22.367189 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58c77e-992e-4ea9-8e34-1633968f41b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:22.368700 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58c77e-992e-4ea9-8e34-1633968f41b0 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:22.393037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-0b58c77e-992e-4ea9-8e34-1633968f41b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:22.393037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:22.393037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:22.393037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:22.393037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:22.393037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:22.393037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:22.393037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:22.393037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:22.393037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:22.393037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:22.393037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:22.393037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:22.393037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:22.393037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:22.393967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:22.393967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:22.393967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:22.393967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:22.393967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:22.393967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:22.393967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:22.393967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:22.393967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:22.393967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:22.393967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:22.393967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:22.393967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:22.393967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:22.393967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:22.393967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:22.393967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:22.395160 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:22.395160 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:22.395160 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:22.395160 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:22.395160 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 230/458] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:22.401278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa16d8-c547-4f9e-89cf-b6e49dcd279f None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:22.425670 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:22.429485 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89104b3-2b68-4d62-a3b2-c0f31fd7aa32 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:22.429774 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89104b3-2b68-4d62-a3b2-c0f31fd7aa32 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:22.430057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89104b3-2b68-4d62-a3b2-c0f31fd7aa32 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:22.431723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 231/459] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:22.437249 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be354a35-ff41-4e2a-b276-04689f8b5fb8 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:22.437701 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be354a35-ff41-4e2a-b276-04689f8b5fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:22.438144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be354a35-ff41-4e2a-b276-04689f8b5fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:22.457367 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-be354a35-ff41-4e2a-b276-04689f8b5fb8 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:22.459053 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-be354a35-ff41-4e2a-b276-04689f8b5fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:22.550339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 232/460] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:22.552260 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8e42d-0c61-4eda-9b62-f3a7c5984ed3 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:22.552861 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8e42d-0c61-4eda-9b62-f3a7c5984ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:22.553271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8e42d-0c61-4eda-9b62-f3a7c5984ed3 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:22.558764 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 233/461] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:22.560379 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa16d8-c547-4f9e-89cf-b6e49dcd279f None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:22.561086 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab2cbd-ef65-4726-acdd-4141cf331af9 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:22.561518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab2cbd-ef65-4726-acdd-4141cf331af9 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:22.561927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab2cbd-ef65-4726-acdd-4141cf331af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:22.579363 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-53ab2cbd-ef65-4726-acdd-4141cf331af9 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:22.582237 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-53ab2cbd-ef65-4726-acdd-4141cf331af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:22.610889 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b92aca-f1da-4432-87f3-bf340829c79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:22.611875 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b92aca-f1da-4432-87f3-bf340829c79c None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:22.612293 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b92aca-f1da-4432-87f3-bf340829c79c None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:22.612702 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b92aca-f1da-4432-87f3-bf340829c79c None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:22.613611 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b92aca-f1da-4432-87f3-bf340829c79c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:22.614066 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b92aca-f1da-4432-87f3-bf340829c79c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:22.615603 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b92aca-f1da-4432-87f3-bf340829c79c None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:22.632563 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 229/462] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:22.633680 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b92aca-f1da-4432-87f3-bf340829c79c None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:22.678451 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 234/463] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:51:22.678451 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab2cbd-ef65-4726-acdd-4141cf331af9 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:22.716552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:22.730939 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:22.754679 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b92aca-f1da-4432-87f3-bf340829c79c None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:22.787902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fa7e3-7e58-4b4d-b16a-5a410f34c119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:22.788704 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fa7e3-7e58-4b4d-b16a-5a410f34c119 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:22.788981 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fa7e3-7e58-4b4d-b16a-5a410f34c119 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:22.789260 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fa7e3-7e58-4b4d-b16a-5a410f34c119 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:22.791323 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab2cbd-ef65-4726-acdd-4141cf331af9 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:22.799756 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fa7e3-7e58-4b4d-b16a-5a410f34c119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:22.801301 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fa7e3-7e58-4b4d-b16a-5a410f34c119 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:22.818393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-030fa7e3-7e58-4b4d-b16a-5a410f34c119 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:22.818393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:22.818393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:22.818393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:22.818393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:22.818393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:22.818393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:22.818393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:22.818393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:22.818393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:22.818393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:22.818393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:22.818393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:22.818393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:22.818393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:22.819221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:22.819221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:22.819221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:22.819221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:22.819221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:22.819221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:22.819221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:22.819221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:22.819221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:22.819221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:22.819221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:22.819221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:22.819221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:22.819221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:22.819221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:22.819221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:22.819221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:22.820177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:22.820177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:22.820177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:22.820177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:22.820177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 230/464] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:22.820835 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158345e-1980-488c-86e8-a12b5bb37ed1 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:22.821073 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158345e-1980-488c-86e8-a12b5bb37ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:22.821351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158345e-1980-488c-86e8-a12b5bb37ed1 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:22.826848 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 231/465] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:22.826848 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158345e-1980-488c-86e8-a12b5bb37ed1 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:22.836397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab959a-8368-440e-ad93-fb239d5d074d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:22.837089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab959a-8368-440e-ad93-fb239d5d074d None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:22.837373 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab959a-8368-440e-ad93-fb239d5d074d None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:22.837698 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab959a-8368-440e-ad93-fb239d5d074d None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:22.838710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab959a-8368-440e-ad93-fb239d5d074d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:22.840566 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab959a-8368-440e-ad93-fb239d5d074d None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:22.862285 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 235/466] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 01:51:22 2022] POST /identity/v3/users => generated 246 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:51:22.862285 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab959a-8368-440e-ad93-fb239d5d074d None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:22.961249 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158345e-1980-488c-86e8-a12b5bb37ed1 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:22.988261 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:22.999453 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:23.004361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab959a-8368-440e-ad93-fb239d5d074d None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:23.012177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e35b8-704b-419b-bab2-3c5204abe8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:23.013517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e35b8-704b-419b-bab2-3c5204abe8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:23.014017 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e35b8-704b-419b-bab2-3c5204abe8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:23.014485 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e35b8-704b-419b-bab2-3c5204abe8b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:23.027015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e35b8-704b-419b-bab2-3c5204abe8b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:23.029141 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e35b8-704b-419b-bab2-3c5204abe8b8 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:23.042770 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac78cc-d7ff-47eb-a99f-31d5e735eb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:23.043531 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac78cc-d7ff-47eb-a99f-31d5e735eb7a None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:23.043831 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac78cc-d7ff-47eb-a99f-31d5e735eb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:23.044110 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac78cc-d7ff-47eb-a99f-31d5e735eb7a None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:23.044852 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac78cc-d7ff-47eb-a99f-31d5e735eb7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:23.045161 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac78cc-d7ff-47eb-a99f-31d5e735eb7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:23.046582 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac78cc-d7ff-47eb-a99f-31d5e735eb7a None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:23.052284 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-e50e35b8-704b-419b-bab2-3c5204abe8b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:23.052284 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:23.052284 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:23.052284 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:23.052284 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:23.052284 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:23.052284 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:23.052284 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:23.052284 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:23.052284 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:23.052284 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:23.052284 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:23.052284 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:23.052284 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:23.052284 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:23.053195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:23.053195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:23.053195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:23.053195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:23.053195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:23.053195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:23.053195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:23.053195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:23.053195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:23.053195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:23.053195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:23.053195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:23.053195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:23.053195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:23.053195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:23.053195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:23.053195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:23.054039 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:23.054039 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:23.054039 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:23.054039 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:23.056021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 232/467] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:23.062646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8075b6-5bb8-481f-adc6-d87d3c8036e7 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:23.063113 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8075b6-5bb8-481f-adc6-d87d3c8036e7 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:23.063587 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8075b6-5bb8-481f-adc6-d87d3c8036e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:23.072904 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 236/468] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:23.073773 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac78cc-d7ff-47eb-a99f-31d5e735eb7a None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:23.081511 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-6e8075b6-5bb8-481f-adc6-d87d3c8036e7 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:23.082742 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-6e8075b6-5bb8-481f-adc6-d87d3c8036e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:23.166671 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 233/469] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:23.167611 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8075b6-5bb8-481f-adc6-d87d3c8036e7 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:23.197711 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac78cc-d7ff-47eb-a99f-31d5e735eb7a None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:23.234086 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774e7a2-302c-4cae-8d41-9b2e00c3c2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:23.234778 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774e7a2-302c-4cae-8d41-9b2e00c3c2ba None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:23.235053 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774e7a2-302c-4cae-8d41-9b2e00c3c2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:23.235331 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774e7a2-302c-4cae-8d41-9b2e00c3c2ba None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:23.236105 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774e7a2-302c-4cae-8d41-9b2e00c3c2ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:23.236417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774e7a2-302c-4cae-8d41-9b2e00c3c2ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:23.237829 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774e7a2-302c-4cae-8d41-9b2e00c3c2ba None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:23.251643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 237/470] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:23.252501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774e7a2-302c-4cae-8d41-9b2e00c3c2ba None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:23.267129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:23.296652 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8075b6-5bb8-481f-adc6-d87d3c8036e7 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:23.314704 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:23.342573 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ec17c-7e0b-4596-82e7-81001d6781df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:23.344026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ec17c-7e0b-4596-82e7-81001d6781df None admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:23.344574 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ec17c-7e0b-4596-82e7-81001d6781df None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:23.345003 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ec17c-7e0b-4596-82e7-81001d6781df None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:23.346007 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ec17c-7e0b-4596-82e7-81001d6781df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:23.348103 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ec17c-7e0b-4596-82e7-81001d6781df None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:23.362837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774e7a2-302c-4cae-8d41-9b2e00c3c2ba None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:23.372514 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 234/471] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 01:51:23 2022] POST /identity/v3/users => generated 248 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:51:23.373620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ec17c-7e0b-4596-82e7-81001d6781df None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:23.427711 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f957a-0b27-435f-8f77-c2f22ed3646b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:23.428695 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f957a-0b27-435f-8f77-c2f22ed3646b None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:23.428982 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f957a-0b27-435f-8f77-c2f22ed3646b None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:23.429305 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f957a-0b27-435f-8f77-c2f22ed3646b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:23.451361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f957a-0b27-435f-8f77-c2f22ed3646b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:23.452848 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f957a-0b27-435f-8f77-c2f22ed3646b None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:23.484813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ec17c-7e0b-4596-82e7-81001d6781df None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:23.493655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-fc8f957a-0b27-435f-8f77-c2f22ed3646b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:23.493655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:23.493655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:23.493655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:23.493655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:23.493655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:23.493655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:23.493655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:23.493655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:23.493655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:23.493655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:23.493655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:23.493655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:23.493655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:23.493655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:23.494579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:23.494579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:23.494579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:23.494579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:23.494579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:23.494579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:23.494579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:23.494579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:23.494579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:23.494579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:23.494579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:23.494579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:23.494579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:23.494579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:23.494579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:23.494579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:23.494579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:23.495400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:23.495400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:23.495400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:23.495400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:23.495400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 238/472] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:23.504983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f957a-0b27-435f-8f77-c2f22ed3646b None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:23.540213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e34f40-7959-4cae-a1d2-966807efb03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:23.541436 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e34f40-7959-4cae-a1d2-966807efb03c None admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:23.541788 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e34f40-7959-4cae-a1d2-966807efb03c None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:23.542130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e34f40-7959-4cae-a1d2-966807efb03c None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:23.542916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e34f40-7959-4cae-a1d2-966807efb03c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:23.544475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e34f40-7959-4cae-a1d2-966807efb03c None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:23.582600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 235/473] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 01:51:23 2022] POST /identity/v3/users => generated 248 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:51:23.595941 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:23.646980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f957a-0b27-435f-8f77-c2f22ed3646b None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:23.693718 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b69dd-be31-41cf-a493-b742d190b3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:23.693718 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b69dd-be31-41cf-a493-b742d190b3ad None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:23.694384 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b69dd-be31-41cf-a493-b742d190b3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:23.694384 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b69dd-be31-41cf-a493-b742d190b3ad None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:23.695040 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b69dd-be31-41cf-a493-b742d190b3ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:23.695349 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b69dd-be31-41cf-a493-b742d190b3ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:23.696796 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b69dd-be31-41cf-a493-b742d190b3ad None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:23.696994 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a0452-e507-4f35-adc8-224ff6368aae None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:23.697463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a0452-e507-4f35-adc8-224ff6368aae None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:23.697961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a0452-e507-4f35-adc8-224ff6368aae None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:23.704003 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 236/474] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:23.709462 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23cf8b-1fac-4c67-8e7f-cc8f9c3bad05 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:23.710057 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23cf8b-1fac-4c67-8e7f-cc8f9c3bad05 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:23.710528 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23cf8b-1fac-4c67-8e7f-cc8f9c3bad05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:23.710959 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 239/475] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:23.719812 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b69dd-be31-41cf-a493-b742d190b3ad None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:23.729826 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-1b23cf8b-1fac-4c67-8e7f-cc8f9c3bad05 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:23.731554 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-1b23cf8b-1fac-4c67-8e7f-cc8f9c3bad05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:23.756273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:23.824414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 237/476] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:51:23.846111 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b69dd-be31-41cf-a493-b742d190b3ad None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:23.850369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23cf8b-1fac-4c67-8e7f-cc8f9c3bad05 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:23.883025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5eb43-b643-4599-ae02-30872ff9e44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:23.884173 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5eb43-b643-4599-ae02-30872ff9e44b None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:23.884655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5eb43-b643-4599-ae02-30872ff9e44b None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:23.885147 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5eb43-b643-4599-ae02-30872ff9e44b None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:23.886048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5eb43-b643-4599-ae02-30872ff9e44b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:23.887911 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5eb43-b643-4599-ae02-30872ff9e44b None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:23.891850 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:23.912730 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 240/477] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 01:51:23 2022] POST /identity/v3/users => generated 249 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 01:51:23.997103 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23cf8b-1fac-4c67-8e7f-cc8f9c3bad05 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:24.040496 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbb421-e8b0-444c-8aa1-0d30195e25f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:24.041248 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbb421-e8b0-444c-8aa1-0d30195e25f9 None admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:24.041480 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbb421-e8b0-444c-8aa1-0d30195e25f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:24.041757 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbb421-e8b0-444c-8aa1-0d30195e25f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:24.042546 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbbb421-e8b0-444c-8aa1-0d30195e25f9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:24.043998 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbbb421-e8b0-444c-8aa1-0d30195e25f9 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:24.052253 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.sql.core [None req-cfbbb421-e8b0-444c-8aa1-0d30195e25f9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 01:51:24.052253 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 01:51:24.052253 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [parameters: {'id': 'b5ff8edaa61d4c5c929751e16196ffaa', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 01:51:24.052253 dv-cinder-815582-9-smb devstack@keystone.service[80431]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80431) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 01:51:24.073878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-cfbbb421-e8b0-444c-8aa1-0d30195e25f9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 01:51:24.073878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:24.073878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 01:51:24.073878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 01:51:24.073878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 01:51:24.073878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 01:51:24.073878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 01:51:24.073878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 01:51:24.073878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 01:51:24.073878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application conn.query(q) Jun 23 01:51:24.073878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 01:51:24.073878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 01:51:24.073878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 01:51:24.073878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application result.read() Jun 23 01:51:24.073878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 01:51:24.074777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 01:51:24.074777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 01:51:24.074777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 01:51:24.074777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 01:51:24.074777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 01:51:24.074777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 01:51:24.074777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 01:51:24.074777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 01:51:24.074777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:24.074777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 01:51:24.074777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:24.074777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:24.074777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 01:51:24.074777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 01:51:24.074777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 23 01:51:24.074777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return ref.to_dict() Jun 23 01:51:24.074777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 01:51:24.074777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application next(self.gen) Jun 23 01:51:24.076223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 01:51:24.076223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application yield resource Jun 23 01:51:24.076223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 01:51:24.076223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application next(self.gen) Jun 23 01:51:24.076223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 01:51:24.076223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 01:51:24.076223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 01:51:24.076223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 01:51:24.076223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 01:51:24.076223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise self.value Jun 23 01:51:24.076223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 01:51:24.076223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 01:51:24.076223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 01:51:24.076223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application session.commit() Jun 23 01:51:24.076223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 01:51:24.076223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 01:51:24.076223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 01:51:24.077297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 01:51:24.077297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 01:51:24.077297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self.session.flush() Jun 23 01:51:24.077297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 01:51:24.077297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 01:51:24.077297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 01:51:24.077297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 01:51:24.077297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 01:51:24.077297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application compat.raise_( Jun 23 01:51:24.077297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 01:51:24.077297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception Jun 23 01:51:24.077297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 01:51:24.077297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 01:51:24.077297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 01:51:24.077297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 01:51:24.077297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 01:51:24.077297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 01:51:24.078154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 01:51:24.078154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 01:51:24.078154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 01:51:24.078154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 01:51:24.078154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 01:51:24.078154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 01:51:24.078154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 01:51:24.078154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 01:51:24.078154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 01:51:24.078154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 01:51:24.078154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 01:51:24.078154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 01:51:24.078154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 01:51:24.078154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 01:51:24.078154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 01:51:24.078154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception Jun 23 01:51:24.078947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 01:51:24.078947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 01:51:24.078947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 01:51:24.078947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 01:51:24.078947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 01:51:24.078947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 01:51:24.078947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 01:51:24.078947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application conn.query(q) Jun 23 01:51:24.078947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 01:51:24.078947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 01:51:24.078947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 01:51:24.078947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application result.read() Jun 23 01:51:24.078947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 01:51:24.078947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 01:51:24.078947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 01:51:24.078947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 01:51:24.079747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 01:51:24.079747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 01:51:24.079747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 01:51:24.079747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 01:51:24.079747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 01:51:24.079747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 01:51:24.079747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [parameters: {'id': 'b5ff8edaa61d4c5c929751e16196ffaa', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 01:51:24.079747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 01:51:24.079747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:24.079747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:51:24.079747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:24.079747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:24.079747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:24.079747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:24.079747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:24.079747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:24.082278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:24.082278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:24.082278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:24.082278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:24.082278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:24.082278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:24.082278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 23 01:51:24.082278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 23 01:51:24.082278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:24.082278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:24.082278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 23 01:51:24.082278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 23 01:51:24.082278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 01:51:24.082278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 01:51:24.082278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 01:51:24.082278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:24.084222 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 238/478] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Jun 23 01:51:23 2022] POST /identity/v3/roles => generated 144 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:24.084361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5eb43-b643-4599-ae02-30872ff9e44b None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:24.224987 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5eb43-b643-4599-ae02-30872ff9e44b None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:24.266001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6a8e5-6f0b-425e-9fa8-cb776d6c2229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:24.267193 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6a8e5-6f0b-425e-9fa8-cb776d6c2229 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:24.267695 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6a8e5-6f0b-425e-9fa8-cb776d6c2229 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:24.268160 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6a8e5-6f0b-425e-9fa8-cb776d6c2229 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:24.281963 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6a8e5-6f0b-425e-9fa8-cb776d6c2229 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:24.290914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-b9c6a8e5-6f0b-425e-9fa8-cb776d6c2229 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:51:24.290914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:24.290914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:24.290914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:24.290914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:24.290914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:24.290914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:24.290914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:24.290914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:24.290914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:24.290914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:24.290914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:24.290914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:24.290914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:24.290914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:24.290914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:24.291794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:24.291794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:24.291794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:24.291794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:24.291794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:24.291794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:24.291794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:24.291794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:24.291794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:24.291794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:24.291794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:24.291794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:24.291794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:24.291794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:24.291794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:24.291794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:24.292587 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:24.292587 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:24.292587 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:24.292587 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:24.292587 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:24.292587 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:24.292587 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:24.292587 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:24.292587 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:24.292587 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:24.292587 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 01:51:24.292587 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:24.295261 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 241/479] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 01:51:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:24.300596 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbb421-e8b0-444c-8aa1-0d30195e25f9 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:24.331773 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:24.438504 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbb421-e8b0-444c-8aa1-0d30195e25f9 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:24.484182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c84e7-5c13-4f90-981f-77196398b311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:24.484874 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c84e7-5c13-4f90-981f-77196398b311 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:24.485159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c84e7-5c13-4f90-981f-77196398b311 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:24.485440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c84e7-5c13-4f90-981f-77196398b311 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:24.486201 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c84e7-5c13-4f90-981f-77196398b311 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:24.486513 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c84e7-5c13-4f90-981f-77196398b311 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:24.487930 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c84e7-5c13-4f90-981f-77196398b311 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:24.502873 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 239/480] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:25.341533 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306cf26-5bed-4499-9843-b002141b7846 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:25.342050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306cf26-5bed-4499-9843-b002141b7846 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:25.342050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306cf26-5bed-4499-9843-b002141b7846 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:25.343590 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 242/481] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:25.349070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba158bc-ae1c-4f94-95ae-58fe1e4d6323 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:25.349504 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba158bc-ae1c-4f94-95ae-58fe1e4d6323 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:25.349694 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba158bc-ae1c-4f94-95ae-58fe1e4d6323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:25.372403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-aba158bc-ae1c-4f94-95ae-58fe1e4d6323 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:25.373614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-aba158bc-ae1c-4f94-95ae-58fe1e4d6323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:25.460603 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 240/482] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:25.496672 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306cf26-5bed-4499-9843-b002141b7846 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:25.563024 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:25.636366 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306cf26-5bed-4499-9843-b002141b7846 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:25.681712 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14717e-843e-41a4-85a9-e841542a2812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:25.682529 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14717e-843e-41a4-85a9-e841542a2812 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:25.682812 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14717e-843e-41a4-85a9-e841542a2812 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:25.683089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14717e-843e-41a4-85a9-e841542a2812 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:25.699045 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14717e-843e-41a4-85a9-e841542a2812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:25.706870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-ee14717e-843e-41a4-85a9-e841542a2812 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:25.706870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:25.706870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:25.706870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:25.706870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:25.706870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:25.706870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:25.706870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:25.706870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:25.706870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:25.706870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:25.706870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:25.706870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:25.706870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:25.706870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:25.706870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:25.707893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:25.707893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:25.707893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:25.707893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:25.707893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:25.707893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:25.707893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:25.707893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:25.707893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:25.707893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:25.707893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:25.707893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:25.707893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:25.707893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:25.707893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:25.707893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:25.708670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:25.708670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:25.708670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:25.708670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:25.708670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:25.708670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:25.708670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:25.708670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:25.708670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:25.708670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:25.708670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:25.708670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:25.712862 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 243/483] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 01:51:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:25.718597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba158bc-ae1c-4f94-95ae-58fe1e4d6323 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:25.734830 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:25.845693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba158bc-ae1c-4f94-95ae-58fe1e4d6323 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:25.874353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca8540-2396-4e14-8147-f4a268f831fa None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:25.874673 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca8540-2396-4e14-8147-f4a268f831fa None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:25.874903 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca8540-2396-4e14-8147-f4a268f831fa None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:25.876571 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 244/484] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:25.884486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b92cc-13a6-496f-a554-dcd8bb45ca04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:25.885303 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b92cc-13a6-496f-a554-dcd8bb45ca04 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:25.885631 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b92cc-13a6-496f-a554-dcd8bb45ca04 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:25.885907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b92cc-13a6-496f-a554-dcd8bb45ca04 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:25.886589 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb2bcc-0727-41da-a824-8de7c8772fd7 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:25.886692 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b92cc-13a6-496f-a554-dcd8bb45ca04 None admin] RBAC: Adding query filter params (name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:25.886840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb2bcc-0727-41da-a824-8de7c8772fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:25.887003 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b92cc-13a6-496f-a554-dcd8bb45ca04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:25.887099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb2bcc-0727-41da-a824-8de7c8772fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:25.888366 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b92cc-13a6-496f-a554-dcd8bb45ca04 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:25.897498 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 241/485] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 01:51:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:25.902944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b92cc-13a6-496f-a554-dcd8bb45ca04 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:25.937600 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-1efb2bcc-0727-41da-a824-8de7c8772fd7 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:25.938828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-1efb2bcc-0727-41da-a824-8de7c8772fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:26.001256 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:26.032007 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b92cc-13a6-496f-a554-dcd8bb45ca04 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:26.067207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66650288-3bd7-49c1-82e4-ceaad6171993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:26.068059 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66650288-3bd7-49c1-82e4-ceaad6171993 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:26.068349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66650288-3bd7-49c1-82e4-ceaad6171993 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:26.068628 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66650288-3bd7-49c1-82e4-ceaad6171993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:26.079110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66650288-3bd7-49c1-82e4-ceaad6171993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:26.080642 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66650288-3bd7-49c1-82e4-ceaad6171993 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:26.100333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-66650288-3bd7-49c1-82e4-ceaad6171993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:26.100333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:26.100333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:26.100333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:26.100333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:26.100333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:26.100333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:26.100333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:26.100333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:26.100333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:26.100333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:26.100333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:26.100333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:26.100333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:26.100333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:26.101226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:26.101226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:26.101226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:26.101226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:26.101226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:26.101226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:26.101226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:26.101226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:26.101226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:26.101226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:26.101226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:26.101226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:26.101226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:26.101226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:26.101226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:26.101226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:26.101226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:26.102063 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:26.102063 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:26.102063 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:26.102063 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:26.102063 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 242/486] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:51:26.108444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66650288-3bd7-49c1-82e4-ceaad6171993 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:26.114664 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 245/487] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:26.155804 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb2bcc-0727-41da-a824-8de7c8772fd7 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:26.199787 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:26.274759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66650288-3bd7-49c1-82e4-ceaad6171993 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:26.301990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:26.307221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb2bcc-0727-41da-a824-8de7c8772fd7 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:26.317825 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41686b90-c212-4b05-958d-c4cbf16a46c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:26.319229 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41686b90-c212-4b05-958d-c4cbf16a46c5 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:26.320115 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41686b90-c212-4b05-958d-c4cbf16a46c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:26.320753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41686b90-c212-4b05-958d-c4cbf16a46c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:26.321787 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41686b90-c212-4b05-958d-c4cbf16a46c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:26.322517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41686b90-c212-4b05-958d-c4cbf16a46c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:26.324853 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41686b90-c212-4b05-958d-c4cbf16a46c5 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:26.345528 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 243/488] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:26.345528 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a2332-b966-40a4-a314-8d177590b02c None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:26.345528 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a2332-b966-40a4-a314-8d177590b02c None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:26.345528 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a2332-b966-40a4-a314-8d177590b02c None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:26.345528 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 244/489] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:26.346239 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a2332-b966-40a4-a314-8d177590b02c None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:26.351020 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf5ebb-6e93-45e6-9b11-e2a7f3ba3e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:26.351863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf5ebb-6e93-45e6-9b11-e2a7f3ba3e92 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:26.352241 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf5ebb-6e93-45e6-9b11-e2a7f3ba3e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:26.352503 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf5ebb-6e93-45e6-9b11-e2a7f3ba3e92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:26.369991 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf5ebb-6e93-45e6-9b11-e2a7f3ba3e92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:26.378604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-92bf5ebb-6e93-45e6-9b11-e2a7f3ba3e92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:26.378604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:26.378604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:26.378604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:26.378604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:26.378604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:26.378604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:26.378604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:26.378604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:26.378604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:26.378604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:26.378604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:26.378604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:26.378604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:26.378604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:26.378604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:26.379622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:26.379622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:26.379622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:26.379622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:26.379622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:26.379622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:26.379622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:26.379622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:26.379622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:26.379622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:26.379622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:26.379622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:26.379622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:26.379622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:26.379622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:26.379622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:26.380428 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:26.380428 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:26.380428 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:26.380428 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:26.380428 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:26.380428 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:26.380428 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:26.380428 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:26.380428 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:26.380428 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:26.380428 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:26.380428 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:26.383326 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 246/490] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 01:51:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:51:26.384994 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81244d76-3f64-493c-b031-019ead298475 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:26.385473 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81244d76-3f64-493c-b031-019ead298475 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:26.385996 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81244d76-3f64-493c-b031-019ead298475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:26.403649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-81244d76-3f64-493c-b031-019ead298475 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:26.405241 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-81244d76-3f64-493c-b031-019ead298475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:26.464798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a2332-b966-40a4-a314-8d177590b02c None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:26.487551 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 247/491] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:26.488817 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81244d76-3f64-493c-b031-019ead298475 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:26.507434 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8dfd0-c598-4718-aa61-1846e991bd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:26.507434 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8dfd0-c598-4718-aa61-1846e991bd8f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:26.507434 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8dfd0-c598-4718-aa61-1846e991bd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:26.507434 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8dfd0-c598-4718-aa61-1846e991bd8f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:26.510082 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8dfd0-c598-4718-aa61-1846e991bd8f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:26.511387 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8dfd0-c598-4718-aa61-1846e991bd8f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:26.526738 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:26.530530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-44a8dfd0-c598-4718-aa61-1846e991bd8f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 01:51:26.530530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:26.530530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:26.530530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:26.530530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:26.530530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:26.530530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:26.530530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:26.530530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:26.530530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:26.530530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:26.530530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:26.530530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:51:26.530530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:51:26.530530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:51:26.530530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:51:26.532050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:26.532050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:26.532050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:51:26.532050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:26.532050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:51:26.532050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:26.532050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:26.532050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:26.532050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:26.532050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:26.532050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:26.532050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:26.532050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:26.532050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:26.532050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:26.532050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:26.532050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:26.532050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:26.532985 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:26.532985 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:26.532985 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:51:26.532985 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:51:26.532985 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:51:26.532985 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:51:26.532985 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:51:26.532985 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:51:26.532985 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 01:51:26.532985 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:26.532985 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 245/492] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 23 01:51:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:51:26.532985 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8dfd0-c598-4718-aa61-1846e991bd8f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:26.581616 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:26.625432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81244d76-3f64-493c-b031-019ead298475 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:26.639783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8dfd0-c598-4718-aa61-1846e991bd8f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:26.663636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843f70a-04fd-432f-8c53-2676380e081f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:26.664299 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843f70a-04fd-432f-8c53-2676380e081f None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:26.664578 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843f70a-04fd-432f-8c53-2676380e081f None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:26.664850 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843f70a-04fd-432f-8c53-2676380e081f None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:26.665604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843f70a-04fd-432f-8c53-2676380e081f None admin] RBAC: Adding query filter params (name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:26.665913 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843f70a-04fd-432f-8c53-2676380e081f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:26.667307 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843f70a-04fd-432f-8c53-2676380e081f None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:26.675739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 248/493] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 01:51:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:26.676281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcbdb6-75c1-4f08-83fd-5031d1fed096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:26.676419 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843f70a-04fd-432f-8c53-2676380e081f None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:26.677364 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcbdb6-75c1-4f08-83fd-5031d1fed096 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:26.677639 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcbdb6-75c1-4f08-83fd-5031d1fed096 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:26.677914 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcbdb6-75c1-4f08-83fd-5031d1fed096 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:26.691085 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcbdb6-75c1-4f08-83fd-5031d1fed096 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:26.699447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-fefcbdb6-75c1-4f08-83fd-5031d1fed096 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:26.699447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:26.699447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:26.699447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:26.699447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:26.699447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:26.699447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:26.699447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:26.699447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:26.699447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:26.699447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:26.699447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:26.699447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:26.699447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:26.699447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:26.699447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:26.700318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:26.700318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:26.700318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:26.700318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:26.700318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:26.700318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:26.700318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:26.700318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:26.700318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:26.700318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:26.700318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:26.700318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:26.700318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:26.700318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:26.700318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:26.700318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:26.701108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:26.701108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:26.701108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:26.701108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:26.701108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:26.701108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:26.701108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:26.701108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:26.701108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:26.701108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:26.701108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:26.701108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:26.701108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 246/494] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 01:51:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:26.702415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592af38-287c-4c7f-9e07-83cd31e57253 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:26.702415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592af38-287c-4c7f-9e07-83cd31e57253 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:26.702415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592af38-287c-4c7f-9e07-83cd31e57253 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:26.703744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 247/495] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:26.707564 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592af38-287c-4c7f-9e07-83cd31e57253 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:26.772795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:26.792634 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843f70a-04fd-432f-8c53-2676380e081f None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:26.816119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592af38-287c-4c7f-9e07-83cd31e57253 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:26.819610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:26.831931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a6068-ad05-46ef-8df2-83f230f044a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:26.832900 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a6068-ad05-46ef-8df2-83f230f044a8 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:26.833179 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a6068-ad05-46ef-8df2-83f230f044a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:26.833449 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a6068-ad05-46ef-8df2-83f230f044a8 None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:26.834300 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a6068-ad05-46ef-8df2-83f230f044a8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:26.834599 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a6068-ad05-46ef-8df2-83f230f044a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:26.836091 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a6068-ad05-46ef-8df2-83f230f044a8 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:26.854374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724dfca-3ad5-476e-b4c0-c1ebfab9a402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:26.855610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724dfca-3ad5-476e-b4c0-c1ebfab9a402 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:26.856054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724dfca-3ad5-476e-b4c0-c1ebfab9a402 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:26.856471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724dfca-3ad5-476e-b4c0-c1ebfab9a402 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:26.867762 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724dfca-3ad5-476e-b4c0-c1ebfab9a402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:26.869414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724dfca-3ad5-476e-b4c0-c1ebfab9a402 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:26.882816 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 249/496] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 23 01:51:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:26.882816 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a6068-ad05-46ef-8df2-83f230f044a8 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:26.888580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-1724dfca-3ad5-476e-b4c0-c1ebfab9a402 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:26.888580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:26.888580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:26.888580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:26.888580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:26.888580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:26.888580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:26.888580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:26.888580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:26.888580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:26.888580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:26.888580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:26.888580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:26.888580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:26.888580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:26.889440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:26.889440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:26.889440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:26.889440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:26.889440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:26.889440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:26.889440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:26.889440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:26.889440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:26.889440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:26.889440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:26.889440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:26.889440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:26.889440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:26.889440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:26.889440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:26.889440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:26.890298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:26.890298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:26.890298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:26.890298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:26.890298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 248/497] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:26.891351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a403a78-2783-4ae8-bf7e-c3cf708208c0 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:26.891351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a403a78-2783-4ae8-bf7e-c3cf708208c0 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:26.891653 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a403a78-2783-4ae8-bf7e-c3cf708208c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:26.910059 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-7a403a78-2783-4ae8-bf7e-c3cf708208c0 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:26.911384 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-7a403a78-2783-4ae8-bf7e-c3cf708208c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:26.982571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 249/498] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:26.984237 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a403a78-2783-4ae8-bf7e-c3cf708208c0 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:26.995636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a6068-ad05-46ef-8df2-83f230f044a8 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:27.034393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd5b18-4826-44e8-bede-560689435dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:27.035007 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd5b18-4826-44e8-bede-560689435dfd None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:27.035283 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd5b18-4826-44e8-bede-560689435dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:27.035605 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd5b18-4826-44e8-bede-560689435dfd None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:27.036355 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd5b18-4826-44e8-bede-560689435dfd None admin] RBAC: Adding query filter params (name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:27.036660 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd5b18-4826-44e8-bede-560689435dfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:27.038052 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd5b18-4826-44e8-bede-560689435dfd None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:27.043132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:27.047351 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 250/499] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 01:51:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:27.048537 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd5b18-4826-44e8-bede-560689435dfd None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:27.087503 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:27.103823 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a403a78-2783-4ae8-bf7e-c3cf708208c0 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:27.138224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ced6c-148e-45b9-9fcb-4f1d15b610a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:27.138881 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ced6c-148e-45b9-9fcb-4f1d15b610a2 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:27.139168 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ced6c-148e-45b9-9fcb-4f1d15b610a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:27.139449 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ced6c-148e-45b9-9fcb-4f1d15b610a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:27.160983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd5b18-4826-44e8-bede-560689435dfd None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:27.198878 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435238ba-d41b-4b2a-812d-7b3cc8be4d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:27.199822 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435238ba-d41b-4b2a-812d-7b3cc8be4d30 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:27.200350 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435238ba-d41b-4b2a-812d-7b3cc8be4d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:27.200767 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435238ba-d41b-4b2a-812d-7b3cc8be4d30 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:27.201717 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435238ba-d41b-4b2a-812d-7b3cc8be4d30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:27.202029 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435238ba-d41b-4b2a-812d-7b3cc8be4d30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:27.203580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435238ba-d41b-4b2a-812d-7b3cc8be4d30 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:27.210167 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ced6c-148e-45b9-9fcb-4f1d15b610a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:27.211650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ced6c-148e-45b9-9fcb-4f1d15b610a2 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:27.221102 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 251/500] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:27.221102 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435238ba-d41b-4b2a-812d-7b3cc8be4d30 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:27.280314 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:27.297845 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:27.314218 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 250/501] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:51:27.315032 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ced6c-148e-45b9-9fcb-4f1d15b610a2 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:27.324543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435238ba-d41b-4b2a-812d-7b3cc8be4d30 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:27.357627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e28f9-a569-4cc8-94c2-357c6e12d686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:27.358425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e28f9-a569-4cc8-94c2-357c6e12d686 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:27.358706 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e28f9-a569-4cc8-94c2-357c6e12d686 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:27.358984 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e28f9-a569-4cc8-94c2-357c6e12d686 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:27.368919 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e28f9-a569-4cc8-94c2-357c6e12d686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:27.376684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-b97e28f9-a569-4cc8-94c2-357c6e12d686 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:27.376684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:27.376684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:27.376684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:27.376684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:27.376684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:27.376684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:27.376684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:27.376684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:27.376684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:27.376684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:27.376684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:27.376684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:27.376684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:27.376684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:27.376684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:27.377638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:27.377638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:27.377638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:27.377638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:27.377638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:27.377638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:27.377638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:27.377638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:27.377638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:27.377638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:27.377638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:27.377638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:27.377638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:27.377638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:27.377638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:27.377638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:27.378457 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:27.378457 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:27.378457 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:27.378457 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:27.378457 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:27.378457 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:27.378457 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:27.378457 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:27.378457 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:27.378457 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:27.378457 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:27.378457 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:27.379697 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 252/502] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 01:51:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:27.380660 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e28f9-a569-4cc8-94c2-357c6e12d686 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:27.413176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ced6c-148e-45b9-9fcb-4f1d15b610a2 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:27.446148 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0415f2-a873-4b6e-9e54-c69eeb5b6728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:27.446947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0415f2-a873-4b6e-9e54-c69eeb5b6728 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:27.447230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0415f2-a873-4b6e-9e54-c69eeb5b6728 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:27.447534 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0415f2-a873-4b6e-9e54-c69eeb5b6728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:27.457379 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0415f2-a873-4b6e-9e54-c69eeb5b6728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:27.459076 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0415f2-a873-4b6e-9e54-c69eeb5b6728 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:27.476374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-7a0415f2-a873-4b6e-9e54-c69eeb5b6728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:27.476374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:27.476374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:27.476374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:27.476374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:27.476374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:27.476374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:27.476374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:27.476374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:27.476374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:27.476374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:27.476374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:27.476374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:27.476374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:27.476374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:27.477656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:27.477656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:27.477656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:27.477656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:27.477656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:27.477656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:27.477656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:27.477656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:27.477656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:27.477656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:27.477656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:27.477656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:27.477656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:27.477656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:27.477656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:27.477656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:27.477656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:27.479118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:27.479118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:27.479118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:27.479118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:27.479118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 251/503] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:27.479118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c51aeb-055b-427e-ba5c-1b5e2f8f12f7 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:27.479118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c51aeb-055b-427e-ba5c-1b5e2f8f12f7 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:27.479699 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c51aeb-055b-427e-ba5c-1b5e2f8f12f7 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:27.480293 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e28f9-a569-4cc8-94c2-357c6e12d686 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:27.483545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 252/504] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:27.484329 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c51aeb-055b-427e-ba5c-1b5e2f8f12f7 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:27.500862 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:27.515265 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011252d-5b1d-42fe-acbf-f3c91e8060da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:27.516125 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011252d-5b1d-42fe-acbf-f3c91e8060da None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:27.516411 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011252d-5b1d-42fe-acbf-f3c91e8060da None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:27.516689 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011252d-5b1d-42fe-acbf-f3c91e8060da None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:27.524511 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011252d-5b1d-42fe-acbf-f3c91e8060da None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:27.525979 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011252d-5b1d-42fe-acbf-f3c91e8060da None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:27.527441 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:27.542221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-d011252d-5b1d-42fe-acbf-f3c91e8060da None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 01:51:27.542221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:27.542221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:27.542221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:27.542221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:27.542221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:27.542221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:27.542221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:27.542221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:27.542221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:27.542221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:27.542221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:27.542221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:51:27.542221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:51:27.542221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:51:27.542221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:51:27.543220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:27.543220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:27.543220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:51:27.543220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:27.543220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:51:27.543220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:27.543220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:27.543220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:27.543220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:27.543220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:27.543220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:27.543220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:27.543220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:27.543220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:27.543220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:27.543220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:27.543220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:27.543220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:27.544350 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:27.544350 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:27.544350 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:51:27.544350 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:51:27.544350 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:51:27.544350 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:51:27.544350 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:51:27.544350 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:51:27.544350 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 01:51:27.544350 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:27.544350 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 253/505] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:27.544350 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011252d-5b1d-42fe-acbf-f3c91e8060da None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:27.598001 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c51aeb-055b-427e-ba5c-1b5e2f8f12f7 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:27.633065 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d66cf-9ab9-4d01-94f9-96c4f113d45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:27.633864 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d66cf-9ab9-4d01-94f9-96c4f113d45c None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:27.634147 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d66cf-9ab9-4d01-94f9-96c4f113d45c None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:27.634422 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d66cf-9ab9-4d01-94f9-96c4f113d45c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:27.644524 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d66cf-9ab9-4d01-94f9-96c4f113d45c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:27.646081 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d66cf-9ab9-4d01-94f9-96c4f113d45c None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:27.647490 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011252d-5b1d-42fe-acbf-f3c91e8060da None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:27.663993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-9c5d66cf-9ab9-4d01-94f9-96c4f113d45c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:27.663993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:27.663993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:27.663993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:27.663993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:27.663993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:27.663993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:27.663993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:27.663993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:27.663993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:27.663993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:27.663993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:27.663993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:27.663993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:27.663993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:27.665023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:27.665023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:27.665023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:27.665023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:27.665023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:27.665023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:27.665023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:27.665023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:27.665023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:27.665023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:27.665023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:27.665023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:27.665023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:27.665023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:27.665023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:27.665023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:27.665023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:27.666052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:27.666052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:27.666052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:27.666052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:27.666052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 253/506] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:27.666052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d66cf-9ab9-4d01-94f9-96c4f113d45c None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:27.684907 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a375000-95c6-478a-897b-970f76f1032e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:27.685587 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a375000-95c6-478a-897b-970f76f1032e None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:27.686187 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a375000-95c6-478a-897b-970f76f1032e None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:27.686459 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a375000-95c6-478a-897b-970f76f1032e None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:27.687203 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a375000-95c6-478a-897b-970f76f1032e None admin] RBAC: Adding query filter params (name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:27.687545 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a375000-95c6-478a-897b-970f76f1032e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:27.688957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a375000-95c6-478a-897b-970f76f1032e None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:27.702107 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 254/507] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 01:51:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:27.702107 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2307e2-d199-4d82-97e3-0eafdc2d3357 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:27.702107 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2307e2-d199-4d82-97e3-0eafdc2d3357 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:27.702107 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2307e2-d199-4d82-97e3-0eafdc2d3357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:27.716615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-3d2307e2-d199-4d82-97e3-0eafdc2d3357 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:27.717821 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-3d2307e2-d199-4d82-97e3-0eafdc2d3357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:27.753274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:27.763246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:27.773696 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d66cf-9ab9-4d01-94f9-96c4f113d45c None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:27.786889 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 255/508] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:27.787747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2307e2-d199-4d82-97e3-0eafdc2d3357 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:27.816034 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0593a-bda4-48c7-828f-72979448b10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:27.816848 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0593a-bda4-48c7-828f-72979448b10c None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:27.817089 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0593a-bda4-48c7-828f-72979448b10c None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:27.817375 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0593a-bda4-48c7-828f-72979448b10c None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:27.818115 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0593a-bda4-48c7-828f-72979448b10c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:27.818424 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0593a-bda4-48c7-828f-72979448b10c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:27.819907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0593a-bda4-48c7-828f-72979448b10c None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:27.831973 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 254/509] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:27.834053 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0593a-bda4-48c7-828f-72979448b10c None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:27.888813 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2307e2-d199-4d82-97e3-0eafdc2d3357 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:27.922429 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb3f31-eb47-42dd-88eb-3716b231a512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:27.923113 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb3f31-eb47-42dd-88eb-3716b231a512 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:27.923393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb3f31-eb47-42dd-88eb-3716b231a512 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:27.923696 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb3f31-eb47-42dd-88eb-3716b231a512 None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:27.924547 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb3f31-eb47-42dd-88eb-3716b231a512 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:27.924850 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb3f31-eb47-42dd-88eb-3716b231a512 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:27.926378 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb3f31-eb47-42dd-88eb-3716b231a512 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:27.937810 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0593a-bda4-48c7-828f-72979448b10c None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:27.943954 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 256/510] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Jun 23 01:51:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:27.944756 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb3f31-eb47-42dd-88eb-3716b231a512 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:27.972601 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e0ace-849d-4a81-badb-ed490a80a39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:27.973321 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e0ace-849d-4a81-badb-ed490a80a39f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:27.973607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e0ace-849d-4a81-badb-ed490a80a39f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:27.973886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e0ace-849d-4a81-badb-ed490a80a39f None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:27.974479 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:27.974586 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e0ace-849d-4a81-badb-ed490a80a39f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:27.974918 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e0ace-849d-4a81-badb-ed490a80a39f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:27.976416 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e0ace-849d-4a81-badb-ed490a80a39f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:27.988192 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 255/511] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:27.988992 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e0ace-849d-4a81-badb-ed490a80a39f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:28.001101 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:28.045474 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb3f31-eb47-42dd-88eb-3716b231a512 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:28.080411 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bcaa0-1533-448b-b6c9-7079f4ddf024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:28.081221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bcaa0-1533-448b-b6c9-7079f4ddf024 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:28.081496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bcaa0-1533-448b-b6c9-7079f4ddf024 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:28.081776 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bcaa0-1533-448b-b6c9-7079f4ddf024 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:28.086470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e0ace-849d-4a81-badb-ed490a80a39f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:28.091750 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bcaa0-1533-448b-b6c9-7079f4ddf024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:28.093212 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bcaa0-1533-448b-b6c9-7079f4ddf024 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:28.111132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-738bcaa0-1533-448b-b6c9-7079f4ddf024 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:28.111132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:28.111132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:28.111132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:28.111132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:28.111132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:28.111132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:28.111132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:28.111132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:28.111132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:28.111132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:28.111132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:28.111132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:28.111132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:28.111132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:28.112035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:28.112035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:28.112035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:28.112035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:28.112035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:28.112035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:28.112035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:28.112035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:28.112035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:28.112035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:28.112035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:28.112035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:28.112035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:28.112035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:28.112035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:28.112035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:28.112035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:28.112870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:28.112870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:28.112870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:28.112870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:28.112870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 257/512] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:28.113362 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bcaa0-1533-448b-b6c9-7079f4ddf024 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:28.120616 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97f582-8f44-4980-9f9c-4be5d71d459c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:28.121430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97f582-8f44-4980-9f9c-4be5d71d459c None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:28.121714 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97f582-8f44-4980-9f9c-4be5d71d459c None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:28.121990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97f582-8f44-4980-9f9c-4be5d71d459c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:28.133497 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97f582-8f44-4980-9f9c-4be5d71d459c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:28.134962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97f582-8f44-4980-9f9c-4be5d71d459c None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:28.153738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-cc97f582-8f44-4980-9f9c-4be5d71d459c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:28.153738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:28.153738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:28.153738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:28.153738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:28.153738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:28.153738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:28.153738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:28.153738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:28.153738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:28.153738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:28.153738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:28.153738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:28.153738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:28.153738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:28.154648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:28.154648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:28.154648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:28.154648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:28.154648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:28.154648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:28.154648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:28.154648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:28.154648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:28.154648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:28.154648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:28.154648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:28.154648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:28.154648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:28.154648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:28.154648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:28.154648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:28.155526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:28.155526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:28.155526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:28.155526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:28.155526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 256/513] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:28.155800 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97f582-8f44-4980-9f9c-4be5d71d459c None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:28.198558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:28.216928 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bcaa0-1533-448b-b6c9-7079f4ddf024 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:28.217095 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:28.250086 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5f5ca-ce48-4849-888e-e9202f047ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:28.250881 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5f5ca-ce48-4849-888e-e9202f047ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:28.251157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5f5ca-ce48-4849-888e-e9202f047ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:28.251441 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5f5ca-ce48-4849-888e-e9202f047ae0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:28.257031 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97f582-8f44-4980-9f9c-4be5d71d459c None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:28.258751 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5f5ca-ce48-4849-888e-e9202f047ae0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:28.260250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5f5ca-ce48-4849-888e-e9202f047ae0 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:28.274674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-26c5f5ca-ce48-4849-888e-e9202f047ae0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 01:51:28.274674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:28.274674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:28.274674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:28.274674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:28.274674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:28.274674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:28.274674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:28.274674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:28.274674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:28.274674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:28.274674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:28.274674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:51:28.274674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:51:28.274674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:51:28.274674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:51:28.275619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:28.275619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:28.275619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:51:28.275619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:28.275619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:51:28.275619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:28.275619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:28.275619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:28.275619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:28.275619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:28.275619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:28.275619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:28.275619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:28.275619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:28.275619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:28.275619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:28.275619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:28.275619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:28.276554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:28.276554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:28.276554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:51:28.276554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:51:28.276554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:51:28.276554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:51:28.276554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:51:28.276554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:51:28.276554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 01:51:28.276554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:28.276554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 258/514] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:28.277110 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5f5ca-ce48-4849-888e-e9202f047ae0 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:28.295067 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c86ee8-c736-4992-ad8c-5ccade8d558f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:28.295811 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c86ee8-c736-4992-ad8c-5ccade8d558f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:28.296097 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c86ee8-c736-4992-ad8c-5ccade8d558f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:28.296384 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c86ee8-c736-4992-ad8c-5ccade8d558f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:28.365582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c86ee8-c736-4992-ad8c-5ccade8d558f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:28.367066 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c86ee8-c736-4992-ad8c-5ccade8d558f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:28.377341 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5f5ca-ce48-4849-888e-e9202f047ae0 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:28.411640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fef672-c21e-46d7-b11b-5fe92d97a3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:28.412373 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fef672-c21e-46d7-b11b-5fe92d97a3fc None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:28.412640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fef672-c21e-46d7-b11b-5fe92d97a3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:28.412956 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fef672-c21e-46d7-b11b-5fe92d97a3fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:28.419786 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fef672-c21e-46d7-b11b-5fe92d97a3fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:28.421257 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fef672-c21e-46d7-b11b-5fe92d97a3fc None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:28.425897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:28.435594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-28fef672-c21e-46d7-b11b-5fe92d97a3fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:28.435594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:28.435594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:28.435594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:28.435594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:28.435594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:28.435594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:28.435594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:28.435594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:28.435594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:28.435594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:28.435594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:28.435594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:51:28.435594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:51:28.435594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:51:28.436884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:51:28.436884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:28.436884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:28.436884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:28.436884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:28.436884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:28.436884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:28.436884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:28.436884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:28.436884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:28.436884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:28.436884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:28.436884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:28.436884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:28.436884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:28.436884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:28.436884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:28.442385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:51:28.442385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:51:28.442385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:51:28.442385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:51:28.442385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:51:28.442385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:51:28.442385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:28.442385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:28.442385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 259/515] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:28.442385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fef672-c21e-46d7-b11b-5fe92d97a3fc None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:28.442385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:28.469769 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 257/516] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:51:28.470613 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c86ee8-c736-4992-ad8c-5ccade8d558f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:28.540085 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fef672-c21e-46d7-b11b-5fe92d97a3fc None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:28.568964 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c86ee8-c736-4992-ad8c-5ccade8d558f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:28.572498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f26ac-26d0-4c59-ab25-3d45978560fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:28.573163 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f26ac-26d0-4c59-ab25-3d45978560fb None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:28.573451 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f26ac-26d0-4c59-ab25-3d45978560fb None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:28.573723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f26ac-26d0-4c59-ab25-3d45978560fb None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:28.574441 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f26ac-26d0-4c59-ab25-3d45978560fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:28.574748 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f26ac-26d0-4c59-ab25-3d45978560fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:28.576198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f26ac-26d0-4c59-ab25-3d45978560fb None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:28.587808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 260/517] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:28.588582 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f26ac-26d0-4c59-ab25-3d45978560fb None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:28.607044 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed8e0c-69b5-4adf-bcf5-bb20b67f380d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:28.607748 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed8e0c-69b5-4adf-bcf5-bb20b67f380d None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:28.608033 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed8e0c-69b5-4adf-bcf5-bb20b67f380d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:28.608321 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed8e0c-69b5-4adf-bcf5-bb20b67f380d None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:28.609058 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed8e0c-69b5-4adf-bcf5-bb20b67f380d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:28.609344 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed8e0c-69b5-4adf-bcf5-bb20b67f380d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:28.610735 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed8e0c-69b5-4adf-bcf5-bb20b67f380d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:28.622071 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 258/518] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:28.622860 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed8e0c-69b5-4adf-bcf5-bb20b67f380d None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:28.647181 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:28.651371 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:28.690641 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f26ac-26d0-4c59-ab25-3d45978560fb None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:28.723236 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed8e0c-69b5-4adf-bcf5-bb20b67f380d None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:28.725418 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2891d5c-1f3c-4323-9583-310c79382e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:28.726121 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2891d5c-1f3c-4323-9583-310c79382e59 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:28.726406 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2891d5c-1f3c-4323-9583-310c79382e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:28.726683 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2891d5c-1f3c-4323-9583-310c79382e59 None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:28.727552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2891d5c-1f3c-4323-9583-310c79382e59 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:28.727883 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2891d5c-1f3c-4323-9583-310c79382e59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:28.729327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2891d5c-1f3c-4323-9583-310c79382e59 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:28.746255 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 261/519] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Jun 23 01:51:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:28.747050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2891d5c-1f3c-4323-9583-310c79382e59 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:28.757219 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689cf5a-52bf-4676-b213-5b2f3576e623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:28.757888 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689cf5a-52bf-4676-b213-5b2f3576e623 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:28.758172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689cf5a-52bf-4676-b213-5b2f3576e623 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:28.758446 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689cf5a-52bf-4676-b213-5b2f3576e623 None admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:28.759245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689cf5a-52bf-4676-b213-5b2f3576e623 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:28.759588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689cf5a-52bf-4676-b213-5b2f3576e623 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:28.761023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689cf5a-52bf-4676-b213-5b2f3576e623 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:28.779773 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 259/520] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:51:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:28.780571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689cf5a-52bf-4676-b213-5b2f3576e623 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:28.850860 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2891d5c-1f3c-4323-9583-310c79382e59 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:28.860387 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:28.872811 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:28.879988 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689cf5a-52bf-4676-b213-5b2f3576e623 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:28.886881 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a239db9-bc16-46e4-9be4-ff5a750c9b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:28.887705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a239db9-bc16-46e4-9be4-ff5a750c9b76 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:28.887981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a239db9-bc16-46e4-9be4-ff5a750c9b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:28.888251 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a239db9-bc16-46e4-9be4-ff5a750c9b76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:28.898367 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a239db9-bc16-46e4-9be4-ff5a750c9b76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:28.899876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a239db9-bc16-46e4-9be4-ff5a750c9b76 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:28.914211 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f7546-3ac5-4f63-a39c-8f833689aceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:28.915032 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f7546-3ac5-4f63-a39c-8f833689aceb None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:28.915320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f7546-3ac5-4f63-a39c-8f833689aceb None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:28.915622 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f7546-3ac5-4f63-a39c-8f833689aceb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:28.920747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-4a239db9-bc16-46e4-9be4-ff5a750c9b76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:28.920747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:28.920747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:28.920747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:28.920747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:28.920747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:28.920747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:28.920747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:28.920747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:28.920747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:28.920747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:28.920747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:28.920747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:28.920747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:28.920747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:28.921757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:28.921757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:28.921757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:28.921757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:28.921757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:28.921757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:28.921757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:28.921757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:28.921757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:28.921757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:28.921757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:28.921757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:28.921757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:28.921757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:28.921757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:28.921757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:28.921757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:28.922620 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:28.922620 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:28.922620 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:28.922620 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:28.922620 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 262/521] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:28.922888 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a239db9-bc16-46e4-9be4-ff5a750c9b76 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:28.927605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f7546-3ac5-4f63-a39c-8f833689aceb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:28.929114 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f7546-3ac5-4f63-a39c-8f833689aceb None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:28.945102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-807f7546-3ac5-4f63-a39c-8f833689aceb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 01:51:28.945102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:28.945102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:28.945102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:28.945102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:28.945102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:28.945102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:28.945102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:28.945102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:28.945102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:28.945102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:28.945102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:28.945102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:51:28.945102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:51:28.945102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:51:28.945102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:51:28.945986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:28.945986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:28.945986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:51:28.945986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:28.945986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:51:28.945986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:28.945986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:28.945986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:28.945986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:28.945986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:28.945986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:28.945986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:28.945986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:28.945986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:28.945986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:28.945986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:28.945986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:28.945986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:28.946883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:28.946883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:28.946883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:51:28.946883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:51:28.946883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:51:28.946883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:51:28.946883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:51:28.946883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:51:28.946883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 01:51:28.946883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:28.946883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 260/522] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 01:51:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:28.947459 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f7546-3ac5-4f63-a39c-8f833689aceb None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:29.025182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a239db9-bc16-46e4-9be4-ff5a750c9b76 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:29.048851 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f7546-3ac5-4f63-a39c-8f833689aceb None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:29.058684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9b330-31ef-434c-af9b-6a97c2907137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:29.059363 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9b330-31ef-434c-af9b-6a97c2907137 None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:29.059669 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9b330-31ef-434c-af9b-6a97c2907137 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:29.059947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9b330-31ef-434c-af9b-6a97c2907137 None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:29.060648 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9b330-31ef-434c-af9b-6a97c2907137 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:29.062409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9b330-31ef-434c-af9b-6a97c2907137 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:29.082631 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 263/523] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 01:51:28 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:51:29.083453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9b330-31ef-434c-af9b-6a97c2907137 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:29.083643 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a8e3a-d2fc-4a11-8105-78f1b9534d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:29.084285 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a8e3a-d2fc-4a11-8105-78f1b9534d82 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:29.084556 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a8e3a-d2fc-4a11-8105-78f1b9534d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:29.084862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a8e3a-d2fc-4a11-8105-78f1b9534d82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:29.100107 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:29.125723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:29.169713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a8e3a-d2fc-4a11-8105-78f1b9534d82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:29.171215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a8e3a-d2fc-4a11-8105-78f1b9534d82 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:29.209773 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9b330-31ef-434c-af9b-6a97c2907137 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:29.254742 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af1869-601e-4752-8f7d-7a13dfedc83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:29.255623 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af1869-601e-4752-8f7d-7a13dfedc83f None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:29.255908 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af1869-601e-4752-8f7d-7a13dfedc83f None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:29.256196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af1869-601e-4752-8f7d-7a13dfedc83f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:29.257030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af1869-601e-4752-8f7d-7a13dfedc83f None admin] RBAC: Adding query filter params (role.id=c8b68b76c1b44e549cc7520e5546d374, scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018, user.id=9d3b5180fb7144c394c39d4db28713b9) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:29.257343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af1869-601e-4752-8f7d-7a13dfedc83f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:29.258801 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af1869-601e-4752-8f7d-7a13dfedc83f None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:29.264778 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 264/524] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:51:29 2022] GET /identity/v3/role_assignments?user.id=9d3b5180fb7144c394c39d4db28713b9&scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018&role.id=c8b68b76c1b44e549cc7520e5546d374 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:29.266287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af1869-601e-4752-8f7d-7a13dfedc83f None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:29.289445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 261/525] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:51:29.290688 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a8e3a-d2fc-4a11-8105-78f1b9534d82 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:29.341528 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:29.399939 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:29.413212 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af1869-601e-4752-8f7d-7a13dfedc83f None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:29.422745 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a8e3a-d2fc-4a11-8105-78f1b9534d82 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:29.460291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6f0c5-42a1-4816-a550-f21d97e485c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:29.460649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6f0c5-42a1-4816-a550-f21d97e485c7 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:29.460941 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6f0c5-42a1-4816-a550-f21d97e485c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:29.461349 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6f0c5-42a1-4816-a550-f21d97e485c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:29.462086 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6f0c5-42a1-4816-a550-f21d97e485c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:29.462536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6f0c5-42a1-4816-a550-f21d97e485c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:29.475441 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6f0c5-42a1-4816-a550-f21d97e485c7 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:29.475627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cf7d4-7631-4392-895e-c7f37dd6bb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:29.475627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cf7d4-7631-4392-895e-c7f37dd6bb94 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:29.475627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cf7d4-7631-4392-895e-c7f37dd6bb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:29.475627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cf7d4-7631-4392-895e-c7f37dd6bb94 None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:29.475908 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752cf7d4-7631-4392-895e-c7f37dd6bb94 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:29.475908 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752cf7d4-7631-4392-895e-c7f37dd6bb94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:29.476997 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752cf7d4-7631-4392-895e-c7f37dd6bb94 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:29.483052 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 265/526] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:29.484037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6f0c5-42a1-4816-a550-f21d97e485c7 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:29.525550 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 262/527] 10.222.0.13 () {56 vars in 1139 bytes} [Thu Jun 23 01:51:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:29.526994 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cf7d4-7631-4392-895e-c7f37dd6bb94 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:29.597791 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6f0c5-42a1-4816-a550-f21d97e485c7 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:29.641046 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9274d80-27ab-42b3-99b3-7b012cd90b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:29.642030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9274d80-27ab-42b3-99b3-7b012cd90b53 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:29.642310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9274d80-27ab-42b3-99b3-7b012cd90b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:29.642581 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9274d80-27ab-42b3-99b3-7b012cd90b53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:29.650551 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:29.654257 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cf7d4-7631-4392-895e-c7f37dd6bb94 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:29.655199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9274d80-27ab-42b3-99b3-7b012cd90b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:29.657282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9274d80-27ab-42b3-99b3-7b012cd90b53 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:29.676204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-e9274d80-27ab-42b3-99b3-7b012cd90b53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:29.676204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:29.676204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:29.676204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:29.676204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:29.676204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:29.676204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:29.676204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:29.676204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:29.676204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:29.676204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:29.676204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:29.676204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:29.676204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:29.676204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:29.677116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:29.677116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:29.677116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:29.677116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:29.677116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:29.677116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:29.677116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:29.677116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:29.677116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:29.677116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:29.677116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:29.677116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:29.677116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:29.677116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:29.677116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:29.677116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:29.677116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:29.678200 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:29.678200 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:29.678200 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:29.678200 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:29.678200 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 266/528] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:29.678803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9274d80-27ab-42b3-99b3-7b012cd90b53 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:29.682467 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:29.698643 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274ca45-c1c8-4e8d-9626-877ebc71e2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:29.699856 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274ca45-c1c8-4e8d-9626-877ebc71e2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:29.700140 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274ca45-c1c8-4e8d-9626-877ebc71e2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:29.700418 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274ca45-c1c8-4e8d-9626-877ebc71e2c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:29.710289 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274ca45-c1c8-4e8d-9626-877ebc71e2c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:29.712763 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274ca45-c1c8-4e8d-9626-877ebc71e2c4 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:29.732125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-a274ca45-c1c8-4e8d-9626-877ebc71e2c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:29.732125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:29.732125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:29.732125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:29.732125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:29.732125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:29.732125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:29.732125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:29.732125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:29.732125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:29.732125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:29.732125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:29.732125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:51:29.732125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:51:29.732125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:51:29.734465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:51:29.734465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:29.734465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:29.734465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:29.734465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:29.734465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:29.734465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:29.734465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:29.734465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:29.734465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:29.734465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:29.734465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:29.734465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:29.734465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:29.734465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:29.734465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:29.734465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:29.736903 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:51:29.736903 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:51:29.736903 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:51:29.736903 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:51:29.736903 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:51:29.736903 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:51:29.736903 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:29.736903 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:29.736903 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 263/529] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:29.736903 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274ca45-c1c8-4e8d-9626-877ebc71e2c4 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:29.808894 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9274d80-27ab-42b3-99b3-7b012cd90b53 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:29.851618 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274ca45-c1c8-4e8d-9626-877ebc71e2c4 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:29.858938 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c23ff4-a392-4a0b-81f2-be8f4e1b6bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:29.860238 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c23ff4-a392-4a0b-81f2-be8f4e1b6bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:29.860586 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c23ff4-a392-4a0b-81f2-be8f4e1b6bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:29.860928 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c23ff4-a392-4a0b-81f2-be8f4e1b6bf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:29.890978 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560fd9e-c44b-485b-a357-140499bd93e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:29.891832 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560fd9e-c44b-485b-a357-140499bd93e4 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:29.892049 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560fd9e-c44b-485b-a357-140499bd93e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:29.892327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560fd9e-c44b-485b-a357-140499bd93e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:29.893070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560fd9e-c44b-485b-a357-140499bd93e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:29.893381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560fd9e-c44b-485b-a357-140499bd93e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:29.895472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560fd9e-c44b-485b-a357-140499bd93e4 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:29.913061 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 264/530] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:29.913061 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560fd9e-c44b-485b-a357-140499bd93e4 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:29.935256 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:29.952351 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c23ff4-a392-4a0b-81f2-be8f4e1b6bf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:29.954185 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c23ff4-a392-4a0b-81f2-be8f4e1b6bf3 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:29.957917 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:30.024615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560fd9e-c44b-485b-a357-140499bd93e4 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:30.061775 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b687b3-ef7e-4e82-beeb-465fa1a6af7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:30.062457 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b687b3-ef7e-4e82-beeb-465fa1a6af7c None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:30.062740 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b687b3-ef7e-4e82-beeb-465fa1a6af7c None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:30.063016 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b687b3-ef7e-4e82-beeb-465fa1a6af7c None admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:30.063850 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b687b3-ef7e-4e82-beeb-465fa1a6af7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:30.064165 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b687b3-ef7e-4e82-beeb-465fa1a6af7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:30.069407 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b687b3-ef7e-4e82-beeb-465fa1a6af7c None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:30.069927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 267/531] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:51:30.071035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c23ff4-a392-4a0b-81f2-be8f4e1b6bf3 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:30.083459 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 265/532] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:51:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:30.083459 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b687b3-ef7e-4e82-beeb-465fa1a6af7c None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:30.167689 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:30.187282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c23ff4-a392-4a0b-81f2-be8f4e1b6bf3 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:30.190808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:30.192733 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b687b3-ef7e-4e82-beeb-465fa1a6af7c None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:30.226568 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a2c79-6cd6-4b88-8d98-ebc00e4ada66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:30.227935 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a2c79-6cd6-4b88-8d98-ebc00e4ada66 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:30.228433 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a2c79-6cd6-4b88-8d98-ebc00e4ada66 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:30.228994 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a2c79-6cd6-4b88-8d98-ebc00e4ada66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:30.231986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981b9eb-a4fe-458e-9432-8d7311964016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:30.232884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981b9eb-a4fe-458e-9432-8d7311964016 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:30.233168 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981b9eb-a4fe-458e-9432-8d7311964016 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:30.233446 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981b9eb-a4fe-458e-9432-8d7311964016 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:30.237892 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a2c79-6cd6-4b88-8d98-ebc00e4ada66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:30.239755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a2c79-6cd6-4b88-8d98-ebc00e4ada66 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:30.245194 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981b9eb-a4fe-458e-9432-8d7311964016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:30.246663 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981b9eb-a4fe-458e-9432-8d7311964016 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:30.255278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-253a2c79-6cd6-4b88-8d98-ebc00e4ada66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:30.255278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:30.255278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:30.255278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:30.255278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:30.255278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:30.255278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:30.255278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:30.255278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:30.255278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:30.255278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:30.255278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:30.255278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:51:30.255278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:51:30.255278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:51:30.256190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:51:30.256190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:30.256190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:30.256190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:30.256190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:30.256190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:30.256190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:30.256190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:30.256190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:30.256190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:30.256190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:30.256190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:30.256190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:30.256190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:30.256190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:30.256190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:30.256190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:30.257032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:51:30.257032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:51:30.257032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:51:30.257032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:51:30.257032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:51:30.257032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:51:30.257032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:30.257032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:30.257032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 268/533] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:30.258070 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a2c79-6cd6-4b88-8d98-ebc00e4ada66 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:30.271600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-c981b9eb-a4fe-458e-9432-8d7311964016 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:30.271600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:30.271600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:30.271600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:30.271600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:30.271600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:30.271600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:30.271600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:30.271600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:30.271600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:30.271600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:30.271600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:30.271600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:30.271600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:30.271600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:30.272482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:30.272482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:30.272482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:30.272482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:30.272482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:30.272482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:30.272482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:30.272482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:30.272482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:30.272482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:30.272482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:30.272482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:30.272482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:30.272482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:30.272482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:30.272482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:30.272482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:30.273328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:30.273328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:30.273328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:30.273328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:30.273328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 266/534] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:30.275497 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981b9eb-a4fe-458e-9432-8d7311964016 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:30.369329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a2c79-6cd6-4b88-8d98-ebc00e4ada66 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:30.392898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981b9eb-a4fe-458e-9432-8d7311964016 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:30.403617 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7573ff7-bc67-40ee-a229-b60ff904a617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:30.404286 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7573ff7-bc67-40ee-a229-b60ff904a617 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:30.404569 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7573ff7-bc67-40ee-a229-b60ff904a617 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:30.404846 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7573ff7-bc67-40ee-a229-b60ff904a617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:30.405691 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7573ff7-bc67-40ee-a229-b60ff904a617 None admin] RBAC: Adding query filter params (role.id=c8b68b76c1b44e549cc7520e5546d374, scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018, user.id=883b947de43d4779b5f95103775430c6) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:30.406005 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7573ff7-bc67-40ee-a229-b60ff904a617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:30.407516 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7573ff7-bc67-40ee-a229-b60ff904a617 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:30.419728 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 269/535] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:51:30 2022] GET /identity/v3/role_assignments?user.id=883b947de43d4779b5f95103775430c6&scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018&role.id=c8b68b76c1b44e549cc7520e5546d374 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:30.420776 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7573ff7-bc67-40ee-a229-b60ff904a617 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:30.433457 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:30.441504 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692663f-ffbf-466d-b0af-5984a53e1478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:30.442536 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692663f-ffbf-466d-b0af-5984a53e1478 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:30.443008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692663f-ffbf-466d-b0af-5984a53e1478 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:30.443535 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692663f-ffbf-466d-b0af-5984a53e1478 None admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:30.444562 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692663f-ffbf-466d-b0af-5984a53e1478 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:30.445092 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692663f-ffbf-466d-b0af-5984a53e1478 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:30.446798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692663f-ffbf-466d-b0af-5984a53e1478 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:30.460841 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 267/536] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:51:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:30.471375 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692663f-ffbf-466d-b0af-5984a53e1478 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:30.477700 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:30.603694 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692663f-ffbf-466d-b0af-5984a53e1478 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:30.645878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679c7f6-b231-4126-b60f-0e12219db7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:30.646832 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679c7f6-b231-4126-b60f-0e12219db7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:30.647117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679c7f6-b231-4126-b60f-0e12219db7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:30.647399 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679c7f6-b231-4126-b60f-0e12219db7e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:30.648281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679c7f6-b231-4126-b60f-0e12219db7e8 None admin] RBAC: Adding query filter params (role.id=c8b68b76c1b44e549cc7520e5546d374, scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018, user.id=46aba36939c549278bcdee7a04511e27) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:30.648598 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679c7f6-b231-4126-b60f-0e12219db7e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:30.650187 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679c7f6-b231-4126-b60f-0e12219db7e8 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:30.657430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 268/537] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:51:30 2022] GET /identity/v3/role_assignments?user.id=46aba36939c549278bcdee7a04511e27&scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018&role.id=c8b68b76c1b44e549cc7520e5546d374 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:30.688276 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7573ff7-bc67-40ee-a229-b60ff904a617 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:30.745588 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7e9b3-514f-4e22-b6ee-143e7bbb724f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:30.746298 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7e9b3-514f-4e22-b6ee-143e7bbb724f None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:30.746576 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7e9b3-514f-4e22-b6ee-143e7bbb724f None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:30.746848 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7e9b3-514f-4e22-b6ee-143e7bbb724f None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:30.747617 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7e9b3-514f-4e22-b6ee-143e7bbb724f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:30.747931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7e9b3-514f-4e22-b6ee-143e7bbb724f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:30.749356 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7e9b3-514f-4e22-b6ee-143e7bbb724f None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:30.768035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 270/538] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:30.773453 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679c7f6-b231-4126-b60f-0e12219db7e8 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:30.853791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:30.926203 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679c7f6-b231-4126-b60f-0e12219db7e8 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:30.965507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d457e4-81bb-423b-b0cf-409ed2cf7727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:30.966684 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d457e4-81bb-423b-b0cf-409ed2cf7727 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:30.967161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d457e4-81bb-423b-b0cf-409ed2cf7727 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:30.967687 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d457e4-81bb-423b-b0cf-409ed2cf7727 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:30.975210 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d457e4-81bb-423b-b0cf-409ed2cf7727 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:30.977038 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d457e4-81bb-423b-b0cf-409ed2cf7727 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:30.992537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-a1d457e4-81bb-423b-b0cf-409ed2cf7727 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:30.992537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:30.992537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:30.992537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:30.992537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:30.992537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:30.992537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:30.992537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:30.992537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:30.992537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:30.992537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:30.992537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:30.992537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:51:30.992537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:51:30.992537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:51:30.993454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:51:30.993454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:30.993454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:30.993454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:30.993454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:30.993454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:30.993454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:30.993454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:30.993454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:30.993454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:30.993454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:30.993454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:30.993454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:30.993454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:30.993454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:30.993454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:30.993454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:30.994328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:51:30.994328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:51:30.994328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:51:30.994328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:51:30.994328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:51:30.994328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:51:30.994328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:30.994328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:30.996866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 269/539] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:31.002175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7e9b3-514f-4e22-b6ee-143e7bbb724f None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:31.096161 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:31.110148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7e9b3-514f-4e22-b6ee-143e7bbb724f None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:31.146084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf085f8-7543-4467-8be6-aa46c63fe19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:31.147102 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf085f8-7543-4467-8be6-aa46c63fe19f None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:31.147611 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf085f8-7543-4467-8be6-aa46c63fe19f None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:31.148104 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf085f8-7543-4467-8be6-aa46c63fe19f None admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:31.149091 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf085f8-7543-4467-8be6-aa46c63fe19f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:31.149591 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf085f8-7543-4467-8be6-aa46c63fe19f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:31.151232 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf085f8-7543-4467-8be6-aa46c63fe19f None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:31.171079 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 271/540] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:51:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:51:31.180554 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d457e4-81bb-423b-b0cf-409ed2cf7727 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:31.280234 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7e393-5966-4c4c-b4e1-9e6ef88e5ec8 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:31.280865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7e393-5966-4c4c-b4e1-9e6ef88e5ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:31.281336 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7e393-5966-4c4c-b4e1-9e6ef88e5ec8 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:31.283601 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 272/541] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:31.288682 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359e659-a4ad-4a55-9079-7db53daf9f3d None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:31.289219 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359e659-a4ad-4a55-9079-7db53daf9f3d None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:31.289687 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359e659-a4ad-4a55-9079-7db53daf9f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:31.318917 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-1359e659-a4ad-4a55-9079-7db53daf9f3d None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:31.320516 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-1359e659-a4ad-4a55-9079-7db53daf9f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:31.341523 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d457e4-81bb-423b-b0cf-409ed2cf7727 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:31.372109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:31.410782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de24a6-d3f9-4faf-8467-812a69e4f0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:31.412831 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de24a6-d3f9-4faf-8467-812a69e4f0cf None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:31.413125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de24a6-d3f9-4faf-8467-812a69e4f0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:31.413404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de24a6-d3f9-4faf-8467-812a69e4f0cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:31.414255 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de24a6-d3f9-4faf-8467-812a69e4f0cf None admin] RBAC: Adding query filter params (role.id=c8b68b76c1b44e549cc7520e5546d374, scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018, user.id=8cda12550db1442ab04f30b9875fdbea) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:31.414569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de24a6-d3f9-4faf-8467-812a69e4f0cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:31.416042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de24a6-d3f9-4faf-8467-812a69e4f0cf None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:31.420329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 273/542] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:31.430444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 270/543] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:51:31 2022] GET /identity/v3/role_assignments?user.id=8cda12550db1442ab04f30b9875fdbea&scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018&role.id=c8b68b76c1b44e549cc7520e5546d374 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:31.436453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ddcf9-6b0f-499c-bd68-dd70bc3b512a None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:31.436766 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ddcf9-6b0f-499c-bd68-dd70bc3b512a None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:31.437011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ddcf9-6b0f-499c-bd68-dd70bc3b512a None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:31.438630 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 274/544] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:31.445020 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de24a6-d3f9-4faf-8467-812a69e4f0cf None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:31.452447 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32324cc0-6032-4a0a-8a26-14daa0ad3018 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:31.452756 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32324cc0-6032-4a0a-8a26-14daa0ad3018 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:31.453010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32324cc0-6032-4a0a-8a26-14daa0ad3018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:31.481784 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-32324cc0-6032-4a0a-8a26-14daa0ad3018 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:31.483025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-32324cc0-6032-4a0a-8a26-14daa0ad3018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:31.619859 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 275/545] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:51:31.636784 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de24a6-d3f9-4faf-8467-812a69e4f0cf None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:31.643545 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32324cc0-6032-4a0a-8a26-14daa0ad3018 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:31.656124 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:31.679319 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20974f-7c5a-4128-999a-89a089cee7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:31.680940 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20974f-7c5a-4128-999a-89a089cee7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:31.681221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20974f-7c5a-4128-999a-89a089cee7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:31.681495 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20974f-7c5a-4128-999a-89a089cee7d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:31.709611 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20974f-7c5a-4128-999a-89a089cee7d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:31.717863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-8a20974f-7c5a-4128-999a-89a089cee7d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:31.717863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:31.717863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:31.717863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:31.717863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:31.717863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:31.717863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:31.717863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:31.717863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:31.717863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:31.717863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:31.717863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:31.717863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:31.717863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:31.717863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:31.717863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:31.718936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:31.718936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:31.718936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:31.718936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:31.718936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:31.718936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:31.718936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:31.718936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:31.718936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:31.718936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:31.718936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:31.718936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:31.718936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:31.718936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:31.718936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:31.718936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:31.719943 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:31.719943 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:31.719943 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:31.719943 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:31.719943 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:31.719943 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:31.719943 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:31.719943 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:31.719943 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:31.719943 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:31.719943 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:31.719943 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:31.723443 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 271/546] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 01:51:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:31.727545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20974f-7c5a-4128-999a-89a089cee7d5 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:31.825031 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:31.841153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32324cc0-6032-4a0a-8a26-14daa0ad3018 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:31.899908 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18faae-40dc-4aec-a862-8515ab8ba25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:31.901274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18faae-40dc-4aec-a862-8515ab8ba25c None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:31.901696 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18faae-40dc-4aec-a862-8515ab8ba25c None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:31.902115 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18faae-40dc-4aec-a862-8515ab8ba25c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:31.914565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18faae-40dc-4aec-a862-8515ab8ba25c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:31.923716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-de18faae-40dc-4aec-a862-8515ab8ba25c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:31.923716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:31.923716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:31.923716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:31.923716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:31.923716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:31.923716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:31.923716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:31.923716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:31.923716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:31.923716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:31.923716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:31.923716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:31.923716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:31.923716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:31.923716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:31.924798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:31.924798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:31.924798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:31.924798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:31.924798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:31.924798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:31.924798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:31.924798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:31.924798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:31.924798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:31.924798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:31.924798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:31.924798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:31.924798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:31.924798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:31.924798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:31.925715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:31.925715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:31.925715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:31.925715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:31.925715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:31.925715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:31.925715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:31.925715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:31.925715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:31.925715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:31.925715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:31.925715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:31.928961 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 276/547] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 01:51:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:31.933871 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18faae-40dc-4aec-a862-8515ab8ba25c None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:31.946806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20974f-7c5a-4128-999a-89a089cee7d5 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:32.024361 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd686120-6175-4934-980e-8047eb24af44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:32.024361 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd686120-6175-4934-980e-8047eb24af44 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:32.024361 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd686120-6175-4934-980e-8047eb24af44 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:32.024361 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd686120-6175-4934-980e-8047eb24af44 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:32.024772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd686120-6175-4934-980e-8047eb24af44 None admin] RBAC: Adding query filter params (name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:32.024772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd686120-6175-4934-980e-8047eb24af44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:32.024772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd686120-6175-4934-980e-8047eb24af44 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:32.041376 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 272/548] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 01:51:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:32.046549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd686120-6175-4934-980e-8047eb24af44 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:32.059160 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:32.120543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18faae-40dc-4aec-a862-8515ab8ba25c None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:32.165861 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea599c0-ee3d-462b-8ea1-8fb0849fa418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:32.166458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea599c0-ee3d-462b-8ea1-8fb0849fa418 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:32.167269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea599c0-ee3d-462b-8ea1-8fb0849fa418 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:32.167599 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea599c0-ee3d-462b-8ea1-8fb0849fa418 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:32.168356 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea599c0-ee3d-462b-8ea1-8fb0849fa418 None admin] RBAC: Adding query filter params (name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:32.168674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea599c0-ee3d-462b-8ea1-8fb0849fa418 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:32.170221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea599c0-ee3d-462b-8ea1-8fb0849fa418 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:32.179829 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 277/549] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 01:51:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:51:32.186082 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea599c0-ee3d-462b-8ea1-8fb0849fa418 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:32.229416 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd686120-6175-4934-980e-8047eb24af44 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:32.231993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:32.290297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c944596-ef90-4d57-81ed-5a6d99b7ca47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:32.291447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c944596-ef90-4d57-81ed-5a6d99b7ca47 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:32.291924 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c944596-ef90-4d57-81ed-5a6d99b7ca47 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:32.292345 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c944596-ef90-4d57-81ed-5a6d99b7ca47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:32.316338 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c944596-ef90-4d57-81ed-5a6d99b7ca47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:32.318070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c944596-ef90-4d57-81ed-5a6d99b7ca47 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:32.335919 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea599c0-ee3d-462b-8ea1-8fb0849fa418 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:32.356738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-7c944596-ef90-4d57-81ed-5a6d99b7ca47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:32.356738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:32.356738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:32.356738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:32.356738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:32.356738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:32.356738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:32.356738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:32.356738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:32.356738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:32.356738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:32.356738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:32.356738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:32.356738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:32.356738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:32.358320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:32.358320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:32.358320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:32.358320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:32.358320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:32.358320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:32.358320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:32.358320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:32.358320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:32.358320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:32.358320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:32.358320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:32.358320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:32.358320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:32.358320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:32.358320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:32.358320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:32.359563 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:32.359563 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:32.359563 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:32.359563 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:32.361478 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 273/550] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:51:32.371439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:32.371686 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c944596-ef90-4d57-81ed-5a6d99b7ca47 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:32.382231 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a9c15-98a3-4baa-85d9-d6bc62eac59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:32.383019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a9c15-98a3-4baa-85d9-d6bc62eac59f None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:32.383295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a9c15-98a3-4baa-85d9-d6bc62eac59f None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:32.383587 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a9c15-98a3-4baa-85d9-d6bc62eac59f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:32.402828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a9c15-98a3-4baa-85d9-d6bc62eac59f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:32.404482 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a9c15-98a3-4baa-85d9-d6bc62eac59f None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:32.445235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-e97a9c15-98a3-4baa-85d9-d6bc62eac59f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:32.445235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:32.445235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:32.445235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:32.445235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:32.445235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:32.445235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:32.445235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:32.445235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:32.445235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:32.445235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:32.445235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:32.445235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:32.445235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:32.445235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:32.446543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:32.446543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:32.446543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:32.446543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:32.446543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:32.446543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:32.446543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:32.446543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:32.446543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:32.446543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:32.446543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:32.446543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:32.446543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:32.446543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:32.446543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:32.446543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:32.446543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:32.447398 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:32.447398 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:32.447398 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:32.447398 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:32.451997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 278/551] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:32.452916 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a9c15-98a3-4baa-85d9-d6bc62eac59f None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:32.537486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c944596-ef90-4d57-81ed-5a6d99b7ca47 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:32.587856 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d4a95-d228-4704-a983-ca8abfe3969e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:32.588560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d4a95-d228-4704-a983-ca8abfe3969e None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:32.588837 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d4a95-d228-4704-a983-ca8abfe3969e None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:32.589106 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d4a95-d228-4704-a983-ca8abfe3969e None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:32.589847 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d4a95-d228-4704-a983-ca8abfe3969e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:32.590227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d4a95-d228-4704-a983-ca8abfe3969e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:32.591799 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d4a95-d228-4704-a983-ca8abfe3969e None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:32.616484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 274/552] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:51:32.624824 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d4a95-d228-4704-a983-ca8abfe3969e None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:32.640072 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a9c15-98a3-4baa-85d9-d6bc62eac59f None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:32.655975 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:32.707523 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8eccc1-2eac-4298-b215-2dcb49dff68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:32.708123 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8eccc1-2eac-4298-b215-2dcb49dff68e None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:32.708408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8eccc1-2eac-4298-b215-2dcb49dff68e None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:32.708684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8eccc1-2eac-4298-b215-2dcb49dff68e None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:32.709421 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8eccc1-2eac-4298-b215-2dcb49dff68e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:32.709729 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8eccc1-2eac-4298-b215-2dcb49dff68e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:32.714791 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8eccc1-2eac-4298-b215-2dcb49dff68e None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:32.742851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 279/553] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:32.748243 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8eccc1-2eac-4298-b215-2dcb49dff68e None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:32.789943 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d4a95-d228-4704-a983-ca8abfe3969e None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:32.811658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:32.826842 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199f094-f9ba-4b80-ba7d-9feeef06e7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:32.828047 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199f094-f9ba-4b80-ba7d-9feeef06e7fc None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:32.828765 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199f094-f9ba-4b80-ba7d-9feeef06e7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:32.829233 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199f094-f9ba-4b80-ba7d-9feeef06e7fc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:32.838342 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199f094-f9ba-4b80-ba7d-9feeef06e7fc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:32.840102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199f094-f9ba-4b80-ba7d-9feeef06e7fc None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:32.857360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-a199f094-f9ba-4b80-ba7d-9feeef06e7fc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 01:51:32.857360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:32.857360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:32.857360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:32.857360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:32.857360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:32.857360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:32.857360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:32.857360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:32.857360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:32.857360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:32.857360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:32.857360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:51:32.857360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:51:32.857360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:51:32.857360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:51:32.858426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:32.858426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:32.858426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:51:32.858426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:32.858426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:51:32.858426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:32.858426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:32.858426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:32.858426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:32.858426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:32.858426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:32.858426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:32.858426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:32.858426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:32.858426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:32.858426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:32.858426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:32.858426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:32.859355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:32.859355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:32.859355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:51:32.859355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:51:32.859355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:51:32.859355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:51:32.859355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:51:32.859355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:51:32.859355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 01:51:32.859355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:32.862312 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 275/554] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:51:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:32.868609 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199f094-f9ba-4b80-ba7d-9feeef06e7fc None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:32.950515 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:32.977735 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8eccc1-2eac-4298-b215-2dcb49dff68e None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:32.981312 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199f094-f9ba-4b80-ba7d-9feeef06e7fc None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:33.013117 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda3f3d-2dc6-4c30-b080-e05743192c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:33.014020 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda3f3d-2dc6-4c30-b080-e05743192c2b None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:33.014351 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda3f3d-2dc6-4c30-b080-e05743192c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:33.014631 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda3f3d-2dc6-4c30-b080-e05743192c2b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:33.021796 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171f761-b8df-4b86-a1aa-6b176da56b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:33.022492 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171f761-b8df-4b86-a1aa-6b176da56b11 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:33.022986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171f761-b8df-4b86-a1aa-6b176da56b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:33.023174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda3f3d-2dc6-4c30-b080-e05743192c2b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:33.023301 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171f761-b8df-4b86-a1aa-6b176da56b11 None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:33.024127 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171f761-b8df-4b86-a1aa-6b176da56b11 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:33.024437 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171f761-b8df-4b86-a1aa-6b176da56b11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:33.024672 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda3f3d-2dc6-4c30-b080-e05743192c2b None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:33.025880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171f761-b8df-4b86-a1aa-6b176da56b11 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:33.040180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-1fda3f3d-2dc6-4c30-b080-e05743192c2b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 01:51:33.040180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:33.040180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:33.040180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:33.040180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:33.040180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:33.040180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:33.040180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:33.040180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:33.040180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:33.040180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:33.040180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:33.040180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:51:33.040180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:51:33.040180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:51:33.040180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:51:33.041182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:33.041182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:33.041182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:51:33.041182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:33.041182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:51:33.041182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:33.041182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:33.041182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:33.041182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:33.041182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:33.041182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:33.041182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:33.041182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:33.041182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:33.041182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:33.041182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:33.041182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:33.041182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:33.043063 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:33.043063 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:33.043063 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:51:33.043063 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:51:33.043063 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:51:33.043063 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:51:33.043063 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:51:33.043063 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:51:33.043063 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 01:51:33.043063 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:33.043063 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 280/555] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 23 01:51:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:33.043063 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062654a-4a58-457a-b40e-ca4c41f72078 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:33.043063 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062654a-4a58-457a-b40e-ca4c41f72078 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:33.044514 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062654a-4a58-457a-b40e-ca4c41f72078 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:33.044514 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 281/556] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:33.051579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd4870-b9d1-4d9d-a245-9a1c28923dee None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:33.051579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd4870-b9d1-4d9d-a245-9a1c28923dee None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:33.051579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd4870-b9d1-4d9d-a245-9a1c28923dee None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:33.051579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 282/557] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:33.051579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd4870-b9d1-4d9d-a245-9a1c28923dee None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:33.053685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 276/558] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Jun 23 01:51:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:33.054981 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447518e-00d0-4d92-bab7-b6fb4ec51ac5 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:33.055267 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447518e-00d0-4d92-bab7-b6fb4ec51ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:33.059909 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447518e-00d0-4d92-bab7-b6fb4ec51ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:33.076556 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-7447518e-00d0-4d92-bab7-b6fb4ec51ac5 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:33.077749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-7447518e-00d0-4d92-bab7-b6fb4ec51ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:33.147378 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 277/559] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:33.148972 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5d8b8-c8ff-4bcb-a4d5-ae3d86767eb7 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:33.149438 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5d8b8-c8ff-4bcb-a4d5-ae3d86767eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:33.149891 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5d8b8-c8ff-4bcb-a4d5-ae3d86767eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:33.166619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd4870-b9d1-4d9d-a245-9a1c28923dee None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:33.167845 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-25c5d8b8-c8ff-4bcb-a4d5-ae3d86767eb7 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:33.169270 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-25c5d8b8-c8ff-4bcb-a4d5-ae3d86767eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:33.175592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:33.206640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc4b67-b277-441b-83dc-bba53a7750c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:33.207441 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc4b67-b277-441b-83dc-bba53a7750c9 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:33.208391 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc4b67-b277-441b-83dc-bba53a7750c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:33.208391 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc4b67-b277-441b-83dc-bba53a7750c9 None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:33.208803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc4b67-b277-441b-83dc-bba53a7750c9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:33.209112 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc4b67-b277-441b-83dc-bba53a7750c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:33.210588 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc4b67-b277-441b-83dc-bba53a7750c9 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:33.234401 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 283/560] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 23 01:51:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:33.234401 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc4b67-b277-441b-83dc-bba53a7750c9 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:33.239592 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:33.249241 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 278/561] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:33.250070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5d8b8-c8ff-4bcb-a4d5-ae3d86767eb7 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:33.354435 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5d8b8-c8ff-4bcb-a4d5-ae3d86767eb7 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:33.356108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc4b67-b277-441b-83dc-bba53a7750c9 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:33.390537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028ae3e-43f1-4f7e-adb2-0bd3013fa890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:33.391349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028ae3e-43f1-4f7e-adb2-0bd3013fa890 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:33.391661 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028ae3e-43f1-4f7e-adb2-0bd3013fa890 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:33.391931 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028ae3e-43f1-4f7e-adb2-0bd3013fa890 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:33.392495 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293d747-afc4-4d01-93e4-a1ea0f2442a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:33.393153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293d747-afc4-4d01-93e4-a1ea0f2442a8 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:33.393437 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293d747-afc4-4d01-93e4-a1ea0f2442a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:33.393823 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293d747-afc4-4d01-93e4-a1ea0f2442a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:33.402751 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028ae3e-43f1-4f7e-adb2-0bd3013fa890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:33.410759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-6028ae3e-43f1-4f7e-adb2-0bd3013fa890 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:33.410759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:33.410759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:33.410759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:33.410759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:33.410759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:33.410759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:33.410759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:33.410759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:33.410759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:33.410759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:33.410759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:33.410759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:33.410759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:33.410759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:33.410759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:33.411755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:33.411755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:33.411755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:33.411755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:33.411755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:33.411755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:33.411755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:33.411755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:33.411755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:33.411755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:33.411755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:33.411755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:33.411755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:33.411755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:33.411755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:33.411755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:33.412621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:33.412621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:33.412621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:33.412621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:33.412621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:33.412621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:33.412621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:33.412621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:33.412621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:33.412621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:33.412621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:33.412621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:33.416856 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 279/562] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 01:51:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:33.417698 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028ae3e-43f1-4f7e-adb2-0bd3013fa890 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:33.429146 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:33.473785 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293d747-afc4-4d01-93e4-a1ea0f2442a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:33.475264 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293d747-afc4-4d01-93e4-a1ea0f2442a8 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:33.475403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:33.529058 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028ae3e-43f1-4f7e-adb2-0bd3013fa890 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:33.567829 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c7a44-19fe-4f6b-8a02-b6b1adda315a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:33.568793 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c7a44-19fe-4f6b-8a02-b6b1adda315a None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:33.569222 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c7a44-19fe-4f6b-8a02-b6b1adda315a None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:33.569487 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c7a44-19fe-4f6b-8a02-b6b1adda315a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:33.580941 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c7a44-19fe-4f6b-8a02-b6b1adda315a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:33.583026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c7a44-19fe-4f6b-8a02-b6b1adda315a None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:33.589979 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 284/563] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:51:33.591109 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293d747-afc4-4d01-93e4-a1ea0f2442a8 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:33.606560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-394c7a44-19fe-4f6b-8a02-b6b1adda315a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:33.606560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:33.606560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:33.606560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:33.606560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:33.606560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:33.606560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:33.606560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:33.606560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:33.606560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:33.606560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:33.606560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:33.606560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:33.606560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:33.606560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:33.607526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:33.607526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:33.607526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:33.607526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:33.607526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:33.607526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:33.607526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:33.607526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:33.607526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:33.607526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:33.607526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:33.607526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:33.607526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:33.607526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:33.607526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:33.607526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:33.607526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:33.608452 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:33.608452 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:33.608452 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:33.608452 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:33.608452 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 280/564] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:33.608727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c7a44-19fe-4f6b-8a02-b6b1adda315a None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:33.661214 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:33.704734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293d747-afc4-4d01-93e4-a1ea0f2442a8 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:33.718197 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c7a44-19fe-4f6b-8a02-b6b1adda315a None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:33.720534 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:33.742343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b774e-ae32-42f8-9212-6d08ee469bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:33.743150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b774e-ae32-42f8-9212-6d08ee469bbe None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:33.743455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b774e-ae32-42f8-9212-6d08ee469bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:33.743990 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b774e-ae32-42f8-9212-6d08ee469bbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:33.754311 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8159c90-8bab-421c-88cc-4c8a00a62f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:33.755014 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8159c90-8bab-421c-88cc-4c8a00a62f60 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:33.755152 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b774e-ae32-42f8-9212-6d08ee469bbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:33.755321 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8159c90-8bab-421c-88cc-4c8a00a62f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:33.755594 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8159c90-8bab-421c-88cc-4c8a00a62f60 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:33.756447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8159c90-8bab-421c-88cc-4c8a00a62f60 None admin] RBAC: Adding query filter params (name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:33.756755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8159c90-8bab-421c-88cc-4c8a00a62f60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:33.758133 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8159c90-8bab-421c-88cc-4c8a00a62f60 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:33.763011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-e03b774e-ae32-42f8-9212-6d08ee469bbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:33.763011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:33.763011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:33.763011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:33.763011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:33.763011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:33.763011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:33.763011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:33.763011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:33.763011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:33.763011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:33.763011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:33.763011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:33.763011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:33.763011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:33.763011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:33.764001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:33.764001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:33.764001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:33.764001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:33.764001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:33.764001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:33.764001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:33.764001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:33.764001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:33.764001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:33.764001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:33.764001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:33.764001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:33.764001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:33.764001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:33.764001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:33.764853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:33.764853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:33.764853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:33.764853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:33.764853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:33.764853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:33.764853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:33.764853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:33.764853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:33.764853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:33.764853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:33.764853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:33.764853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 285/565] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 01:51:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:33.765556 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b774e-ae32-42f8-9212-6d08ee469bbe None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:33.777699 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 281/566] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 01:51:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:33.777699 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8159c90-8bab-421c-88cc-4c8a00a62f60 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:33.877187 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b774e-ae32-42f8-9212-6d08ee469bbe None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:33.877755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8159c90-8bab-421c-88cc-4c8a00a62f60 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:33.896957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:33.912104 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c4665-1920-45ef-9598-3a1017f38af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:33.912908 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c4665-1920-45ef-9598-3a1017f38af1 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:33.913177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c4665-1920-45ef-9598-3a1017f38af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:33.913448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c4665-1920-45ef-9598-3a1017f38af1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:33.914655 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ec2cc-fe25-47d2-8b75-bed613a8e88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:33.915327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ec2cc-fe25-47d2-8b75-bed613a8e88c None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:33.915636 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ec2cc-fe25-47d2-8b75-bed613a8e88c None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:33.915910 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ec2cc-fe25-47d2-8b75-bed613a8e88c None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:33.916632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ec2cc-fe25-47d2-8b75-bed613a8e88c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:33.916936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ec2cc-fe25-47d2-8b75-bed613a8e88c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:33.918298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ec2cc-fe25-47d2-8b75-bed613a8e88c None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:33.924419 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c4665-1920-45ef-9598-3a1017f38af1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:33.926168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c4665-1920-45ef-9598-3a1017f38af1 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:33.931348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 282/567] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:33.932193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ec2cc-fe25-47d2-8b75-bed613a8e88c None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:33.944081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-523c4665-1920-45ef-9598-3a1017f38af1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:33.944081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:33.944081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:33.944081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:33.944081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:33.944081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:33.944081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:33.944081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:33.944081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:33.944081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:33.944081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:33.944081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:33.944081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:33.944081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:33.944081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:33.945157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:33.945157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:33.945157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:33.945157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:33.945157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:33.945157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:33.945157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:33.945157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:33.945157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:33.945157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:33.945157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:33.945157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:33.945157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:33.945157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:33.945157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:33.945157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:33.945157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:33.947465 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:33.947465 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:33.947465 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:33.947465 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:33.947465 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 286/568] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:33.947465 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c4665-1920-45ef-9598-3a1017f38af1 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:33.965990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:34.037370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ec2cc-fe25-47d2-8b75-bed613a8e88c None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:34.052047 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c4665-1920-45ef-9598-3a1017f38af1 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:34.071494 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15532089-f478-483a-a991-84cc69726678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:34.072192 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15532089-f478-483a-a991-84cc69726678 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:34.072505 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15532089-f478-483a-a991-84cc69726678 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:34.072783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15532089-f478-483a-a991-84cc69726678 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:34.073537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15532089-f478-483a-a991-84cc69726678 None admin] RBAC: Adding query filter params (name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:34.073846 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15532089-f478-483a-a991-84cc69726678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:34.075225 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15532089-f478-483a-a991-84cc69726678 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:34.083192 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 283/569] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 01:51:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:34.084504 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05982422-fe47-413c-967a-aa07a03de8bb None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:34.084793 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05982422-fe47-413c-967a-aa07a03de8bb None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:34.085068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05982422-fe47-413c-967a-aa07a03de8bb None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:34.085873 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a817c-baf4-4e27-a30e-1516ce3aa96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:34.087591 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 284/570] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:34.087760 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a817c-baf4-4e27-a30e-1516ce3aa96f None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:34.087760 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a817c-baf4-4e27-a30e-1516ce3aa96f None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:34.087911 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05982422-fe47-413c-967a-aa07a03de8bb None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:34.087985 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a817c-baf4-4e27-a30e-1516ce3aa96f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:34.100951 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a817c-baf4-4e27-a30e-1516ce3aa96f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:34.102401 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a817c-baf4-4e27-a30e-1516ce3aa96f None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:34.119429 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-7b3a817c-baf4-4e27-a30e-1516ce3aa96f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:34.119429 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:34.119429 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:34.119429 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:34.119429 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:34.119429 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:34.119429 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:34.119429 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:34.119429 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:34.119429 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:34.119429 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:34.119429 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:34.119429 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:34.119429 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:34.119429 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:34.120462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:34.120462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:34.120462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:34.120462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:34.120462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:34.120462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:34.120462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:34.120462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:34.120462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:34.120462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:34.120462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:34.120462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:34.120462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:34.120462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:34.120462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:34.120462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:34.120462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:34.121411 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:34.121411 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:34.121411 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:34.121411 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:34.121411 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 287/571] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:34.121691 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a817c-baf4-4e27-a30e-1516ce3aa96f None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:34.146569 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:34.184050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:34.197074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05982422-fe47-413c-967a-aa07a03de8bb None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:34.219863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a817c-baf4-4e27-a30e-1516ce3aa96f None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:34.229219 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5903b14-a7f8-4993-afe4-ed76d62422c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:34.230053 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5903b14-a7f8-4993-afe4-ed76d62422c9 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:34.230332 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5903b14-a7f8-4993-afe4-ed76d62422c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:34.230606 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5903b14-a7f8-4993-afe4-ed76d62422c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:34.237480 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5903b14-a7f8-4993-afe4-ed76d62422c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:34.239060 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5903b14-a7f8-4993-afe4-ed76d62422c9 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:34.252938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-d5903b14-a7f8-4993-afe4-ed76d62422c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:34.252938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:34.252938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:34.252938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:34.252938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:34.252938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:34.252938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:34.252938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:34.252938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:34.252938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:34.252938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:34.252938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:34.252938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:51:34.252938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:51:34.252938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:51:34.254162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:51:34.254162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:34.254162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:34.254162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:34.254162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:34.254162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:34.254162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:34.254162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:34.254162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:34.254162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:34.254162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:34.254162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:34.254162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:34.254162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:34.254162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:34.254162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:34.254162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:34.255248 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:51:34.255248 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:51:34.255248 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:51:34.255248 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:51:34.255248 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:51:34.255248 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:51:34.255248 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:34.255248 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:34.255803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f88f0f-749f-4447-8b4d-e768898d16e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:34.255904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 285/572] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:34.255904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5903b14-a7f8-4993-afe4-ed76d62422c9 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:34.256049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f88f0f-749f-4447-8b4d-e768898d16e8 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:34.256311 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f88f0f-749f-4447-8b4d-e768898d16e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:34.256594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f88f0f-749f-4447-8b4d-e768898d16e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:34.257312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f88f0f-749f-4447-8b4d-e768898d16e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:34.257620 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f88f0f-749f-4447-8b4d-e768898d16e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:34.259009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f88f0f-749f-4447-8b4d-e768898d16e8 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:34.270827 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 288/573] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:34.272084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cfdea-16de-406b-a3d6-85705efcee90 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:34.272367 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cfdea-16de-406b-a3d6-85705efcee90 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:34.272670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cfdea-16de-406b-a3d6-85705efcee90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:34.288495 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-f07cfdea-16de-406b-a3d6-85705efcee90 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:34.289686 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-f07cfdea-16de-406b-a3d6-85705efcee90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:34.355216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5903b14-a7f8-4993-afe4-ed76d62422c9 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:34.356162 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 289/574] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:34.357095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cfdea-16de-406b-a3d6-85705efcee90 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:34.377151 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:34.390015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b459f3b-bdff-4045-b22c-9fbdd08cdc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:34.390825 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b459f3b-bdff-4045-b22c-9fbdd08cdc19 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:34.391107 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b459f3b-bdff-4045-b22c-9fbdd08cdc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:34.391382 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b459f3b-bdff-4045-b22c-9fbdd08cdc19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:34.402557 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b459f3b-bdff-4045-b22c-9fbdd08cdc19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:34.403979 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b459f3b-bdff-4045-b22c-9fbdd08cdc19 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:34.412518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:34.422610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-3b459f3b-bdff-4045-b22c-9fbdd08cdc19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:34.422610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:34.422610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:34.422610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:34.422610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:34.422610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:34.422610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:34.422610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:34.422610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:34.422610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:34.422610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:34.422610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:34.422610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:34.422610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:34.422610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:34.423672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:34.423672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:34.423672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:34.423672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:34.423672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:34.423672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:34.423672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:34.423672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:34.423672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:34.423672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:34.423672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:34.423672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:34.423672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:34.423672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:34.423672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:34.423672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:34.423672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:34.424755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:34.424755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:34.424755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:34.424755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:34.428787 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 286/575] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:34.429609 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b459f3b-bdff-4045-b22c-9fbdd08cdc19 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:34.463960 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cfdea-16de-406b-a3d6-85705efcee90 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:34.498042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ad669-ae1b-4eb7-b554-8c53e98eebaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:34.498702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ad669-ae1b-4eb7-b554-8c53e98eebaf None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:34.498983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ad669-ae1b-4eb7-b554-8c53e98eebaf None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:34.499255 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ad669-ae1b-4eb7-b554-8c53e98eebaf None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:34.500017 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ad669-ae1b-4eb7-b554-8c53e98eebaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:34.500324 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ad669-ae1b-4eb7-b554-8c53e98eebaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:34.501717 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ad669-ae1b-4eb7-b554-8c53e98eebaf None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:34.513236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 290/576] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:34.513848 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ad669-ae1b-4eb7-b554-8c53e98eebaf None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:34.533332 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b459f3b-bdff-4045-b22c-9fbdd08cdc19 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:34.567578 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad12fab-775f-41b6-ab3c-af94045db77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:34.568246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad12fab-775f-41b6-ab3c-af94045db77f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:34.568532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad12fab-775f-41b6-ab3c-af94045db77f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:34.568811 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad12fab-775f-41b6-ab3c-af94045db77f None admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:34.569608 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad12fab-775f-41b6-ab3c-af94045db77f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:34.569921 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad12fab-775f-41b6-ab3c-af94045db77f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:34.571372 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad12fab-775f-41b6-ab3c-af94045db77f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:34.583695 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 287/577] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:51:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:34.584326 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad12fab-775f-41b6-ab3c-af94045db77f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:34.589702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:34.615642 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ad669-ae1b-4eb7-b554-8c53e98eebaf None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:34.644413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:34.649360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5958f4-e70f-461f-8058-fa8d8293cf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:34.650161 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5958f4-e70f-461f-8058-fa8d8293cf38 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:34.650443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5958f4-e70f-461f-8058-fa8d8293cf38 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:34.650718 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5958f4-e70f-461f-8058-fa8d8293cf38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:34.657446 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5958f4-e70f-461f-8058-fa8d8293cf38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:34.658842 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5958f4-e70f-461f-8058-fa8d8293cf38 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:34.672912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-ed5958f4-e70f-461f-8058-fa8d8293cf38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:34.672912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:34.672912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:34.672912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:34.672912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:34.672912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:34.672912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:34.672912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:34.672912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:34.672912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:34.672912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:34.672912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:34.672912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:51:34.672912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:51:34.672912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:51:34.673876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:51:34.673876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:34.673876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:34.673876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:34.673876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:34.673876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:34.673876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:34.673876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:34.673876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:34.673876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:34.673876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:34.673876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:34.673876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:34.673876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:34.673876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:34.673876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:34.673876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:34.674766 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:51:34.674766 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:51:34.674766 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:51:34.674766 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:51:34.674766 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:51:34.674766 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:51:34.674766 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:34.674766 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:34.675785 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 291/578] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:34.676764 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5958f4-e70f-461f-8058-fa8d8293cf38 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:34.684808 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad12fab-775f-41b6-ab3c-af94045db77f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:34.720073 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cb862-76a9-49cb-a80f-c2ece5bddcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:34.720878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cb862-76a9-49cb-a80f-c2ece5bddcfa None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:34.721155 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cb862-76a9-49cb-a80f-c2ece5bddcfa None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:34.721423 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cb862-76a9-49cb-a80f-c2ece5bddcfa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:34.731866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886cb862-76a9-49cb-a80f-c2ece5bddcfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:34.740475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-886cb862-76a9-49cb-a80f-c2ece5bddcfa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:34.740475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:34.740475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:34.740475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:34.740475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:34.740475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:34.740475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:34.740475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:34.740475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:34.740475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:34.740475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:34.740475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:34.740475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:34.740475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:34.740475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:34.740475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:34.741553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:34.741553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:34.741553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:34.741553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:34.741553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:34.741553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:34.741553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:34.741553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:34.741553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:34.741553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:34.741553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:34.741553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:34.741553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:34.741553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:34.741553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:34.741553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:34.742390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:34.742390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:34.742390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:34.742390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:34.742390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:34.742390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:34.742390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:34.742390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:34.742390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:34.742390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:34.742390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:34.742390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:34.746830 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 288/579] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 01:51:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:34.747631 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cb862-76a9-49cb-a80f-c2ece5bddcfa None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:34.777938 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5958f4-e70f-461f-8058-fa8d8293cf38 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:34.812918 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea0127-3013-4bae-bbd5-dc22f0acc3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:34.813580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea0127-3013-4bae-bbd5-dc22f0acc3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:34.813860 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea0127-3013-4bae-bbd5-dc22f0acc3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:34.814137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea0127-3013-4bae-bbd5-dc22f0acc3a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:34.814859 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea0127-3013-4bae-bbd5-dc22f0acc3a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:34.815168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea0127-3013-4bae-bbd5-dc22f0acc3a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:34.816637 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea0127-3013-4bae-bbd5-dc22f0acc3a9 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:34.818090 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:34.828489 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 292/580] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:34.829284 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea0127-3013-4bae-bbd5-dc22f0acc3a9 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:34.846981 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cb862-76a9-49cb-a80f-c2ece5bddcfa None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:34.866300 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:34.881451 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed886a59-4c67-4173-8ced-88a7f3ea7ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:34.882287 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed886a59-4c67-4173-8ced-88a7f3ea7ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:34.882555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed886a59-4c67-4173-8ced-88a7f3ea7ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:34.882820 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed886a59-4c67-4173-8ced-88a7f3ea7ee0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:34.890846 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed886a59-4c67-4173-8ced-88a7f3ea7ee0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:34.892298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed886a59-4c67-4173-8ced-88a7f3ea7ee0 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:34.906627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-ed886a59-4c67-4173-8ced-88a7f3ea7ee0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 01:51:34.906627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:34.906627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:34.906627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:34.906627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:34.906627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:34.906627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:34.906627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:34.906627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:34.906627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:34.906627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:34.906627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:34.906627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:51:34.906627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:51:34.906627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:51:34.906627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:51:34.907954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:34.907954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:34.907954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:51:34.907954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:34.907954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:51:34.907954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:34.907954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:34.907954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:34.907954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:34.907954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:34.907954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:34.907954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:34.907954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:34.907954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:34.907954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:34.907954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:34.907954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:34.907954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:34.908969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:34.908969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:34.908969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:51:34.908969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:51:34.908969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:51:34.908969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:51:34.908969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:51:34.908969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:51:34.908969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 01:51:34.908969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:34.908969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 289/581] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:34.908969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed886a59-4c67-4173-8ced-88a7f3ea7ee0 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:34.939895 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea0127-3013-4bae-bbd5-dc22f0acc3a9 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:34.972925 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946941e-f1fa-4650-80f4-a8552aa8b255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:34.973825 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946941e-f1fa-4650-80f4-a8552aa8b255 None admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:34.974112 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946941e-f1fa-4650-80f4-a8552aa8b255 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:34.974382 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946941e-f1fa-4650-80f4-a8552aa8b255 None admin] PATH_INFO: `/v3/projects/3f3b06be1b5a4b3a8235ebf22da2a018/users/9d3b5180fb7144c394c39d4db28713b9/roles/c8b68b76c1b44e549cc7520e5546d374` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:34.988730 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946941e-f1fa-4650-80f4-a8552aa8b255 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f3b06be1b5a4b3a8235ebf22da2a018, user_id=9d3b5180fb7144c394c39d4db28713b9, role_id=c8b68b76c1b44e549cc7520e5546d374)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:34.990350 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946941e-f1fa-4650-80f4-a8552aa8b255 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:35.003445 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 293/582] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:51:34 2022] PUT /identity/v3/projects/3f3b06be1b5a4b3a8235ebf22da2a018/users/9d3b5180fb7144c394c39d4db28713b9/roles/c8b68b76c1b44e549cc7520e5546d374 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:51:35.004306 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946941e-f1fa-4650-80f4-a8552aa8b255 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:35.015898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed886a59-4c67-4173-8ced-88a7f3ea7ee0 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:35.055505 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18787164-1887-4de8-b31c-3e2c41f993dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:35.056252 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18787164-1887-4de8-b31c-3e2c41f993dd None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:35.056537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18787164-1887-4de8-b31c-3e2c41f993dd None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:35.056811 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18787164-1887-4de8-b31c-3e2c41f993dd None admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:35.057868 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18787164-1887-4de8-b31c-3e2c41f993dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:35.058179 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18787164-1887-4de8-b31c-3e2c41f993dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:35.059736 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18787164-1887-4de8-b31c-3e2c41f993dd None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:35.071438 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:35.074003 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 290/583] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:51:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:35.074716 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18787164-1887-4de8-b31c-3e2c41f993dd None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:35.120749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:35.137599 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946941e-f1fa-4650-80f4-a8552aa8b255 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:35.182847 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb0dc3-cf20-451f-b30e-733027962816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:35.183638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb0dc3-cf20-451f-b30e-733027962816 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:35.183919 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb0dc3-cf20-451f-b30e-733027962816 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:35.184194 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb0dc3-cf20-451f-b30e-733027962816 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:35.184990 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb0dc3-cf20-451f-b30e-733027962816 None admin] RBAC: Adding query filter params (name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:35.185307 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb0dc3-cf20-451f-b30e-733027962816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:35.187077 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb0dc3-cf20-451f-b30e-733027962816 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:35.191858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18787164-1887-4de8-b31c-3e2c41f993dd None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:35.196333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 294/584] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 01:51:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:35.197466 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb0dc3-cf20-451f-b30e-733027962816 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:35.233278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ca93a-c64a-45ce-b3e7-4a751ca97945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:35.234472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ca93a-c64a-45ce-b3e7-4a751ca97945 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:35.234950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ca93a-c64a-45ce-b3e7-4a751ca97945 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:35.235403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ca93a-c64a-45ce-b3e7-4a751ca97945 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:35.243911 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ca93a-c64a-45ce-b3e7-4a751ca97945 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:35.245811 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ca93a-c64a-45ce-b3e7-4a751ca97945 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:35.262150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-ef7ca93a-c64a-45ce-b3e7-4a751ca97945 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 01:51:35.262150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:35.262150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:35.262150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:35.262150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:35.262150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:35.262150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:35.262150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:35.262150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:35.262150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:35.262150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:35.262150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:35.262150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:51:35.262150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:51:35.262150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:51:35.262150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:51:35.263159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:35.263159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:35.263159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:51:35.263159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:35.263159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:51:35.263159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:35.263159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:35.263159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:35.263159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:35.263159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:35.263159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:35.263159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:35.263159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:35.263159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:35.263159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:35.263159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:35.263159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:35.263159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:35.269445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:35.269445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:35.269445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:51:35.269445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:51:35.269445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:51:35.269445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:51:35.269445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:51:35.269445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:51:35.269445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 01:51:35.269445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:35.269445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 291/585] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:35.269445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ca93a-c64a-45ce-b3e7-4a751ca97945 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:35.305911 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb0dc3-cf20-451f-b30e-733027962816 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:35.313224 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:35.344263 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0fef0-b8ee-430c-9f13-2dc0432a28fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:35.344937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0fef0-b8ee-430c-9f13-2dc0432a28fc None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:35.345215 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0fef0-b8ee-430c-9f13-2dc0432a28fc None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:35.345486 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0fef0-b8ee-430c-9f13-2dc0432a28fc None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:35.346329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0fef0-b8ee-430c-9f13-2dc0432a28fc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:35.346634 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0fef0-b8ee-430c-9f13-2dc0432a28fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:35.348709 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0fef0-b8ee-430c-9f13-2dc0432a28fc None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:35.372296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:35.374237 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 295/586] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Jun 23 01:51:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:35.375304 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0fef0-b8ee-430c-9f13-2dc0432a28fc None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:35.375821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ca93a-c64a-45ce-b3e7-4a751ca97945 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:35.414190 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c6d64-30a6-4865-8cb0-14609c125b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:35.414853 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c6d64-30a6-4865-8cb0-14609c125b77 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:35.415135 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c6d64-30a6-4865-8cb0-14609c125b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:35.415426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c6d64-30a6-4865-8cb0-14609c125b77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:35.416279 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c6d64-30a6-4865-8cb0-14609c125b77 None admin] RBAC: Adding query filter params (role.id=c8b68b76c1b44e549cc7520e5546d374, scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018, user.id=1ae132c4d0b5461aa26ab929a017cb08) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:35.416598 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c6d64-30a6-4865-8cb0-14609c125b77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:35.418058 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c6d64-30a6-4865-8cb0-14609c125b77 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:35.435526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 292/587] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:51:35 2022] GET /identity/v3/role_assignments?user.id=1ae132c4d0b5461aa26ab929a017cb08&scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018&role.id=c8b68b76c1b44e549cc7520e5546d374 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:35.435526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c6d64-30a6-4865-8cb0-14609c125b77 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:35.510997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0fef0-b8ee-430c-9f13-2dc0432a28fc None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:35.555663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b0040-1fab-497c-b2a9-8a57d344e939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:35.557007 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b0040-1fab-497c-b2a9-8a57d344e939 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:35.557493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b0040-1fab-497c-b2a9-8a57d344e939 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:35.557994 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b0040-1fab-497c-b2a9-8a57d344e939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:35.564867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c6d64-30a6-4865-8cb0-14609c125b77 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:35.576050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b0040-1fab-497c-b2a9-8a57d344e939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:35.577659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b0040-1fab-497c-b2a9-8a57d344e939 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:35.604101 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabb3e6-9f05-46dd-bb25-b5bff53e081e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:35.604339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-fb0b0040-1fab-497c-b2a9-8a57d344e939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:35.604339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:35.604339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:35.604339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:35.604339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:35.604339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:35.604339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:35.604339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:35.604339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:35.604339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:35.604339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:35.604339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:35.604339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:35.604339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:35.604339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:35.605148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:35.605148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:35.605148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:35.605148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:35.605148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:35.605148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:35.605148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:35.605148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:35.605148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:35.605148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:35.605148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:35.605148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:35.605148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:35.605148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:35.605148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:35.605148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:35.605148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:35.606035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:35.606035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:35.606035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:35.606035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:35.606260 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabb3e6-9f05-46dd-bb25-b5bff53e081e None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:35.606260 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabb3e6-9f05-46dd-bb25-b5bff53e081e None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:35.606260 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabb3e6-9f05-46dd-bb25-b5bff53e081e None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:35.606260 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeabb3e6-9f05-46dd-bb25-b5bff53e081e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:35.606494 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeabb3e6-9f05-46dd-bb25-b5bff53e081e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:35.608713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeabb3e6-9f05-46dd-bb25-b5bff53e081e None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:35.611671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 296/588] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:35.612583 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b0040-1fab-497c-b2a9-8a57d344e939 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:35.627168 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 293/589] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Jun 23 01:51:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:35.628096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabb3e6-9f05-46dd-bb25-b5bff53e081e None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:35.640738 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:35.655770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:35.727801 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b0040-1fab-497c-b2a9-8a57d344e939 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:35.733703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabb3e6-9f05-46dd-bb25-b5bff53e081e None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:35.764016 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95f399-6557-4c38-823e-6eb142d9192b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:35.765181 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95f399-6557-4c38-823e-6eb142d9192b None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:35.765605 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95f399-6557-4c38-823e-6eb142d9192b None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:35.766087 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95f399-6557-4c38-823e-6eb142d9192b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:35.770757 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54acf6-5c45-4a34-9349-61d6ae207011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:35.771486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54acf6-5c45-4a34-9349-61d6ae207011 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:35.771776 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54acf6-5c45-4a34-9349-61d6ae207011 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:35.772052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54acf6-5c45-4a34-9349-61d6ae207011 None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:35.772782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54acf6-5c45-4a34-9349-61d6ae207011 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:35.773089 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54acf6-5c45-4a34-9349-61d6ae207011 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:35.774712 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54acf6-5c45-4a34-9349-61d6ae207011 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:35.778938 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95f399-6557-4c38-823e-6eb142d9192b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:35.780646 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95f399-6557-4c38-823e-6eb142d9192b None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:35.791442 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 294/590] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:35.791442 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54acf6-5c45-4a34-9349-61d6ae207011 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:35.810290 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-ae95f399-6557-4c38-823e-6eb142d9192b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:35.810290 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:35.810290 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:35.810290 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:35.810290 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:35.810290 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:35.810290 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:35.810290 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:35.810290 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:35.810290 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:35.810290 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:35.810290 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:35.810290 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:35.810290 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:35.810290 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:35.811833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:35.811833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:35.811833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:35.811833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:35.811833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:35.811833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:35.811833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:35.811833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:35.811833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:35.811833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:35.811833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:35.811833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:35.811833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:35.811833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:35.811833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:35.811833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:35.811833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:35.812748 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:35.812748 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:35.812748 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:35.812748 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:35.815188 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 297/591] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:35.816452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95f399-6557-4c38-823e-6eb142d9192b None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:35.892980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:35.914572 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:35.919384 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54acf6-5c45-4a34-9349-61d6ae207011 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:35.957287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95f399-6557-4c38-823e-6eb142d9192b None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:35.959729 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07bb5e-2698-42e1-9a0f-345eb4381c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:35.960698 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07bb5e-2698-42e1-9a0f-345eb4381c1c None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:35.961078 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07bb5e-2698-42e1-9a0f-345eb4381c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:35.961446 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07bb5e-2698-42e1-9a0f-345eb4381c1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:35.973228 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07bb5e-2698-42e1-9a0f-345eb4381c1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:35.975006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07bb5e-2698-42e1-9a0f-345eb4381c1c None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:35.993907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-9d07bb5e-2698-42e1-9a0f-345eb4381c1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:35.993907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:35.993907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:35.993907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:35.993907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:35.993907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:35.993907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:35.993907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:35.993907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:35.993907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:35.993907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:35.993907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:35.993907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:35.993907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:35.993907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:35.994880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:35.994880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:35.994880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:35.994880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:35.994880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:35.994880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:35.994880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:35.994880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:35.994880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:35.994880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:35.994880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:35.994880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:35.994880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:35.994880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:35.994880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:35.994880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:35.994880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:35.995811 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:35.995811 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:35.995811 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:35.995811 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:35.996037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02ca3a-b243-4fce-81d8-d0fab5eaa502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:35.996126 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 295/592] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:36.000565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02ca3a-b243-4fce-81d8-d0fab5eaa502 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:36.000565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02ca3a-b243-4fce-81d8-d0fab5eaa502 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:36.000565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02ca3a-b243-4fce-81d8-d0fab5eaa502 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:36.001037 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07bb5e-2698-42e1-9a0f-345eb4381c1c None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:36.006013 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02ca3a-b243-4fce-81d8-d0fab5eaa502 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:36.008034 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02ca3a-b243-4fce-81d8-d0fab5eaa502 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:36.025455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-9c02ca3a-b243-4fce-81d8-d0fab5eaa502 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 01:51:36.025455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:36.025455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:36.025455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:36.025455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:36.025455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:36.025455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:36.025455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:36.025455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:36.025455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:36.025455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:36.025455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:36.025455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:51:36.025455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:51:36.025455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:51:36.025455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:51:36.026621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:36.026621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:36.026621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:51:36.026621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:36.026621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:51:36.026621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:36.026621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:36.026621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:36.026621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:36.026621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:36.026621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:36.026621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:36.026621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:36.026621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:36.026621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:36.026621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:36.026621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:36.026621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:36.027922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:36.027922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:36.027922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:51:36.027922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:51:36.027922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:51:36.027922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:51:36.027922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:51:36.027922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:51:36.027922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 01:51:36.027922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:36.027922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 298/593] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 01:51:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:36.027922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02ca3a-b243-4fce-81d8-d0fab5eaa502 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:36.105722 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07bb5e-2698-42e1-9a0f-345eb4381c1c None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:36.139620 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02ca3a-b243-4fce-81d8-d0fab5eaa502 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:36.144439 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05ffa2-c2f9-47ec-816e-d41d42ece87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:36.145116 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05ffa2-c2f9-47ec-816e-d41d42ece87a None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:36.145399 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05ffa2-c2f9-47ec-816e-d41d42ece87a None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:36.145673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05ffa2-c2f9-47ec-816e-d41d42ece87a None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:36.146405 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05ffa2-c2f9-47ec-816e-d41d42ece87a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:36.146713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05ffa2-c2f9-47ec-816e-d41d42ece87a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:36.149476 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05ffa2-c2f9-47ec-816e-d41d42ece87a None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:36.150140 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:36.168788 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 296/594] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:36.169937 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05ffa2-c2f9-47ec-816e-d41d42ece87a None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:36.172571 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:36.181174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433cdb5-d30b-4544-8f03-f3e0eed33f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:36.182229 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433cdb5-d30b-4544-8f03-f3e0eed33f0c None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:36.182229 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433cdb5-d30b-4544-8f03-f3e0eed33f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:36.182489 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433cdb5-d30b-4544-8f03-f3e0eed33f0c None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:36.183219 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433cdb5-d30b-4544-8f03-f3e0eed33f0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:36.183567 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433cdb5-d30b-4544-8f03-f3e0eed33f0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:36.185067 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433cdb5-d30b-4544-8f03-f3e0eed33f0c None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:36.198106 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 299/595] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:36.199015 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433cdb5-d30b-4544-8f03-f3e0eed33f0c None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:36.283234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05ffa2-c2f9-47ec-816e-d41d42ece87a None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:36.303962 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433cdb5-d30b-4544-8f03-f3e0eed33f0c None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:36.325253 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09526784-7efb-4fd2-8aa5-6bfda4f0ce65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:36.326700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09526784-7efb-4fd2-8aa5-6bfda4f0ce65 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:36.327511 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09526784-7efb-4fd2-8aa5-6bfda4f0ce65 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:36.328445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09526784-7efb-4fd2-8aa5-6bfda4f0ce65 None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:36.330755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09526784-7efb-4fd2-8aa5-6bfda4f0ce65 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:36.331687 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09526784-7efb-4fd2-8aa5-6bfda4f0ce65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:36.334835 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09526784-7efb-4fd2-8aa5-6bfda4f0ce65 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:36.339877 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cf368-ff0e-4f56-a77c-6cde6d4209a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:36.341423 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cf368-ff0e-4f56-a77c-6cde6d4209a9 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:36.341423 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cf368-ff0e-4f56-a77c-6cde6d4209a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:36.341423 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cf368-ff0e-4f56-a77c-6cde6d4209a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:36.348976 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6cf368-ff0e-4f56-a77c-6cde6d4209a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:36.350030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6cf368-ff0e-4f56-a77c-6cde6d4209a9 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:36.362017 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 297/596] 10.222.0.13 () {56 vars in 1139 bytes} [Thu Jun 23 01:51:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:36.363187 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09526784-7efb-4fd2-8aa5-6bfda4f0ce65 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:36.369550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-eb6cf368-ff0e-4f56-a77c-6cde6d4209a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:36.369550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:36.369550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:36.369550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:36.369550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:36.369550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:36.369550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:36.369550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:36.369550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:36.369550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:36.369550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:36.369550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:36.369550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:51:36.369550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:51:36.369550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:51:36.370498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:51:36.370498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:36.370498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:36.370498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:36.370498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:36.370498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:36.370498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:36.370498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:36.370498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:36.370498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:36.370498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:36.370498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:36.370498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:36.370498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:36.370498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:36.370498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:36.370498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:36.371383 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:51:36.371383 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:51:36.371383 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:51:36.371383 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:51:36.371383 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:51:36.371383 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:51:36.371383 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:36.371383 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:36.371853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 300/597] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:36.377732 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cf368-ff0e-4f56-a77c-6cde6d4209a9 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:36.440104 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:36.445990 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:36.496595 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09526784-7efb-4fd2-8aa5-6bfda4f0ce65 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:36.501795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cf368-ff0e-4f56-a77c-6cde6d4209a9 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:36.538798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cff3a-0b8a-4e35-b836-5f7ec86ac95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:36.539702 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cff3a-0b8a-4e35-b836-5f7ec86ac95f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:36.540077 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cff3a-0b8a-4e35-b836-5f7ec86ac95f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:36.540456 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cff3a-0b8a-4e35-b836-5f7ec86ac95f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:36.543494 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160eae43-8a48-46fd-bfcc-c1e787501bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:36.545656 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eae43-8a48-46fd-bfcc-c1e787501bbe None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:36.546271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eae43-8a48-46fd-bfcc-c1e787501bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:36.546907 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eae43-8a48-46fd-bfcc-c1e787501bbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:36.550045 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cff3a-0b8a-4e35-b836-5f7ec86ac95f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:36.552375 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cff3a-0b8a-4e35-b836-5f7ec86ac95f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:36.564685 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160eae43-8a48-46fd-bfcc-c1e787501bbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:36.567282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160eae43-8a48-46fd-bfcc-c1e787501bbe None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:36.568272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-ea9cff3a-0b8a-4e35-b836-5f7ec86ac95f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:36.568272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:36.568272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:36.568272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:36.568272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:36.568272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:36.568272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:36.568272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:36.568272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:36.568272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:36.568272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:36.568272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:36.568272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:51:36.568272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:51:36.568272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:51:36.569854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:51:36.569854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:36.569854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:36.569854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:36.569854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:36.569854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:36.569854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:36.569854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:36.569854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:36.569854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:36.569854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:36.569854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:36.569854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:36.569854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:36.569854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:36.569854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:36.569854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:36.571673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:51:36.571673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:51:36.571673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:51:36.571673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:51:36.571673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:51:36.571673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:51:36.571673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:36.571673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:36.571673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 298/598] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:36.572477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cff3a-0b8a-4e35-b836-5f7ec86ac95f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:36.592365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-160eae43-8a48-46fd-bfcc-c1e787501bbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:36.592365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:36.592365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:36.592365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:36.592365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:36.592365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:36.592365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:36.592365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:36.592365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:36.592365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:36.592365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:36.592365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:36.592365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:36.592365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:36.592365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:36.593327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:36.593327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:36.593327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:36.593327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:36.593327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:36.593327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:36.593327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:36.593327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:36.593327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:36.593327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:36.593327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:36.593327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:36.593327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:36.593327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:36.593327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:36.593327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:36.593327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:36.594251 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:36.594251 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:36.594251 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:36.594251 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:36.601211 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 301/599] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:36.602705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160eae43-8a48-46fd-bfcc-c1e787501bbe None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:36.712476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:36.715831 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160eae43-8a48-46fd-bfcc-c1e787501bbe None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:36.723428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cff3a-0b8a-4e35-b836-5f7ec86ac95f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:36.742726 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:36.757126 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891724bf-bd26-41fa-8e7e-df056deb97bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:36.758285 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891724bf-bd26-41fa-8e7e-df056deb97bb None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:36.758706 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891724bf-bd26-41fa-8e7e-df056deb97bb None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:36.759117 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891724bf-bd26-41fa-8e7e-df056deb97bb None admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:36.760114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891724bf-bd26-41fa-8e7e-df056deb97bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:36.760678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891724bf-bd26-41fa-8e7e-df056deb97bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:36.762389 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891724bf-bd26-41fa-8e7e-df056deb97bb None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:36.771155 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa7b08-4b8e-49e7-9098-2b6e26452a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:36.771892 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa7b08-4b8e-49e7-9098-2b6e26452a17 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:36.772175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa7b08-4b8e-49e7-9098-2b6e26452a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:36.772824 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa7b08-4b8e-49e7-9098-2b6e26452a17 None admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:36.773365 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa7b08-4b8e-49e7-9098-2b6e26452a17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:36.773677 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa7b08-4b8e-49e7-9098-2b6e26452a17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:36.775197 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa7b08-4b8e-49e7-9098-2b6e26452a17 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:36.776913 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 302/600] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:51:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:36.778026 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891724bf-bd26-41fa-8e7e-df056deb97bb None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:36.794701 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 299/601] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:51:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:36.795529 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa7b08-4b8e-49e7-9098-2b6e26452a17 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:36.886356 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891724bf-bd26-41fa-8e7e-df056deb97bb None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:36.923766 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9699b2-38c7-4b84-ba38-d3ed621b50c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:36.924808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9699b2-38c7-4b84-ba38-d3ed621b50c6 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:36.925322 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9699b2-38c7-4b84-ba38-d3ed621b50c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:36.925929 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9699b2-38c7-4b84-ba38-d3ed621b50c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:36.927542 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9699b2-38c7-4b84-ba38-d3ed621b50c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:36.928056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9699b2-38c7-4b84-ba38-d3ed621b50c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:36.929761 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9699b2-38c7-4b84-ba38-d3ed621b50c6 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:36.948792 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 303/602] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:36.949775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9699b2-38c7-4b84-ba38-d3ed621b50c6 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:36.955963 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa7b08-4b8e-49e7-9098-2b6e26452a17 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:37.000587 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e952311-b770-408e-b64c-98ac3ed3edf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:37.001519 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:37.001670 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e952311-b770-408e-b64c-98ac3ed3edf3 None admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:37.001827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e952311-b770-408e-b64c-98ac3ed3edf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:37.002198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e952311-b770-408e-b64c-98ac3ed3edf3 None admin] PATH_INFO: `/v3/projects/3f3b06be1b5a4b3a8235ebf22da2a018/users/46aba36939c549278bcdee7a04511e27/roles/c8b68b76c1b44e549cc7520e5546d374` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:37.028701 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e952311-b770-408e-b64c-98ac3ed3edf3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f3b06be1b5a4b3a8235ebf22da2a018, user_id=46aba36939c549278bcdee7a04511e27, role_id=c8b68b76c1b44e549cc7520e5546d374)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:37.030162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e952311-b770-408e-b64c-98ac3ed3edf3 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:37.055905 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 300/603] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:51:36 2022] PUT /identity/v3/projects/3f3b06be1b5a4b3a8235ebf22da2a018/users/46aba36939c549278bcdee7a04511e27/roles/c8b68b76c1b44e549cc7520e5546d374 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:51:37.057024 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e952311-b770-408e-b64c-98ac3ed3edf3 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:37.067179 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9699b2-38c7-4b84-ba38-d3ed621b50c6 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:37.105184 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:37.111279 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e19c4c-fac0-4a57-aae1-f6f5a9b42783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:37.112657 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e19c4c-fac0-4a57-aae1-f6f5a9b42783 None admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:37.113204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e19c4c-fac0-4a57-aae1-f6f5a9b42783 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:37.113853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e19c4c-fac0-4a57-aae1-f6f5a9b42783 None admin] PATH_INFO: `/v3/projects/3f3b06be1b5a4b3a8235ebf22da2a018/users/883b947de43d4779b5f95103775430c6/roles/c8b68b76c1b44e549cc7520e5546d374` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:37.133237 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e19c4c-fac0-4a57-aae1-f6f5a9b42783 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f3b06be1b5a4b3a8235ebf22da2a018, user_id=883b947de43d4779b5f95103775430c6, role_id=c8b68b76c1b44e549cc7520e5546d374)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:37.135263 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e19c4c-fac0-4a57-aae1-f6f5a9b42783 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:37.155915 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 304/604] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:51:36 2022] PUT /identity/v3/projects/3f3b06be1b5a4b3a8235ebf22da2a018/users/883b947de43d4779b5f95103775430c6/roles/c8b68b76c1b44e549cc7520e5546d374 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:51:37.157940 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4773ea-fce0-41a5-b5e5-375a9e3cdce9 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:37.159243 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4773ea-fce0-41a5-b5e5-375a9e3cdce9 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:37.160021 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4773ea-fce0-41a5-b5e5-375a9e3cdce9 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:37.162801 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 305/605] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:37.169282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc2c54-d3fd-4889-b52a-c53ee6fa5d58 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:37.169794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc2c54-d3fd-4889-b52a-c53ee6fa5d58 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:37.170221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc2c54-d3fd-4889-b52a-c53ee6fa5d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:37.194431 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-5fcc2c54-d3fd-4889-b52a-c53ee6fa5d58 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:37.195913 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5fcc2c54-d3fd-4889-b52a-c53ee6fa5d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:37.214334 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e952311-b770-408e-b64c-98ac3ed3edf3 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:37.273940 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b6fdd-95ef-4519-a2df-cfe528de0355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:37.275091 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b6fdd-95ef-4519-a2df-cfe528de0355 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:37.275454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b6fdd-95ef-4519-a2df-cfe528de0355 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:37.275745 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b6fdd-95ef-4519-a2df-cfe528de0355 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:37.284222 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:37.291115 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 306/606] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:37.292182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b6fdd-95ef-4519-a2df-cfe528de0355 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:37.293715 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b6fdd-95ef-4519-a2df-cfe528de0355 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:37.317936 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc2c54-d3fd-4889-b52a-c53ee6fa5d58 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:37.322533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-a98b6fdd-95ef-4519-a2df-cfe528de0355 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:37.322533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:37.322533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:37.322533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:37.322533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:37.322533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:37.322533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:37.322533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:37.322533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:37.322533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:37.322533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:37.322533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:37.322533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:51:37.322533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:51:37.322533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:51:37.323486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:51:37.323486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:37.323486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:37.323486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:37.323486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:37.323486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:37.323486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:37.323486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:37.323486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:37.323486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:37.323486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:37.323486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:37.323486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:37.323486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:37.323486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:37.323486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:37.323486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:37.324535 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:51:37.324535 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:51:37.324535 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:51:37.324535 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:51:37.324535 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:51:37.324535 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:51:37.324535 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:37.324535 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:37.326752 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 301/607] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:37.332508 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b6fdd-95ef-4519-a2df-cfe528de0355 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:37.455044 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:37.465070 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc2c54-d3fd-4889-b52a-c53ee6fa5d58 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:37.481793 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b6fdd-95ef-4519-a2df-cfe528de0355 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:37.509513 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a910c-b48f-4c9a-9c9a-4b66b63a54a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:37.510804 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a910c-b48f-4c9a-9c9a-4b66b63a54a0 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:37.511225 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a910c-b48f-4c9a-9c9a-4b66b63a54a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:37.511662 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a910c-b48f-4c9a-9c9a-4b66b63a54a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:37.524208 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a910c-b48f-4c9a-9c9a-4b66b63a54a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:37.532992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-be0a910c-b48f-4c9a-9c9a-4b66b63a54a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:37.532992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:37.532992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:37.532992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:37.532992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:37.532992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:37.532992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:37.532992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:37.532992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:37.532992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:37.532992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:37.532992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:37.532992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:37.532992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:37.532992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:37.532992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:37.534002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:37.534002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:37.534002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:37.534002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:37.534002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:37.534002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:37.534002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:37.534002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:37.534002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:37.534002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:37.534002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:37.534002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:37.534002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:37.534002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:37.534002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:37.534002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:37.534942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:37.534942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:37.534942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:37.534942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:37.534942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:37.534942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:37.534942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:37.534942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:37.534942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:37.534942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:37.534942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:37.534942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:37.537603 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 307/608] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 01:51:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:51:37.543639 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a910c-b48f-4c9a-9c9a-4b66b63a54a0 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:37.579396 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2b982-b2c1-4c1b-948a-a6ee2768fc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:37.580193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2b982-b2c1-4c1b-948a-a6ee2768fc65 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:37.580569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2b982-b2c1-4c1b-948a-a6ee2768fc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:37.580944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2b982-b2c1-4c1b-948a-a6ee2768fc65 None admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:37.582023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2b982-b2c1-4c1b-948a-a6ee2768fc65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:37.582436 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2b982-b2c1-4c1b-948a-a6ee2768fc65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:37.584044 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2b982-b2c1-4c1b-948a-a6ee2768fc65 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:37.611288 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 302/609] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:51:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:37.616805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2b982-b2c1-4c1b-948a-a6ee2768fc65 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:37.617079 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:37.666059 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a910c-b48f-4c9a-9c9a-4b66b63a54a0 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:37.706970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994f00a-fb11-4172-81e7-7e1e99e40bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:37.708006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994f00a-fb11-4172-81e7-7e1e99e40bce None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:37.708428 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994f00a-fb11-4172-81e7-7e1e99e40bce None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:37.708837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994f00a-fb11-4172-81e7-7e1e99e40bce None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:37.709727 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994f00a-fb11-4172-81e7-7e1e99e40bce None admin] RBAC: Adding query filter params (name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:37.710196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994f00a-fb11-4172-81e7-7e1e99e40bce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:37.712044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994f00a-fb11-4172-81e7-7e1e99e40bce None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:37.722204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 308/610] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 01:51:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:37.728498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994f00a-fb11-4172-81e7-7e1e99e40bce None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:37.845935 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994f00a-fb11-4172-81e7-7e1e99e40bce None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:37.869607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2b982-b2c1-4c1b-948a-a6ee2768fc65 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:37.871718 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:37.884883 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76214506-bd48-43bb-9145-8075672d09d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:37.885919 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76214506-bd48-43bb-9145-8075672d09d7 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:37.886349 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76214506-bd48-43bb-9145-8075672d09d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:37.886793 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76214506-bd48-43bb-9145-8075672d09d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:37.899556 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76214506-bd48-43bb-9145-8075672d09d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:37.901253 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76214506-bd48-43bb-9145-8075672d09d7 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:37.919920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-76214506-bd48-43bb-9145-8075672d09d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:37.919920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:37.919920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:37.919920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:37.919920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:37.919920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:37.919920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:37.919920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:37.919920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:37.919920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:37.919920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:37.919920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:37.919920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:37.919920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:37.919920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:37.921042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:37.921042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:37.921042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:37.921042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:37.921042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:37.921042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:37.921042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:37.921042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:37.921042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:37.921042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:37.921042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:37.921042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:37.921042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:37.921042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:37.921042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:37.921042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:37.921042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:37.922105 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:37.922105 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:37.922105 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:37.922105 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:37.925027 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 309/611] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:51:37.937858 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76214506-bd48-43bb-9145-8075672d09d7 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:37.968226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f7cd2-5035-493e-ae46-75ec54b3607f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:37.969131 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f7cd2-5035-493e-ae46-75ec54b3607f None admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:37.969491 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f7cd2-5035-493e-ae46-75ec54b3607f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:37.969670 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f7cd2-5035-493e-ae46-75ec54b3607f None admin] PATH_INFO: `/v3/projects/3f3b06be1b5a4b3a8235ebf22da2a018/users/8cda12550db1442ab04f30b9875fdbea/roles/c8b68b76c1b44e549cc7520e5546d374` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:37.982377 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:37.987122 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f7cd2-5035-493e-ae46-75ec54b3607f None admin] RBAC: Authorizing `identity:create_grant(project_id=3f3b06be1b5a4b3a8235ebf22da2a018, user_id=8cda12550db1442ab04f30b9875fdbea, role_id=c8b68b76c1b44e549cc7520e5546d374)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:37.988654 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f7cd2-5035-493e-ae46-75ec54b3607f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:38.011786 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 303/612] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:51:37 2022] PUT /identity/v3/projects/3f3b06be1b5a4b3a8235ebf22da2a018/users/8cda12550db1442ab04f30b9875fdbea/roles/c8b68b76c1b44e549cc7520e5546d374 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 01:51:38.016081 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17485ec-bddb-4a1f-8939-22a9d7a66a6e None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:38.017848 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17485ec-bddb-4a1f-8939-22a9d7a66a6e None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:38.018285 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17485ec-bddb-4a1f-8939-22a9d7a66a6e None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:38.022266 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 304/613] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:38.028859 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82874279-9ba4-4f23-a04e-16a9e3237ace None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:38.029456 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82874279-9ba4-4f23-a04e-16a9e3237ace None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:38.029875 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82874279-9ba4-4f23-a04e-16a9e3237ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:38.070537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-82874279-9ba4-4f23-a04e-16a9e3237ace None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:38.071885 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-82874279-9ba4-4f23-a04e-16a9e3237ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:38.093496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76214506-bd48-43bb-9145-8075672d09d7 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:38.135642 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfe20e-2ea4-4056-91eb-12ca12ffe57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:38.136606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfe20e-2ea4-4056-91eb-12ca12ffe57d None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:38.137064 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfe20e-2ea4-4056-91eb-12ca12ffe57d None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:38.137794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfe20e-2ea4-4056-91eb-12ca12ffe57d None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:38.139642 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdfe20e-2ea4-4056-91eb-12ca12ffe57d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:38.140551 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdfe20e-2ea4-4056-91eb-12ca12ffe57d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:38.142522 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdfe20e-2ea4-4056-91eb-12ca12ffe57d None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:38.175672 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 310/614] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:38.176895 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfe20e-2ea4-4056-91eb-12ca12ffe57d None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:38.215450 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 305/615] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:51:38.237302 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:38.246904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82874279-9ba4-4f23-a04e-16a9e3237ace None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:38.320853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfe20e-2ea4-4056-91eb-12ca12ffe57d None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:38.362372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db44f3a-9210-4419-b162-b7081221ac29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:38.362372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db44f3a-9210-4419-b162-b7081221ac29 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:38.362372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db44f3a-9210-4419-b162-b7081221ac29 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:38.362372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db44f3a-9210-4419-b162-b7081221ac29 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:38.375797 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db44f3a-9210-4419-b162-b7081221ac29 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:38.377757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db44f3a-9210-4419-b162-b7081221ac29 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:38.402221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-1db44f3a-9210-4419-b162-b7081221ac29 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 01:51:38.402221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:38.402221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:38.402221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:38.402221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:38.402221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:38.402221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:38.402221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:38.402221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:38.402221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:38.402221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:38.402221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:38.402221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:51:38.402221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:51:38.402221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:51:38.402221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:51:38.403199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:38.403199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:38.403199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:51:38.403199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:38.403199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:51:38.403199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:38.403199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:38.403199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:38.403199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:38.403199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:38.403199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:38.403199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:38.403199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:38.403199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:38.403199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:38.403199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:38.403199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:38.403199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:38.404172 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:38.404172 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:38.404172 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:51:38.404172 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:51:38.404172 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:51:38.404172 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:51:38.404172 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:51:38.404172 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:51:38.404172 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 01:51:38.404172 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:38.404172 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 311/616] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 23 01:51:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:38.411229 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db44f3a-9210-4419-b162-b7081221ac29 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:38.423788 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82874279-9ba4-4f23-a04e-16a9e3237ace None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:38.472627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:38.500476 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e255269-fa98-4550-b4dd-1c04f32d0252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:38.501458 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e255269-fa98-4550-b4dd-1c04f32d0252 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:38.501841 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e255269-fa98-4550-b4dd-1c04f32d0252 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:38.502242 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e255269-fa98-4550-b4dd-1c04f32d0252 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:38.522903 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e255269-fa98-4550-b4dd-1c04f32d0252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:38.532263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-3e255269-fa98-4550-b4dd-1c04f32d0252 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:38.532263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:38.532263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:38.532263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:38.532263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:38.532263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:38.532263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:38.532263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:38.532263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:38.532263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:38.532263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:38.532263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:38.532263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:38.532263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:38.532263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:38.532263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:38.533368 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:38.533368 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:38.533368 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:38.533368 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:38.533368 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:38.533368 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:38.533368 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:38.533368 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:38.533368 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:38.533368 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:38.533368 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:38.533368 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:38.533368 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:38.533368 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:38.533368 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:38.533368 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:38.534390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:38.534390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:38.534390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:38.534390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:38.534390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:38.534390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:38.534390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:38.534390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:38.534390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:38.534390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:38.534390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:38.534390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:38.536547 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 306/617] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 01:51:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:38.544283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e255269-fa98-4550-b4dd-1c04f32d0252 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:38.571953 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:38.586199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db44f3a-9210-4419-b162-b7081221ac29 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:38.665442 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e255269-fa98-4550-b4dd-1c04f32d0252 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:38.672907 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35172d13-0941-4b6e-85b4-87f371de3829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:38.673864 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35172d13-0941-4b6e-85b4-87f371de3829 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:38.674396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35172d13-0941-4b6e-85b4-87f371de3829 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:38.675001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35172d13-0941-4b6e-85b4-87f371de3829 None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:38.676106 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35172d13-0941-4b6e-85b4-87f371de3829 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:38.676659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35172d13-0941-4b6e-85b4-87f371de3829 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:38.678299 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35172d13-0941-4b6e-85b4-87f371de3829 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:38.705977 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b95c9-6585-441a-8e1e-f4f664a6a992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:38.706744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b95c9-6585-441a-8e1e-f4f664a6a992 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:38.707088 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b95c9-6585-441a-8e1e-f4f664a6a992 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:38.707395 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b95c9-6585-441a-8e1e-f4f664a6a992 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:38.708092 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b95c9-6585-441a-8e1e-f4f664a6a992 None admin] RBAC: Adding query filter params (name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:38.708400 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b95c9-6585-441a-8e1e-f4f664a6a992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:38.709775 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b95c9-6585-441a-8e1e-f4f664a6a992 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:38.718637 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 307/618] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 01:51:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:38.725379 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 312/619] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 23 01:51:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:38.726146 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b95c9-6585-441a-8e1e-f4f664a6a992 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:38.733020 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35172d13-0941-4b6e-85b4-87f371de3829 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:38.815749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:38.914680 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b95c9-6585-441a-8e1e-f4f664a6a992 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:38.933883 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35172d13-0941-4b6e-85b4-87f371de3829 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:38.971505 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f50a7-fa6f-4dc9-94fe-c6e2f01b85a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:38.972534 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f50a7-fa6f-4dc9-94fe-c6e2f01b85a4 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:38.972828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f50a7-fa6f-4dc9-94fe-c6e2f01b85a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:38.973109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f50a7-fa6f-4dc9-94fe-c6e2f01b85a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:38.984699 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f50a7-fa6f-4dc9-94fe-c6e2f01b85a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:38.986194 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f50a7-fa6f-4dc9-94fe-c6e2f01b85a4 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:39.006590 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-780f50a7-fa6f-4dc9-94fe-c6e2f01b85a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:39.006590 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:39.006590 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:39.006590 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:39.006590 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:39.006590 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:39.006590 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:39.006590 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:39.006590 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:39.006590 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:39.006590 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:39.006590 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:39.006590 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:39.006590 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:39.006590 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:39.007717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:39.007717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:39.007717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:39.007717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:39.007717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:39.007717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:39.007717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:39.007717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:39.007717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:39.007717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:39.007717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:39.007717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:39.007717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:39.007717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:39.007717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:39.007717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:39.007717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:39.008598 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:39.008598 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:39.008598 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:39.008598 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:39.008598 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 308/620] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:39.014412 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f50a7-fa6f-4dc9-94fe-c6e2f01b85a4 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:39.027138 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d89628-4fa9-45de-b3c0-cfb50292a479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:39.027843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d89628-4fa9-45de-b3c0-cfb50292a479 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:39.028128 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d89628-4fa9-45de-b3c0-cfb50292a479 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:39.028402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d89628-4fa9-45de-b3c0-cfb50292a479 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:39.098976 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:39.123823 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:39.132505 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f50a7-fa6f-4dc9-94fe-c6e2f01b85a4 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:39.186339 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecd1a6-e745-437d-9e55-913686131789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:39.187367 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecd1a6-e745-437d-9e55-913686131789 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:39.187889 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecd1a6-e745-437d-9e55-913686131789 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:39.188559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecd1a6-e745-437d-9e55-913686131789 None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:39.189531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecd1a6-e745-437d-9e55-913686131789 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:39.190039 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecd1a6-e745-437d-9e55-913686131789 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:39.191713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecd1a6-e745-437d-9e55-913686131789 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:39.205672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 309/621] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:39.214640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecd1a6-e745-437d-9e55-913686131789 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:39.227453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d89628-4fa9-45de-b3c0-cfb50292a479 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:39.227453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d89628-4fa9-45de-b3c0-cfb50292a479 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:39.373522 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 313/622] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:51:39.379201 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d89628-4fa9-45de-b3c0-cfb50292a479 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:39.380145 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecd1a6-e745-437d-9e55-913686131789 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:39.433105 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:39.441989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c5967-e4ec-4d97-a912-bee65dcc5425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:39.443247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c5967-e4ec-4d97-a912-bee65dcc5425 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:39.443859 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c5967-e4ec-4d97-a912-bee65dcc5425 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:39.444230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c5967-e4ec-4d97-a912-bee65dcc5425 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:39.453016 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c5967-e4ec-4d97-a912-bee65dcc5425 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:39.454871 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c5967-e4ec-4d97-a912-bee65dcc5425 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:39.472349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-b02c5967-e4ec-4d97-a912-bee65dcc5425 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 01:51:39.472349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:39.472349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:39.472349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:39.472349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:39.472349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:39.472349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:39.472349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:39.472349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:39.472349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:39.472349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:39.472349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:39.472349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:51:39.472349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:51:39.472349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:51:39.472349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:51:39.473531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:39.473531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:39.473531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:51:39.473531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:39.473531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:51:39.473531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:39.473531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:39.473531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:39.473531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:39.473531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:39.473531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:39.473531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:39.473531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:39.473531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:39.473531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:39.473531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:39.473531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:39.473531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:39.474720 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:39.474720 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:39.474720 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:51:39.474720 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:51:39.474720 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:51:39.474720 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:51:39.474720 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:51:39.474720 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:51:39.474720 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 01:51:39.474720 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:39.476632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 310/623] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:51:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:39.478023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aae870-8a75-4031-984a-f36154a43276 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:39.478414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aae870-8a75-4031-984a-f36154a43276 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:39.478783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aae870-8a75-4031-984a-f36154a43276 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:39.483454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 311/624] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:39.484322 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aae870-8a75-4031-984a-f36154a43276 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:39.503929 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:39.505823 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d89628-4fa9-45de-b3c0-cfb50292a479 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:39.542802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2786c-bc8b-41e0-8471-c514561f6e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:39.543607 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2786c-bc8b-41e0-8471-c514561f6e48 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:39.543869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2786c-bc8b-41e0-8471-c514561f6e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:39.544139 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2786c-bc8b-41e0-8471-c514561f6e48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:39.555770 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2786c-bc8b-41e0-8471-c514561f6e48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:39.557329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2786c-bc8b-41e0-8471-c514561f6e48 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:39.576132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-a2d2786c-bc8b-41e0-8471-c514561f6e48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:39.576132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:39.576132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:39.576132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:39.576132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:39.576132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:39.576132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:39.576132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:39.576132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:39.576132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:39.576132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:39.576132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:39.576132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:39.576132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:39.576132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:39.577508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:39.577508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:39.577508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:39.577508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:39.577508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:39.577508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:39.577508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:39.577508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:39.577508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:39.577508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:39.577508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:39.577508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:39.577508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:39.577508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:39.577508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:39.577508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:39.577508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:39.578424 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:39.578424 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:39.578424 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:39.578424 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:39.578424 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 314/625] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:39.579145 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c9224-fa04-4c53-8503-0107ae0391b3 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:39.579437 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c9224-fa04-4c53-8503-0107ae0391b3 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:39.579718 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c9224-fa04-4c53-8503-0107ae0391b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:39.595137 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aae870-8a75-4031-984a-f36154a43276 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:39.599374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-2c2c9224-fa04-4c53-8503-0107ae0391b3 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:39.600561 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-2c2c9224-fa04-4c53-8503-0107ae0391b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:39.632493 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cd5b5-a963-4f61-a4f2-622823d9cfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:39.633176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cd5b5-a963-4f61-a4f2-622823d9cfcd None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:39.633459 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cd5b5-a963-4f61-a4f2-622823d9cfcd None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:39.633729 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cd5b5-a963-4f61-a4f2-622823d9cfcd None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:39.634568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cd5b5-a963-4f61-a4f2-622823d9cfcd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:39.634877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cd5b5-a963-4f61-a4f2-622823d9cfcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:39.636342 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cd5b5-a963-4f61-a4f2-622823d9cfcd None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:39.654596 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 312/626] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Jun 23 01:51:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:39.655884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71a7a4-ffdd-46e3-b12d-ba37094fccc8 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:39.656164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71a7a4-ffdd-46e3-b12d-ba37094fccc8 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:39.656433 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71a7a4-ffdd-46e3-b12d-ba37094fccc8 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:39.659845 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 313/627] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:39.659845 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71a7a4-ffdd-46e3-b12d-ba37094fccc8 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:39.674837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 315/628] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:39.675840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c9224-fa04-4c53-8503-0107ae0391b3 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:39.720083 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:39.740199 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:39.769616 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71a7a4-ffdd-46e3-b12d-ba37094fccc8 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:39.785347 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c9224-fa04-4c53-8503-0107ae0391b3 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:39.806248 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db9c2a-6f6d-4058-97ca-d679aecef5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:39.806915 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db9c2a-6f6d-4058-97ca-d679aecef5ef None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:39.807193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db9c2a-6f6d-4058-97ca-d679aecef5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:39.807543 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db9c2a-6f6d-4058-97ca-d679aecef5ef None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:39.808237 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db9c2a-6f6d-4058-97ca-d679aecef5ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:39.808540 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db9c2a-6f6d-4058-97ca-d679aecef5ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:39.809902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db9c2a-6f6d-4058-97ca-d679aecef5ef None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:39.822381 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470936e-1757-4d74-93a4-1c4cd02547e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:39.823185 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470936e-1757-4d74-93a4-1c4cd02547e5 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:39.823499 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470936e-1757-4d74-93a4-1c4cd02547e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:39.828057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470936e-1757-4d74-93a4-1c4cd02547e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:39.828270 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 314/629] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:39.828270 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2eaa0-6f28-4f3c-9a94-7c0e89b387d9 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:39.828270 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2eaa0-6f28-4f3c-9a94-7c0e89b387d9 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:39.828270 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2eaa0-6f28-4f3c-9a94-7c0e89b387d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:39.839192 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470936e-1757-4d74-93a4-1c4cd02547e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:39.840703 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470936e-1757-4d74-93a4-1c4cd02547e5 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:39.844812 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-d1f2eaa0-6f28-4f3c-9a94-7c0e89b387d9 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:39.846013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-d1f2eaa0-6f28-4f3c-9a94-7c0e89b387d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:39.859144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-6470936e-1757-4d74-93a4-1c4cd02547e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:39.859144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:39.859144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:39.859144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:39.859144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:39.859144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:39.859144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:39.859144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:39.859144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:39.859144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:39.859144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:39.859144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:39.859144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:39.859144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:39.859144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:39.860098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:39.860098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:39.860098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:39.860098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:39.860098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:39.860098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:39.860098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:39.860098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:39.860098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:39.860098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:39.860098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:39.860098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:39.860098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:39.860098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:39.860098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:39.860098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:39.860098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:39.860987 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:39.860987 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:39.860987 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:39.860987 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:39.860987 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 316/630] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:39.861681 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470936e-1757-4d74-93a4-1c4cd02547e5 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:39.925195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 315/631] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:39.925195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2eaa0-6f28-4f3c-9a94-7c0e89b387d9 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:39.970850 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:39.987306 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:39.989573 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470936e-1757-4d74-93a4-1c4cd02547e5 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:40.029718 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f240ff6-794d-446c-9e92-77c0d9beabe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:40.030521 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f240ff6-794d-446c-9e92-77c0d9beabe6 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:40.030801 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f240ff6-794d-446c-9e92-77c0d9beabe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:40.031068 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f240ff6-794d-446c-9e92-77c0d9beabe6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:40.031992 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2eaa0-6f28-4f3c-9a94-7c0e89b387d9 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:40.041767 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f240ff6-794d-446c-9e92-77c0d9beabe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:40.049452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-2f240ff6-794d-446c-9e92-77c0d9beabe6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:40.049452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:40.049452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:40.049452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:40.049452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:40.049452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:40.049452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:40.049452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:40.049452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:40.049452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:40.049452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:40.049452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:40.049452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:40.049452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:40.049452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:40.049452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:40.050414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:40.050414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:40.050414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:40.050414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:40.050414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:40.050414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:40.050414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:40.050414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:40.050414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:40.050414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:40.050414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:40.050414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:40.050414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:40.050414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:40.050414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:40.050414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:40.051245 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:40.051245 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:40.051245 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:40.051245 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:40.051245 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:40.051245 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:40.051245 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:40.051245 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:40.051245 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:40.051245 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:40.051245 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:40.051245 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:40.051245 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 317/632] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 01:51:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:40.051972 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f240ff6-794d-446c-9e92-77c0d9beabe6 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:40.074229 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d399e-f7ff-4969-b00d-87969071bf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:40.075021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d399e-f7ff-4969-b00d-87969071bf0d None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:40.075304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d399e-f7ff-4969-b00d-87969071bf0d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:40.075611 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d399e-f7ff-4969-b00d-87969071bf0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:40.082617 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d399e-f7ff-4969-b00d-87969071bf0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:40.084113 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d399e-f7ff-4969-b00d-87969071bf0d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:40.098828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-379d399e-f7ff-4969-b00d-87969071bf0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:40.098828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:40.098828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:40.098828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:40.098828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:40.098828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:40.098828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:40.098828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:40.098828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:40.098828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:40.098828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:40.098828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:40.098828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:51:40.098828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:51:40.098828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:51:40.099974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:51:40.099974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:40.099974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:40.099974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:40.099974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:40.099974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:40.099974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:40.099974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:40.099974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:40.099974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:40.099974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:40.099974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:40.099974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:40.099974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:40.099974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:40.099974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:40.099974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:40.100861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:51:40.100861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:51:40.100861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:51:40.100861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:51:40.100861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:51:40.100861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:51:40.100861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:40.100861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:40.100861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 316/633] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:40.101353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d399e-f7ff-4969-b00d-87969071bf0d None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:40.164338 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f240ff6-794d-446c-9e92-77c0d9beabe6 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:40.200567 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ece257-e8a8-4a0e-8c0f-96565c8ab596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:40.201332 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ece257-e8a8-4a0e-8c0f-96565c8ab596 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:40.201681 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ece257-e8a8-4a0e-8c0f-96565c8ab596 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:40.201964 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ece257-e8a8-4a0e-8c0f-96565c8ab596 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:40.202691 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ece257-e8a8-4a0e-8c0f-96565c8ab596 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:40.203001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ece257-e8a8-4a0e-8c0f-96565c8ab596 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:40.204433 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ece257-e8a8-4a0e-8c0f-96565c8ab596 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:40.207930 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d399e-f7ff-4969-b00d-87969071bf0d None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:40.221234 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 318/634] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:40.221234 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ece257-e8a8-4a0e-8c0f-96565c8ab596 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:40.228505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:40.239768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:40.253228 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187c3a2-deb8-4c5b-855c-7107a154d240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:40.254303 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187c3a2-deb8-4c5b-855c-7107a154d240 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:40.254759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187c3a2-deb8-4c5b-855c-7107a154d240 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:40.255303 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187c3a2-deb8-4c5b-855c-7107a154d240 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:40.267917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187c3a2-deb8-4c5b-855c-7107a154d240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:40.275798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-1187c3a2-deb8-4c5b-855c-7107a154d240 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:40.275798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:40.275798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:40.275798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:40.275798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:40.275798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:40.275798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:40.275798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:40.275798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:40.275798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:40.275798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:40.275798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:40.275798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:40.275798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:40.275798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:40.275798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:40.276935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:40.276935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:40.276935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:40.276935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:40.276935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:40.276935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:40.276935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:40.276935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:40.276935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:40.276935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:40.276935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:40.276935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:40.276935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:40.276935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:40.276935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:40.276935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:40.277895 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:40.277895 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:40.277895 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:40.277895 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:40.277895 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:40.277895 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:40.277895 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:40.277895 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:40.277895 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:40.277895 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:40.277895 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:40.277895 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:40.277895 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 317/635] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 01:51:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:40.278574 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187c3a2-deb8-4c5b-855c-7107a154d240 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:40.327626 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ece257-e8a8-4a0e-8c0f-96565c8ab596 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:40.365559 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e70e37-897c-4d7f-b449-13c399282460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:40.366290 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e70e37-897c-4d7f-b449-13c399282460 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:40.366505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e70e37-897c-4d7f-b449-13c399282460 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:40.366777 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e70e37-897c-4d7f-b449-13c399282460 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:40.367552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e70e37-897c-4d7f-b449-13c399282460 None admin] RBAC: Adding query filter params (name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:40.367859 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e70e37-897c-4d7f-b449-13c399282460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:40.369263 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e70e37-897c-4d7f-b449-13c399282460 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:40.381849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 319/636] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 01:51:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:40.381849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e70e37-897c-4d7f-b449-13c399282460 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:40.396977 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187c3a2-deb8-4c5b-855c-7107a154d240 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:40.430914 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cae76-fe3d-4b5a-9860-dd6e309cc0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:40.431615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cae76-fe3d-4b5a-9860-dd6e309cc0fa None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:40.431903 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cae76-fe3d-4b5a-9860-dd6e309cc0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:40.432182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cae76-fe3d-4b5a-9860-dd6e309cc0fa None admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:40.432982 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cae76-fe3d-4b5a-9860-dd6e309cc0fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:40.433297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cae76-fe3d-4b5a-9860-dd6e309cc0fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:40.434784 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cae76-fe3d-4b5a-9860-dd6e309cc0fa None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:40.447616 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 318/637] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:51:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:40.448411 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cae76-fe3d-4b5a-9860-dd6e309cc0fa None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:40.448638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:40.484137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e70e37-897c-4d7f-b449-13c399282460 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:40.497481 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:40.518507 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390c29c-4b69-4797-91b8-5031100626cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:40.519578 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390c29c-4b69-4797-91b8-5031100626cc None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:40.519861 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390c29c-4b69-4797-91b8-5031100626cc None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:40.520132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390c29c-4b69-4797-91b8-5031100626cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:40.526782 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390c29c-4b69-4797-91b8-5031100626cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:40.528269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390c29c-4b69-4797-91b8-5031100626cc None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:40.542390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-1390c29c-4b69-4797-91b8-5031100626cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:40.542390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:40.542390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:40.542390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:40.542390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:40.542390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:40.542390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:40.542390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:40.542390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:40.542390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:40.542390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:40.542390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:40.542390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:51:40.542390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:51:40.542390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:51:40.543404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:51:40.543404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:40.543404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:40.543404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:40.543404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:40.543404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:40.543404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:40.543404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:40.543404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:40.543404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:40.543404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:40.543404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:40.543404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:40.543404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:40.543404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:40.543404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:40.543404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:40.544519 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:51:40.544519 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:51:40.544519 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:51:40.544519 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:51:40.544519 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:51:40.544519 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:51:40.544519 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:40.544519 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:40.547549 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 320/638] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:40.548798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390c29c-4b69-4797-91b8-5031100626cc None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:40.551930 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cae76-fe3d-4b5a-9860-dd6e309cc0fa None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:40.586021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa287a71-aa44-42ed-a824-b84c2c23615a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:40.586686 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa287a71-aa44-42ed-a824-b84c2c23615a None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:40.586965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa287a71-aa44-42ed-a824-b84c2c23615a None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:40.587235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa287a71-aa44-42ed-a824-b84c2c23615a None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:40.588009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa287a71-aa44-42ed-a824-b84c2c23615a None admin] RBAC: Adding query filter params (name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:40.588314 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa287a71-aa44-42ed-a824-b84c2c23615a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:40.589669 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa287a71-aa44-42ed-a824-b84c2c23615a None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:40.597928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 319/639] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 01:51:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:40.599208 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c2dfb-9709-443e-b7dc-d4a6b9a84b23 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:40.599716 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c2dfb-9709-443e-b7dc-d4a6b9a84b23 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:40.600002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c2dfb-9709-443e-b7dc-d4a6b9a84b23 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:40.603458 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 320/640] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:40.603458 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c2dfb-9709-443e-b7dc-d4a6b9a84b23 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:40.651216 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390c29c-4b69-4797-91b8-5031100626cc None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:40.678784 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:40.688117 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedaa57-7367-4274-9076-67f676a5977a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:40.689002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedaa57-7367-4274-9076-67f676a5977a None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:40.689377 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedaa57-7367-4274-9076-67f676a5977a None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:40.689698 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedaa57-7367-4274-9076-67f676a5977a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:40.700191 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedaa57-7367-4274-9076-67f676a5977a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:40.701727 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedaa57-7367-4274-9076-67f676a5977a None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:40.704961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c2dfb-9709-443e-b7dc-d4a6b9a84b23 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:40.712152 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:40.720527 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-2dedaa57-7367-4274-9076-67f676a5977a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:40.720527 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:40.720527 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:40.720527 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:40.720527 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:40.720527 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:40.720527 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:40.720527 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:40.720527 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:40.720527 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:40.720527 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:40.720527 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:40.720527 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:40.720527 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:40.720527 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:40.721640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:40.721640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:40.721640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:40.721640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:40.721640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:40.721640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:40.721640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:40.721640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:40.721640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:40.721640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:40.721640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:40.721640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:40.721640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:40.721640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:40.721640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:40.721640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:40.721640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:40.722815 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:40.722815 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:40.722815 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:40.722815 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:40.726738 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 321/641] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:40.727397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedaa57-7367-4274-9076-67f676a5977a None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:40.740526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7348c-b829-400c-a514-0d9ad207a8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:40.741132 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7348c-b829-400c-a514-0d9ad207a8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:40.741413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7348c-b829-400c-a514-0d9ad207a8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:40.741684 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7348c-b829-400c-a514-0d9ad207a8c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:40.742520 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7348c-b829-400c-a514-0d9ad207a8c0 None admin] RBAC: Adding query filter params (role.id=c8b68b76c1b44e549cc7520e5546d374, scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018, user.id=9d3b5180fb7144c394c39d4db28713b9) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:40.742830 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7348c-b829-400c-a514-0d9ad207a8c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:40.744310 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7348c-b829-400c-a514-0d9ad207a8c0 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:40.750348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 321/642] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:51:40 2022] GET /identity/v3/role_assignments?user.id=9d3b5180fb7144c394c39d4db28713b9&scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018&role.id=c8b68b76c1b44e549cc7520e5546d374 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:40.751121 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7348c-b829-400c-a514-0d9ad207a8c0 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:40.836525 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedaa57-7367-4274-9076-67f676a5977a None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:40.873912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a408749-1d24-4225-af75-93eab2897643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:40.874696 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a408749-1d24-4225-af75-93eab2897643 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:40.875038 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a408749-1d24-4225-af75-93eab2897643 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:40.875379 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a408749-1d24-4225-af75-93eab2897643 None admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:40.875892 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7348c-b829-400c-a514-0d9ad207a8c0 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:40.876363 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a408749-1d24-4225-af75-93eab2897643 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:40.876739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a408749-1d24-4225-af75-93eab2897643 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:40.878360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a408749-1d24-4225-af75-93eab2897643 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:40.891676 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 322/643] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:51:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:40.893321 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61fcef-8645-4f43-96a0-af8c21d4c7d8 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:40.893606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61fcef-8645-4f43-96a0-af8c21d4c7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:40.894226 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61fcef-8645-4f43-96a0-af8c21d4c7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:40.913444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-5e61fcef-8645-4f43-96a0-af8c21d4c7d8 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:40.914955 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5e61fcef-8645-4f43-96a0-af8c21d4c7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:40.923615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ba107-b671-4627-8780-57aa542c5d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:40.923805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ba107-b671-4627-8780-57aa542c5d52 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:40.923954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ba107-b671-4627-8780-57aa542c5d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:40.924224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ba107-b671-4627-8780-57aa542c5d52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:40.936702 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ba107-b671-4627-8780-57aa542c5d52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:40.938239 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ba107-b671-4627-8780-57aa542c5d52 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:40.954798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:40.957604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-036ba107-b671-4627-8780-57aa542c5d52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:40.957604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:40.957604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:40.957604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:40.957604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:40.957604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:40.957604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:40.957604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:40.957604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:40.957604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:40.957604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:40.957604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:40.957604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:40.957604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:40.957604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:40.958548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:40.958548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:40.958548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:40.958548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:40.958548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:40.958548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:40.958548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:40.958548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:40.958548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:40.958548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:40.958548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:40.958548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:40.958548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:40.958548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:40.958548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:40.958548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:40.958548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:40.959689 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:40.959689 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:40.959689 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:40.959689 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:40.963634 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 322/644] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:40.964430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ba107-b671-4627-8780-57aa542c5d52 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:40.992098 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:40.992704 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 323/645] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:40.993791 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61fcef-8645-4f43-96a0-af8c21d4c7d8 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:41.080702 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ba107-b671-4627-8780-57aa542c5d52 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:41.104520 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61fcef-8645-4f43-96a0-af8c21d4c7d8 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:41.117877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37831269-7192-4396-b9be-751ebfcdcd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:41.118550 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37831269-7192-4396-b9be-751ebfcdcd3e None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:41.118833 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37831269-7192-4396-b9be-751ebfcdcd3e None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:41.119108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37831269-7192-4396-b9be-751ebfcdcd3e None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:41.119866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37831269-7192-4396-b9be-751ebfcdcd3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:41.120163 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37831269-7192-4396-b9be-751ebfcdcd3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:41.121533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37831269-7192-4396-b9be-751ebfcdcd3e None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:41.138832 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 323/646] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:41.138832 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37831269-7192-4396-b9be-751ebfcdcd3e None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:41.148016 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2665d9-51b6-4665-8d36-30b881ae8ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:41.148995 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2665d9-51b6-4665-8d36-30b881ae8ed1 None admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:41.149405 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2665d9-51b6-4665-8d36-30b881ae8ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:41.149626 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2665d9-51b6-4665-8d36-30b881ae8ed1 None admin] PATH_INFO: `/v3/projects/3f3b06be1b5a4b3a8235ebf22da2a018/users/1ae132c4d0b5461aa26ab929a017cb08/roles/c8b68b76c1b44e549cc7520e5546d374` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:41.166074 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2665d9-51b6-4665-8d36-30b881ae8ed1 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f3b06be1b5a4b3a8235ebf22da2a018, user_id=1ae132c4d0b5461aa26ab929a017cb08, role_id=c8b68b76c1b44e549cc7520e5546d374)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:41.167885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2665d9-51b6-4665-8d36-30b881ae8ed1 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:41.191444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 324/647] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:51:40 2022] PUT /identity/v3/projects/3f3b06be1b5a4b3a8235ebf22da2a018/users/1ae132c4d0b5461aa26ab929a017cb08/roles/c8b68b76c1b44e549cc7520e5546d374 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:51:41.191444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2665d9-51b6-4665-8d36-30b881ae8ed1 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:41.224205 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:41.247382 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:41.272156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37831269-7192-4396-b9be-751ebfcdcd3e None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:41.314307 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6eb23-44f2-4365-8d3d-91091a570f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:41.315233 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6eb23-44f2-4365-8d3d-91091a570f9e None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:41.315659 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6eb23-44f2-4365-8d3d-91091a570f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:41.316465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6eb23-44f2-4365-8d3d-91091a570f9e None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:41.317786 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6eb23-44f2-4365-8d3d-91091a570f9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:41.318201 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6eb23-44f2-4365-8d3d-91091a570f9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:41.319728 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6eb23-44f2-4365-8d3d-91091a570f9e None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:41.334360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 324/648] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:41.335492 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6eb23-44f2-4365-8d3d-91091a570f9e None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:41.341296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2665d9-51b6-4665-8d36-30b881ae8ed1 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:41.385036 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbae597-d46b-437a-a495-39862347a79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:41.385851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbae597-d46b-437a-a495-39862347a79d None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:41.386129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbae597-d46b-437a-a495-39862347a79d None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:41.386746 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbae597-d46b-437a-a495-39862347a79d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:41.399837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbae597-d46b-437a-a495-39862347a79d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:41.407443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-afbae597-d46b-437a-a495-39862347a79d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:41.407443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:41.407443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:41.407443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:41.407443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:41.407443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:41.407443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:41.407443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:41.407443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:41.407443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:41.407443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:41.407443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:41.407443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:41.407443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:41.407443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:41.407443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:41.408393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:41.408393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:41.408393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:41.408393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:41.408393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:41.408393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:41.408393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:41.408393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:41.408393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:41.408393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:41.408393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:41.408393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:41.408393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:41.408393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:41.408393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:41.408393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:41.409258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:41.409258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:41.409258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:41.409258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:41.409258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:41.409258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:41.409258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:41.409258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:41.409258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:41.409258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:41.409258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:41.409258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:41.409258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 325/649] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 01:51:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:41.409954 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbae597-d46b-437a-a495-39862347a79d None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:41.459652 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6eb23-44f2-4365-8d3d-91091a570f9e None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:41.495743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22660d-9947-43d7-ba98-420cd3ebdab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:41.496723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22660d-9947-43d7-ba98-420cd3ebdab6 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:41.497099 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22660d-9947-43d7-ba98-420cd3ebdab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:41.497529 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22660d-9947-43d7-ba98-420cd3ebdab6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:41.498817 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:41.507996 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22660d-9947-43d7-ba98-420cd3ebdab6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:41.509692 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22660d-9947-43d7-ba98-420cd3ebdab6 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:41.521671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbae597-d46b-437a-a495-39862347a79d None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:41.525668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-2b22660d-9947-43d7-ba98-420cd3ebdab6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 01:51:41.525668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:41.525668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:41.525668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:41.525668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:41.525668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:41.525668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:41.525668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:41.525668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:41.525668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:41.525668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:41.525668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:41.525668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:51:41.525668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:51:41.525668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:51:41.525668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:51:41.526805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:41.526805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:41.526805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:51:41.526805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:41.526805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:51:41.526805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:41.526805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:41.526805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:41.526805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:41.526805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:41.526805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:41.526805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:41.526805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:41.526805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:41.526805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:41.526805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:41.526805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:41.526805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:41.528019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:41.528019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:41.528019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:51:41.528019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:51:41.528019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:51:41.528019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:51:41.528019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:51:41.528019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:51:41.528019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 01:51:41.528019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:41.529754 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 325/650] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:41.530603 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22660d-9947-43d7-ba98-420cd3ebdab6 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:41.533546 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:41.564669 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0a8c2-1425-4456-afc5-e4b9b1e84b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:41.565841 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0a8c2-1425-4456-afc5-e4b9b1e84b42 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:41.566331 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0a8c2-1425-4456-afc5-e4b9b1e84b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:41.566876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0a8c2-1425-4456-afc5-e4b9b1e84b42 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:41.576276 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0a8c2-1425-4456-afc5-e4b9b1e84b42 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:41.578087 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0a8c2-1425-4456-afc5-e4b9b1e84b42 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:41.594400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-37b0a8c2-1425-4456-afc5-e4b9b1e84b42 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 01:51:41.594400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:41.594400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:41.594400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:41.594400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:41.594400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:41.594400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:41.594400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:41.594400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:41.594400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:41.594400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:41.594400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:41.594400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:51:41.594400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:51:41.594400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:51:41.594400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:51:41.595396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:41.595396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:41.595396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:51:41.595396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:41.595396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:51:41.595396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:41.595396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:41.595396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:41.595396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:41.595396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:41.595396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:41.595396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:41.595396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:41.595396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:41.595396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:41.595396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:41.595396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:41.595396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:41.596424 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:41.596424 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:41.596424 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:51:41.596424 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:51:41.596424 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:51:41.596424 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:51:41.596424 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:51:41.596424 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:51:41.596424 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 01:51:41.596424 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:41.598970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 326/651] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:41.600026 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0a8c2-1425-4456-afc5-e4b9b1e84b42 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:41.642971 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22660d-9947-43d7-ba98-420cd3ebdab6 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:41.678529 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f9aa9-25fa-4ea2-a9d5-49a75d4d7da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:41.679492 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f9aa9-25fa-4ea2-a9d5-49a75d4d7da2 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:41.679883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f9aa9-25fa-4ea2-a9d5-49a75d4d7da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:41.680249 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f9aa9-25fa-4ea2-a9d5-49a75d4d7da2 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:41.681092 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f9aa9-25fa-4ea2-a9d5-49a75d4d7da2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:41.681545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f9aa9-25fa-4ea2-a9d5-49a75d4d7da2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:41.683007 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f9aa9-25fa-4ea2-a9d5-49a75d4d7da2 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:41.696881 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 326/652] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 01:51:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:41.697874 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f9aa9-25fa-4ea2-a9d5-49a75d4d7da2 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:41.711551 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0a8c2-1425-4456-afc5-e4b9b1e84b42 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:41.747907 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc7dab-ed72-4057-94aa-3104bb63be3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:41.748912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc7dab-ed72-4057-94aa-3104bb63be3c None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:41.749341 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc7dab-ed72-4057-94aa-3104bb63be3c None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:41.749757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc7dab-ed72-4057-94aa-3104bb63be3c None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:41.750844 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc7dab-ed72-4057-94aa-3104bb63be3c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:41.751401 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc7dab-ed72-4057-94aa-3104bb63be3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:41.753093 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc7dab-ed72-4057-94aa-3104bb63be3c None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:41.763639 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:41.765176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:41.775384 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 327/653] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Jun 23 01:51:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:41.776909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc7dab-ed72-4057-94aa-3104bb63be3c None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:41.809748 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f9aa9-25fa-4ea2-a9d5-49a75d4d7da2 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:41.847617 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08060bb-e606-4591-9887-c14dde544f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:41.848533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08060bb-e606-4591-9887-c14dde544f60 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:41.848955 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08060bb-e606-4591-9887-c14dde544f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:41.849387 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08060bb-e606-4591-9887-c14dde544f60 None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:41.850475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08060bb-e606-4591-9887-c14dde544f60 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:41.851067 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08060bb-e606-4591-9887-c14dde544f60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:41.852836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08060bb-e606-4591-9887-c14dde544f60 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:41.876937 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 327/654] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Jun 23 01:51:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:41.878311 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08060bb-e606-4591-9887-c14dde544f60 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:41.882059 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc7dab-ed72-4057-94aa-3104bb63be3c None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:41.920640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa376f-87cb-498c-8001-d56e9ce8cd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:41.921361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa376f-87cb-498c-8001-d56e9ce8cd40 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:41.921651 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa376f-87cb-498c-8001-d56e9ce8cd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:41.921924 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa376f-87cb-498c-8001-d56e9ce8cd40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:41.933666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa376f-87cb-498c-8001-d56e9ce8cd40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:41.935235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa376f-87cb-498c-8001-d56e9ce8cd40 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:41.954763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-01aa376f-87cb-498c-8001-d56e9ce8cd40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:41.954763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:41.954763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:41.954763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:41.954763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:41.954763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:41.954763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:41.954763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:41.954763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:41.954763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:41.954763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:41.954763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:41.954763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:41.954763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:41.954763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:41.955743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:41.955743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:41.955743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:41.955743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:41.955743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:41.955743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:41.955743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:41.955743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:41.955743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:41.955743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:41.955743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:41.955743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:41.955743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:41.955743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:41.955743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:41.955743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:41.955743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:41.956896 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:41.956896 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:41.956896 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:41.956896 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:41.960961 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 328/655] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:41.961900 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa376f-87cb-498c-8001-d56e9ce8cd40 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:41.994979 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08060bb-e606-4591-9887-c14dde544f60 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:42.014977 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:42.021365 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:42.035446 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461eecea-db95-4fbe-b2de-ebda7569c2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:42.036419 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eecea-db95-4fbe-b2de-ebda7569c2af None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:42.036903 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eecea-db95-4fbe-b2de-ebda7569c2af None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:42.037446 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eecea-db95-4fbe-b2de-ebda7569c2af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:42.069650 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa376f-87cb-498c-8001-d56e9ce8cd40 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:42.105970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b453aef-4a6a-4615-8f63-0342dc0b236c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:42.106642 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b453aef-4a6a-4615-8f63-0342dc0b236c None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:42.106930 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b453aef-4a6a-4615-8f63-0342dc0b236c None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:42.107209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b453aef-4a6a-4615-8f63-0342dc0b236c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:42.110404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461eecea-db95-4fbe-b2de-ebda7569c2af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:42.112221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461eecea-db95-4fbe-b2de-ebda7569c2af None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:42.178659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b453aef-4a6a-4615-8f63-0342dc0b236c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:42.180230 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b453aef-4a6a-4615-8f63-0342dc0b236c None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:42.217307 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 328/656] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:51:42.218547 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461eecea-db95-4fbe-b2de-ebda7569c2af None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:42.232167 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:42.245413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:42.294349 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 329/657] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:51:42.294349 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b453aef-4a6a-4615-8f63-0342dc0b236c None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:42.333059 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461eecea-db95-4fbe-b2de-ebda7569c2af None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:42.370091 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab7db1-eb7a-4da2-94e5-a67e80699752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:42.371197 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab7db1-eb7a-4da2-94e5-a67e80699752 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:42.371765 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab7db1-eb7a-4da2-94e5-a67e80699752 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:42.372330 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab7db1-eb7a-4da2-94e5-a67e80699752 None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:42.373296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab7db1-eb7a-4da2-94e5-a67e80699752 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:42.373898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab7db1-eb7a-4da2-94e5-a67e80699752 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:42.375490 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab7db1-eb7a-4da2-94e5-a67e80699752 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:42.389050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 329/658] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:42.390353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab7db1-eb7a-4da2-94e5-a67e80699752 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:42.402743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b453aef-4a6a-4615-8f63-0342dc0b236c None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:42.439992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430cfaf-11bc-4a9a-8704-cbedccdb81aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:42.440877 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430cfaf-11bc-4a9a-8704-cbedccdb81aa None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:42.441236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430cfaf-11bc-4a9a-8704-cbedccdb81aa None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:42.441722 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430cfaf-11bc-4a9a-8704-cbedccdb81aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:42.453144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430cfaf-11bc-4a9a-8704-cbedccdb81aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:42.454732 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430cfaf-11bc-4a9a-8704-cbedccdb81aa None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:42.474287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-8430cfaf-11bc-4a9a-8704-cbedccdb81aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:42.474287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:42.474287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:42.474287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:42.474287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:42.474287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:42.474287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:42.474287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:42.474287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:42.474287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:42.474287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:42.474287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:42.474287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:42.474287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:42.474287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:42.475250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:42.475250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:42.475250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:42.475250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:42.475250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:42.475250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:42.475250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:42.475250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:42.475250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:42.475250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:42.475250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:42.475250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:42.475250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:42.475250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:42.475250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:42.475250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:42.475250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:42.476179 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:42.476179 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:42.476179 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:42.476179 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:42.476179 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 330/659] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:42.476878 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430cfaf-11bc-4a9a-8704-cbedccdb81aa None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:42.479547 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:42.485219 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:42.505509 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab7db1-eb7a-4da2-94e5-a67e80699752 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:42.547701 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000881a7-6a27-41a6-a852-893c94fecd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:42.548570 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000881a7-6a27-41a6-a852-893c94fecd21 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:42.548993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000881a7-6a27-41a6-a852-893c94fecd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:42.549384 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000881a7-6a27-41a6-a852-893c94fecd21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:42.561485 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000881a7-6a27-41a6-a852-893c94fecd21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:42.563100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000881a7-6a27-41a6-a852-893c94fecd21 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:42.581772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-000881a7-6a27-41a6-a852-893c94fecd21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:42.581772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:42.581772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:42.581772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:42.581772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:42.581772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:42.581772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:42.581772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:42.581772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:42.581772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:42.581772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:42.581772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:42.581772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:42.581772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:42.581772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:42.583048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:42.583048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:42.583048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:42.583048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:42.583048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:42.583048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:42.583048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:42.583048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:42.583048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:42.583048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:42.583048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:42.583048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:42.583048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:42.583048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:42.583048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:42.583048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:42.583048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:42.584259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:42.584259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:42.584259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:42.584259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:42.589836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 330/660] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:42.590908 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000881a7-6a27-41a6-a852-893c94fecd21 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:42.593515 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430cfaf-11bc-4a9a-8704-cbedccdb81aa None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:42.630378 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d10a1-73df-486f-9ca7-b8951c8f57e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:42.631480 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d10a1-73df-486f-9ca7-b8951c8f57e7 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:42.631924 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d10a1-73df-486f-9ca7-b8951c8f57e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:42.632340 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d10a1-73df-486f-9ca7-b8951c8f57e7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:42.640212 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d10a1-73df-486f-9ca7-b8951c8f57e7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:42.641947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d10a1-73df-486f-9ca7-b8951c8f57e7 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:42.658129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-566d10a1-73df-486f-9ca7-b8951c8f57e7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 01:51:42.658129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:42.658129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:42.658129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:42.658129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:42.658129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:42.658129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:42.658129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:42.658129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:42.658129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:42.658129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:42.658129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:42.658129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:51:42.658129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:51:42.658129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:51:42.658129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:51:42.659129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:42.659129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:42.659129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:51:42.659129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:42.659129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:51:42.659129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:42.659129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:42.659129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:42.659129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:42.659129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:42.659129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:42.659129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:42.659129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:42.659129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:42.659129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:42.659129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:42.659129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:42.659129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:42.660161 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:42.660161 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:42.660161 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:51:42.660161 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:51:42.660161 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:51:42.660161 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:51:42.660161 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:51:42.660161 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:51:42.660161 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 01:51:42.660161 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:42.667507 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 331/661] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 01:51:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:42.668596 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d10a1-73df-486f-9ca7-b8951c8f57e7 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:42.699798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000881a7-6a27-41a6-a852-893c94fecd21 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:42.734385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:42.736400 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482246e4-200b-426b-9b89-33437a10539d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:42.737224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482246e4-200b-426b-9b89-33437a10539d None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:42.737546 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482246e4-200b-426b-9b89-33437a10539d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:42.737948 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482246e4-200b-426b-9b89-33437a10539d None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:42.739049 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482246e4-200b-426b-9b89-33437a10539d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:42.739788 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482246e4-200b-426b-9b89-33437a10539d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:42.741282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482246e4-200b-426b-9b89-33437a10539d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:42.743016 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:42.755259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 331/662] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:42.756357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482246e4-200b-426b-9b89-33437a10539d None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:42.782323 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d10a1-73df-486f-9ca7-b8951c8f57e7 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:42.820517 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153bf85-93c7-47b6-8607-cd61fbe4e7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:42.821507 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153bf85-93c7-47b6-8607-cd61fbe4e7bb None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:42.821979 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153bf85-93c7-47b6-8607-cd61fbe4e7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:42.822532 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153bf85-93c7-47b6-8607-cd61fbe4e7bb None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:42.823573 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153bf85-93c7-47b6-8607-cd61fbe4e7bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:42.824080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153bf85-93c7-47b6-8607-cd61fbe4e7bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:42.825649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153bf85-93c7-47b6-8607-cd61fbe4e7bb None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:42.838285 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 332/663] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:42.839454 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153bf85-93c7-47b6-8607-cd61fbe4e7bb None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:42.863360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482246e4-200b-426b-9b89-33437a10539d None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:42.900635 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54660ab7-30c5-4fb8-a3f6-da04ee31e4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:42.901313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54660ab7-30c5-4fb8-a3f6-da04ee31e4cc None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:42.901595 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54660ab7-30c5-4fb8-a3f6-da04ee31e4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:42.901869 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54660ab7-30c5-4fb8-a3f6-da04ee31e4cc None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:42.902706 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54660ab7-30c5-4fb8-a3f6-da04ee31e4cc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:42.903014 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54660ab7-30c5-4fb8-a3f6-da04ee31e4cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:42.904471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54660ab7-30c5-4fb8-a3f6-da04ee31e4cc None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:42.927400 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 332/664] 10.222.0.13 () {56 vars in 1139 bytes} [Thu Jun 23 01:51:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:42.929524 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c51809-1653-43ef-995a-fc6b87cf534a None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:42.929825 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c51809-1653-43ef-995a-fc6b87cf534a None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:42.930102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c51809-1653-43ef-995a-fc6b87cf534a None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:42.935910 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 333/665] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:42.935910 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c51809-1653-43ef-995a-fc6b87cf534a None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:42.953512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153bf85-93c7-47b6-8607-cd61fbe4e7bb None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:42.977492 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:42.988372 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:42.991529 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c1839-3ac5-48f3-af10-b8a15a225ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:42.992353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c1839-3ac5-48f3-af10-b8a15a225ded None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:42.992795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c1839-3ac5-48f3-af10-b8a15a225ded None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:42.993078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c1839-3ac5-48f3-af10-b8a15a225ded None admin] PATH_INFO: `/v3/projects/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:43.000617 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c1839-3ac5-48f3-af10-b8a15a225ded None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:43.002071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c1839-3ac5-48f3-af10-b8a15a225ded None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:43.016078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-158c1839-3ac5-48f3-af10-b8a15a225ded None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:43.016078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:43.016078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:43.016078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:43.016078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:43.016078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:43.016078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:43.016078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:43.016078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:43.016078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:43.016078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:43.016078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:43.016078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:51:43.016078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:51:43.016078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:51:43.017050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:51:43.017050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:43.017050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:43.017050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:43.017050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:43.017050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:43.017050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:43.017050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:43.017050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:43.017050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:43.017050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:43.017050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:43.017050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:43.017050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:43.017050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:43.017050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:43.017050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:43.017978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:51:43.017978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:51:43.017978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:51:43.017978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:51:43.017978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:51:43.017978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:51:43.017978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:43.017978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:43.017978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 333/666] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:43.019088 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c1839-3ac5-48f3-af10-b8a15a225ded None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:43.045244 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c51809-1653-43ef-995a-fc6b87cf534a None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:43.081760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c748615-9f1a-45f6-be78-d88d095309e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:43.082594 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c748615-9f1a-45f6-be78-d88d095309e5 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:43.082873 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c748615-9f1a-45f6-be78-d88d095309e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:43.083142 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c748615-9f1a-45f6-be78-d88d095309e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:43.089882 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c748615-9f1a-45f6-be78-d88d095309e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:43.091318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c748615-9f1a-45f6-be78-d88d095309e5 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:43.105370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-5c748615-9f1a-45f6-be78-d88d095309e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:43.105370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:43.105370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:43.105370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:43.105370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:43.105370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:43.105370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:43.105370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:43.105370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:43.105370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:43.105370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:43.105370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:43.105370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:51:43.105370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:51:43.105370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:51:43.106545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:51:43.106545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:43.106545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:43.106545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:43.106545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:43.106545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:43.106545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:43.106545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:43.106545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:43.106545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:43.106545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:43.106545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:43.106545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:43.106545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:43.106545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:43.106545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:43.106545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:43.107499 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:51:43.107499 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:51:43.107499 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:51:43.107499 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:51:43.107499 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:51:43.107499 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:51:43.107499 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:43.107499 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:43.111559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 334/667] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:43.112746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84701b-10af-4ba9-a9a2-d24719ea1621 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:43.113021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84701b-10af-4ba9-a9a2-d24719ea1621 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:43.113293 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84701b-10af-4ba9-a9a2-d24719ea1621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:43.130049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c1839-3ac5-48f3-af10-b8a15a225ded None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:43.131347 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-6a84701b-10af-4ba9-a9a2-d24719ea1621 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:43.132576 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-6a84701b-10af-4ba9-a9a2-d24719ea1621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:43.167052 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ff2fc-db5d-45f2-ab7d-339afdacb64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:43.167743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ff2fc-db5d-45f2-ab7d-339afdacb64d None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:43.168068 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ff2fc-db5d-45f2-ab7d-339afdacb64d None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:43.168339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ff2fc-db5d-45f2-ab7d-339afdacb64d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:43.211555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 335/668] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:43.212846 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84701b-10af-4ba9-a9a2-d24719ea1621 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:43.225486 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:43.240613 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ff2fc-db5d-45f2-ab7d-339afdacb64d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:43.242102 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ff2fc-db5d-45f2-ab7d-339afdacb64d None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:43.265240 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:43.327340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84701b-10af-4ba9-a9a2-d24719ea1621 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:43.343711 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 334/669] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:51:43.344479 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ff2fc-db5d-45f2-ab7d-339afdacb64d None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:43.362560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de2c51-7c49-4273-b3fb-8ef9fb7b326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:43.363441 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de2c51-7c49-4273-b3fb-8ef9fb7b326f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:43.363727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de2c51-7c49-4273-b3fb-8ef9fb7b326f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:43.363996 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de2c51-7c49-4273-b3fb-8ef9fb7b326f None admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:43.364789 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de2c51-7c49-4273-b3fb-8ef9fb7b326f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:43.365101 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de2c51-7c49-4273-b3fb-8ef9fb7b326f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:43.366535 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de2c51-7c49-4273-b3fb-8ef9fb7b326f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:43.378069 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 336/670] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:51:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:43.379209 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de2c51-7c49-4273-b3fb-8ef9fb7b326f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:43.423493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:43.441867 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ff2fc-db5d-45f2-ab7d-339afdacb64d None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:43.476859 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a82a7-18ad-41e9-8c4d-127daf5c93bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:43.477536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a82a7-18ad-41e9-8c4d-127daf5c93bd None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:43.477794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a82a7-18ad-41e9-8c4d-127daf5c93bd None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:43.478063 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a82a7-18ad-41e9-8c4d-127daf5c93bd None admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:43.478841 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a82a7-18ad-41e9-8c4d-127daf5c93bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:43.478977 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de2c51-7c49-4273-b3fb-8ef9fb7b326f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:43.479146 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a82a7-18ad-41e9-8c4d-127daf5c93bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:43.480544 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:43.480670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a82a7-18ad-41e9-8c4d-127daf5c93bd None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:43.492622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 335/671] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:51:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:43.494048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bbe3d-db23-4fa9-86ab-0224b8c906d6 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:43.494332 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bbe3d-db23-4fa9-86ab-0224b8c906d6 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:43.494606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bbe3d-db23-4fa9-86ab-0224b8c906d6 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:43.496028 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 336/672] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:43.496550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bbe3d-db23-4fa9-86ab-0224b8c906d6 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:43.516412 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8de84-26b8-40da-8de4-f62ea0774d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:43.517294 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8de84-26b8-40da-8de4-f62ea0774d77 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:43.517577 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8de84-26b8-40da-8de4-f62ea0774d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:43.517850 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8de84-26b8-40da-8de4-f62ea0774d77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:43.528364 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8de84-26b8-40da-8de4-f62ea0774d77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:43.536193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-6af8de84-26b8-40da-8de4-f62ea0774d77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:51:43.536193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:43.536193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:43.536193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:43.536193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:43.536193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:43.536193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:43.536193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:43.536193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:43.536193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:43.536193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:43.536193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:43.536193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:43.536193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:43.536193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:43.536193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:43.537156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:43.537156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:43.537156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:43.537156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:43.537156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:43.537156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:43.537156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:43.537156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:43.537156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:43.537156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:43.537156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:43.537156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:43.537156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:43.537156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:43.537156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:43.537156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:43.538102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:43.538102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:43.538102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:43.538102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:43.538102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:43.538102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:43.538102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:43.538102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:43.538102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:43.538102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:43.538102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:51:43.538102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:43.538102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 337/673] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:51:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:43.538818 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8de84-26b8-40da-8de4-f62ea0774d77 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:43.603393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bbe3d-db23-4fa9-86ab-0224b8c906d6 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:43.635927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f26a43-322b-4220-b392-93b6a022de79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:43.636730 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f26a43-322b-4220-b392-93b6a022de79 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:43.637010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f26a43-322b-4220-b392-93b6a022de79 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:43.637288 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f26a43-322b-4220-b392-93b6a022de79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:43.641741 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8de84-26b8-40da-8de4-f62ea0774d77 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:43.648726 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f26a43-322b-4220-b392-93b6a022de79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:43.650198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f26a43-322b-4220-b392-93b6a022de79 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:43.652053 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:43.668927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-05f26a43-322b-4220-b392-93b6a022de79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:43.668927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:43.668927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:43.668927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:43.668927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:43.668927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:43.668927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:43.668927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:43.668927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:43.668927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:43.668927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:43.668927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:43.668927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:43.668927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:43.668927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:43.669967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:43.669967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:43.669967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:43.669967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:43.669967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:43.669967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:43.669967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:43.669967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:43.669967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:43.669967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:43.669967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:43.669967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:43.669967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:43.669967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:43.669967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:43.669967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:43.669967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:43.671033 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:43.671033 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:43.671033 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:43.671033 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:43.671033 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 337/674] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:43.671033 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f26a43-322b-4220-b392-93b6a022de79 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:43.677525 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f115792-2a59-41ee-bea4-15d0b961b018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:43.678189 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f115792-2a59-41ee-bea4-15d0b961b018 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:43.678472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f115792-2a59-41ee-bea4-15d0b961b018 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:43.678746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f115792-2a59-41ee-bea4-15d0b961b018 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:43.679620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f115792-2a59-41ee-bea4-15d0b961b018 None admin] RBAC: Adding query filter params (role.id=c8b68b76c1b44e549cc7520e5546d374, scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018, user.id=46aba36939c549278bcdee7a04511e27) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:43.679936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f115792-2a59-41ee-bea4-15d0b961b018 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:43.681380 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f115792-2a59-41ee-bea4-15d0b961b018 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:43.687854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 338/675] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:51:43 2022] GET /identity/v3/role_assignments?user.id=46aba36939c549278bcdee7a04511e27&scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018&role.id=c8b68b76c1b44e549cc7520e5546d374 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:43.688847 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee35e5b-8af8-4abf-87d3-96b06a8e4d8f None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:43.689132 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee35e5b-8af8-4abf-87d3-96b06a8e4d8f None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:43.689412 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee35e5b-8af8-4abf-87d3-96b06a8e4d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:43.708619 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-2ee35e5b-8af8-4abf-87d3-96b06a8e4d8f None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:43.709919 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-2ee35e5b-8af8-4abf-87d3-96b06a8e4d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:43.732725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:43.785894 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f26a43-322b-4220-b392-93b6a022de79 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:43.791662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 339/676] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:43.791662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee35e5b-8af8-4abf-87d3-96b06a8e4d8f None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:43.828501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d41c0-da09-434d-86e8-901d1c3de841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:43.829265 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d41c0-da09-434d-86e8-901d1c3de841 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:43.829610 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d41c0-da09-434d-86e8-901d1c3de841 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:43.829947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d41c0-da09-434d-86e8-901d1c3de841 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:43.830847 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d41c0-da09-434d-86e8-901d1c3de841 None admin] RBAC: Adding query filter params (role.id=c8b68b76c1b44e549cc7520e5546d374, scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018, user.id=883b947de43d4779b5f95103775430c6) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:43.831224 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d41c0-da09-434d-86e8-901d1c3de841 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:43.832856 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d41c0-da09-434d-86e8-901d1c3de841 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:43.839610 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 338/677] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:51:43 2022] GET /identity/v3/role_assignments?user.id=883b947de43d4779b5f95103775430c6&scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018&role.id=c8b68b76c1b44e549cc7520e5546d374 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:43.840230 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d41c0-da09-434d-86e8-901d1c3de841 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:43.923617 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:43.942558 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee35e5b-8af8-4abf-87d3-96b06a8e4d8f None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:43.985185 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d41c0-da09-434d-86e8-901d1c3de841 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:43.996190 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5bbe5-3680-40eb-b0cf-5fee03b6c9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:43.997456 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5bbe5-3680-40eb-b0cf-5fee03b6c9be None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:43.997746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5bbe5-3680-40eb-b0cf-5fee03b6c9be None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:43.998019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5bbe5-3680-40eb-b0cf-5fee03b6c9be None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:43.999276 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5bbe5-3680-40eb-b0cf-5fee03b6c9be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:43.999898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5bbe5-3680-40eb-b0cf-5fee03b6c9be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:44.001594 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5bbe5-3680-40eb-b0cf-5fee03b6c9be None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:44.014529 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 340/678] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:44.015397 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5bbe5-3680-40eb-b0cf-5fee03b6c9be None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:44.027080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de4973-f198-47c1-a7cf-2488c1a3fcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:44.027805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de4973-f198-47c1-a7cf-2488c1a3fcc2 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:44.028085 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de4973-f198-47c1-a7cf-2488c1a3fcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:44.028366 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de4973-f198-47c1-a7cf-2488c1a3fcc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:44.029098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de4973-f198-47c1-a7cf-2488c1a3fcc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:44.029400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de4973-f198-47c1-a7cf-2488c1a3fcc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:44.030798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de4973-f198-47c1-a7cf-2488c1a3fcc2 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:44.038059 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:44.047650 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 339/679] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:44.048330 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de4973-f198-47c1-a7cf-2488c1a3fcc2 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:44.135529 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5bbe5-3680-40eb-b0cf-5fee03b6c9be None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:44.164884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de4973-f198-47c1-a7cf-2488c1a3fcc2 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:44.185204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:44.186401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc216ea-8f07-4784-ba90-2682e2abdb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:44.187374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc216ea-8f07-4784-ba90-2682e2abdb63 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:44.187868 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc216ea-8f07-4784-ba90-2682e2abdb63 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:44.188370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc216ea-8f07-4784-ba90-2682e2abdb63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:44.203650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc216ea-8f07-4784-ba90-2682e2abdb63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:44.204565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4698b20-c0cf-45e2-90af-5a9f1efd9924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:44.205571 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4698b20-c0cf-45e2-90af-5a9f1efd9924 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:44.206027 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4698b20-c0cf-45e2-90af-5a9f1efd9924 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:44.206598 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4698b20-c0cf-45e2-90af-5a9f1efd9924 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:44.212286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-edc216ea-8f07-4784-ba90-2682e2abdb63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:44.212286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:44.212286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:44.212286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:44.212286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:44.212286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:44.212286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:44.212286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:44.212286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:44.212286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:44.212286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:44.212286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:44.212286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:44.212286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:44.212286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:44.212286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:44.213227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:44.213227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:44.213227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:44.213227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:44.213227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:44.213227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:44.213227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:44.213227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:44.213227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:44.213227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:44.213227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:44.213227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:44.213227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:44.213227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:44.213227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:44.213227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:44.214080 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:44.214080 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:44.214080 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:44.214080 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:44.214080 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:44.214080 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:44.214080 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:44.214080 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:44.214080 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:44.214080 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:44.214080 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:44.214080 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:44.214080 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 341/680] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 01:51:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:44.214779 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc216ea-8f07-4784-ba90-2682e2abdb63 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:44.226680 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4698b20-c0cf-45e2-90af-5a9f1efd9924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:44.228559 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4698b20-c0cf-45e2-90af-5a9f1efd9924 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:44.247539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-a4698b20-c0cf-45e2-90af-5a9f1efd9924 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:44.247539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:44.247539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:44.247539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:44.247539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:44.247539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:44.247539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:44.247539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:44.247539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:44.247539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:44.247539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:44.247539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:44.247539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:44.247539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:44.247539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:44.248493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:44.248493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:44.248493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:44.248493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:44.248493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:44.248493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:44.248493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:44.248493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:44.248493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:44.248493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:44.248493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:44.248493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:44.248493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:44.248493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:44.248493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:44.248493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:44.248493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:44.249390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:44.249390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:44.249390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:44.249390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:44.251476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 340/681] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:44.252738 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4698b20-c0cf-45e2-90af-5a9f1efd9924 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:44.312704 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:44.341916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc216ea-8f07-4784-ba90-2682e2abdb63 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:44.359867 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4698b20-c0cf-45e2-90af-5a9f1efd9924 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:44.385859 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b2247-b3ba-4408-88fd-ed6d550a832f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:44.387088 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b2247-b3ba-4408-88fd-ed6d550a832f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:44.387890 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b2247-b3ba-4408-88fd-ed6d550a832f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:44.388311 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b2247-b3ba-4408-88fd-ed6d550a832f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:44.397905 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b2247-b3ba-4408-88fd-ed6d550a832f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:44.399815 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b2247-b3ba-4408-88fd-ed6d550a832f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:44.400424 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3057a43-3903-45fd-b3cc-a84257c08d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:44.401121 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3057a43-3903-45fd-b3cc-a84257c08d10 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:44.401417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3057a43-3903-45fd-b3cc-a84257c08d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:44.401999 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3057a43-3903-45fd-b3cc-a84257c08d10 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:44.402771 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3057a43-3903-45fd-b3cc-a84257c08d10 None admin] RBAC: Adding query filter params (name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:44.403084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3057a43-3903-45fd-b3cc-a84257c08d10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:44.404497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3057a43-3903-45fd-b3cc-a84257c08d10 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:44.414303 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 341/682] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 01:51:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:44.415139 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3057a43-3903-45fd-b3cc-a84257c08d10 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:44.419662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-762b2247-b3ba-4408-88fd-ed6d550a832f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:44.419662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:44.419662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:44.419662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:44.419662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:44.419662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:44.419662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:44.419662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:44.419662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:44.419662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:44.419662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:44.419662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:44.419662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:51:44.419662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:51:44.419662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:51:44.420690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:51:44.420690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:44.420690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:44.420690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:44.420690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:44.420690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:44.420690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:44.420690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:44.420690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:44.420690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:44.420690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:44.420690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:44.420690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:44.420690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:44.420690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:44.420690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:44.420690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:44.421798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:51:44.421798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:51:44.421798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:51:44.421798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:51:44.421798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:51:44.421798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:51:44.421798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:44.421798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:44.424242 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 342/683] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:44.425300 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b2247-b3ba-4408-88fd-ed6d550a832f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:44.447980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:44.520888 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3057a43-3903-45fd-b3cc-a84257c08d10 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:44.551994 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b2247-b3ba-4408-88fd-ed6d550a832f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:44.557608 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22735c86-48e5-411b-9d26-52532cd8513b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:44.558472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22735c86-48e5-411b-9d26-52532cd8513b None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:44.558916 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22735c86-48e5-411b-9d26-52532cd8513b None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:44.559338 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22735c86-48e5-411b-9d26-52532cd8513b None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:44.560298 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22735c86-48e5-411b-9d26-52532cd8513b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:44.561584 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22735c86-48e5-411b-9d26-52532cd8513b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:44.563588 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22735c86-48e5-411b-9d26-52532cd8513b None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:44.584672 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 342/684] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:44.585605 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22735c86-48e5-411b-9d26-52532cd8513b None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:44.598532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb89111-433e-4017-8d25-5eec07300047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:44.600185 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb89111-433e-4017-8d25-5eec07300047 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:44.600679 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb89111-433e-4017-8d25-5eec07300047 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:44.601551 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb89111-433e-4017-8d25-5eec07300047 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:44.610538 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:44.617372 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb89111-433e-4017-8d25-5eec07300047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:44.619741 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb89111-433e-4017-8d25-5eec07300047 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:44.643482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-ccb89111-433e-4017-8d25-5eec07300047 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:44.643482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:44.643482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:44.643482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:44.643482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:44.643482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:44.643482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:44.643482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:44.643482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:44.643482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:44.643482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:44.643482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:44.643482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:44.643482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:44.643482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:44.644466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:44.644466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:44.644466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:44.644466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:44.644466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:44.644466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:44.644466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:44.644466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:44.644466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:44.644466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:44.644466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:44.644466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:44.644466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:44.644466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:44.644466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:44.644466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:44.644466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:44.645341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:44.645341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:44.645341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:44.645341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:44.648402 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 343/685] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:44.649492 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb89111-433e-4017-8d25-5eec07300047 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:44.694017 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:44.705734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22735c86-48e5-411b-9d26-52532cd8513b None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:44.742068 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fd3eb-12fe-44be-81f5-00c3497568c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:44.742775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fd3eb-12fe-44be-81f5-00c3497568c8 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:44.743056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fd3eb-12fe-44be-81f5-00c3497568c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:44.743328 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fd3eb-12fe-44be-81f5-00c3497568c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:44.744418 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fd3eb-12fe-44be-81f5-00c3497568c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:44.744544 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fd3eb-12fe-44be-81f5-00c3497568c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:44.745882 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fd3eb-12fe-44be-81f5-00c3497568c8 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:44.758483 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 343/686] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:51:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:44.759222 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fd3eb-12fe-44be-81f5-00c3497568c8 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:44.781349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb89111-433e-4017-8d25-5eec07300047 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:44.830346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5678b-db53-49fe-aad7-60bcef48b60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:44.831148 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5678b-db53-49fe-aad7-60bcef48b60f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:44.831523 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5678b-db53-49fe-aad7-60bcef48b60f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:44.831861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5678b-db53-49fe-aad7-60bcef48b60f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:44.839846 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5678b-db53-49fe-aad7-60bcef48b60f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:44.841296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5678b-db53-49fe-aad7-60bcef48b60f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:44.856026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-26e5678b-db53-49fe-aad7-60bcef48b60f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 01:51:44.856026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:44.856026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:44.856026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:44.856026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:44.856026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:44.856026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:44.856026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:44.856026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:44.856026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:44.856026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:44.856026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:44.856026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:51:44.856026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:51:44.856026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:51:44.856026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:51:44.856990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:44.856990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:44.856990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:51:44.856990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:44.856990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:51:44.856990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:44.856990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:44.856990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:44.856990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:44.856990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:44.856990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:44.856990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:44.856990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:44.856990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:44.856990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:44.856990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:44.856990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:44.856990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:44.857941 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:44.857941 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:44.857941 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:51:44.857941 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:51:44.857941 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:51:44.857941 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:51:44.857941 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:51:44.857941 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:51:44.857941 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 01:51:44.857941 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:44.862091 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 344/687] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 23 01:51:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:44.863094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5678b-db53-49fe-aad7-60bcef48b60f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:44.873428 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fd3eb-12fe-44be-81f5-00c3497568c8 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:44.920221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:44.928114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c069a-a292-4a32-915c-29a04822afa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:44.928942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c069a-a292-4a32-915c-29a04822afa9 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:44.929510 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c069a-a292-4a32-915c-29a04822afa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:44.929656 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c069a-a292-4a32-915c-29a04822afa9 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:44.930439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c069a-a292-4a32-915c-29a04822afa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:44.930798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c069a-a292-4a32-915c-29a04822afa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:44.932375 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c069a-a292-4a32-915c-29a04822afa9 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:44.951250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 344/688] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:44.952557 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c069a-a292-4a32-915c-29a04822afa9 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:44.968225 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:44.989413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5678b-db53-49fe-aad7-60bcef48b60f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:45.033529 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aa3f1-1635-411f-9640-bd382d5e77fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:45.035022 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aa3f1-1635-411f-9640-bd382d5e77fd None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:45.035535 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aa3f1-1635-411f-9640-bd382d5e77fd None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:45.035985 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aa3f1-1635-411f-9640-bd382d5e77fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:45.037449 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04aa3f1-1635-411f-9640-bd382d5e77fd None admin] RBAC: Adding query filter params (role.id=c8b68b76c1b44e549cc7520e5546d374, scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018, user.id=8cda12550db1442ab04f30b9875fdbea) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:45.037954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04aa3f1-1635-411f-9640-bd382d5e77fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:45.040230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04aa3f1-1635-411f-9640-bd382d5e77fd None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:45.049699 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 345/689] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:51:44 2022] GET /identity/v3/role_assignments?user.id=8cda12550db1442ab04f30b9875fdbea&scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018&role.id=c8b68b76c1b44e549cc7520e5546d374 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:45.050980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aa3f1-1635-411f-9640-bd382d5e77fd None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:45.079924 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c069a-a292-4a32-915c-29a04822afa9 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:45.153748 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6e9b4-735a-4c62-a969-b3da4cb19b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:45.154447 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6e9b4-735a-4c62-a969-b3da4cb19b62 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:45.154726 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6e9b4-735a-4c62-a969-b3da4cb19b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:45.155000 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6e9b4-735a-4c62-a969-b3da4cb19b62 None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:45.155884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6e9b4-735a-4c62-a969-b3da4cb19b62 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:45.156196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6e9b4-735a-4c62-a969-b3da4cb19b62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:45.157868 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6e9b4-735a-4c62-a969-b3da4cb19b62 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:45.171161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aa3f1-1635-411f-9640-bd382d5e77fd None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:45.201874 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 345/690] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 23 01:51:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:45.203783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:45.208522 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6e9b4-735a-4c62-a969-b3da4cb19b62 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:45.214456 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1c180-6833-4809-a92e-a715c3b6ce96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:45.215282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1c180-6833-4809-a92e-a715c3b6ce96 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:45.215604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1c180-6833-4809-a92e-a715c3b6ce96 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:45.215872 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1c180-6833-4809-a92e-a715c3b6ce96 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:45.231052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1c180-6833-4809-a92e-a715c3b6ce96 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:45.232521 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1c180-6833-4809-a92e-a715c3b6ce96 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:45.267713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-a0a1c180-6833-4809-a92e-a715c3b6ce96 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 01:51:45.267713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:45.267713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:45.267713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:45.267713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:45.267713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:45.267713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:45.267713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:45.267713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:45.267713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:45.267713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:45.267713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:45.267713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:51:45.267713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:51:45.267713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:51:45.267713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:51:45.268770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:45.268770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:45.268770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:51:45.268770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:45.268770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:51:45.268770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:45.268770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:45.268770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:45.268770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:45.268770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:45.268770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:45.268770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:45.268770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:45.268770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:45.268770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:45.268770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:45.268770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:45.268770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:45.269826 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:45.269826 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:45.269826 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:51:45.269826 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:51:45.269826 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:51:45.269826 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:51:45.269826 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:51:45.269826 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:51:45.269826 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 01:51:45.269826 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:45.269826 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 346/691] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:51:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:45.275922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1c180-6833-4809-a92e-a715c3b6ce96 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:45.329227 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:45.367909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6e9b4-735a-4c62-a969-b3da4cb19b62 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:45.395457 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1c180-6833-4809-a92e-a715c3b6ce96 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:45.406862 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bfd7a-1b34-4a06-8e2e-ce48980ff782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:45.407963 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bfd7a-1b34-4a06-8e2e-ce48980ff782 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:45.408468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bfd7a-1b34-4a06-8e2e-ce48980ff782 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:45.409009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bfd7a-1b34-4a06-8e2e-ce48980ff782 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:45.436615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d764df2-4960-4d9e-b077-5d15f62e8ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:45.437298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d764df2-4960-4d9e-b077-5d15f62e8ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:45.437576 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d764df2-4960-4d9e-b077-5d15f62e8ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:45.437844 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d764df2-4960-4d9e-b077-5d15f62e8ae3 None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:45.438854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d764df2-4960-4d9e-b077-5d15f62e8ae3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:45.439164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d764df2-4960-4d9e-b077-5d15f62e8ae3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:45.441455 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d764df2-4960-4d9e-b077-5d15f62e8ae3 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:45.464564 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 347/692] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Jun 23 01:51:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:45.469628 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d764df2-4960-4d9e-b077-5d15f62e8ae3 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:45.495812 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bfd7a-1b34-4a06-8e2e-ce48980ff782 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:45.497647 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bfd7a-1b34-4a06-8e2e-ce48980ff782 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:45.507263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:45.591742 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d764df2-4960-4d9e-b077-5d15f62e8ae3 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:45.603941 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:45.634867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9257913-05cb-4949-a272-f1e4641777bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:45.636240 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9257913-05cb-4949-a272-f1e4641777bb None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:45.637031 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9257913-05cb-4949-a272-f1e4641777bb None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:45.637505 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9257913-05cb-4949-a272-f1e4641777bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:45.672403 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 346/693] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 01:51:45.678053 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bfd7a-1b34-4a06-8e2e-ce48980ff782 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:45.716085 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9257913-05cb-4949-a272-f1e4641777bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:45.717972 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9257913-05cb-4949-a272-f1e4641777bb None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:45.752940 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:45.833960 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 348/694] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 01:51:45.839869 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9257913-05cb-4949-a272-f1e4641777bb None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:45.941807 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bfd7a-1b34-4a06-8e2e-ce48980ff782 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:45.970444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9257913-05cb-4949-a272-f1e4641777bb None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:45.978005 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed236f4b-03a2-4bd0-b8fe-e62c8391ac96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:45.978812 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed236f4b-03a2-4bd0-b8fe-e62c8391ac96 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:45.979091 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed236f4b-03a2-4bd0-b8fe-e62c8391ac96 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:45.979364 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed236f4b-03a2-4bd0-b8fe-e62c8391ac96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:45.990376 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed236f4b-03a2-4bd0-b8fe-e62c8391ac96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:45.991875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed236f4b-03a2-4bd0-b8fe-e62c8391ac96 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:46.007892 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:46.009968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-ed236f4b-03a2-4bd0-b8fe-e62c8391ac96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:46.009968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:46.009968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:46.009968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:46.009968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:46.009968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:46.009968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:46.009968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:46.009968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:46.009968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:46.009968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:46.009968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:46.009968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:46.009968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:46.009968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:46.010837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:46.010837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:46.010837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:46.010837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:46.010837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:46.010837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:46.010837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:46.010837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:46.010837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:46.010837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:46.010837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:46.010837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:46.010837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:46.010837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:46.010837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:46.010837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:46.010837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:46.011755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:46.011755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:46.011755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:46.011755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:46.011755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 347/695] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:46.012518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb097851-d9be-4f26-bb40-2539dcca0306 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:46.013183 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb097851-d9be-4f26-bb40-2539dcca0306 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:46.013183 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb097851-d9be-4f26-bb40-2539dcca0306 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:46.016204 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ac3b9-b97e-4363-8837-b5589a51ff70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:46.017136 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ac3b9-b97e-4363-8837-b5589a51ff70 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:46.017588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ac3b9-b97e-4363-8837-b5589a51ff70 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:46.017936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ac3b9-b97e-4363-8837-b5589a51ff70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:46.018540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 348/696] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:46.019643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb097851-d9be-4f26-bb40-2539dcca0306 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:46.031604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ac3b9-b97e-4363-8837-b5589a51ff70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:46.033701 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ac3b9-b97e-4363-8837-b5589a51ff70 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:46.045759 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:46.061477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-602ac3b9-b97e-4363-8837-b5589a51ff70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:46.061477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:46.061477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:46.061477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:46.061477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:46.061477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:46.061477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:46.061477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:46.061477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:46.061477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:46.061477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:46.061477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:46.061477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:46.061477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:46.061477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:46.062615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:46.062615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:46.062615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:46.062615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:46.062615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:46.062615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:46.062615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:46.062615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:46.062615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:46.062615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:46.062615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:46.062615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:46.062615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:46.062615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:46.062615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:46.062615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:46.062615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:46.063701 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:46.063701 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:46.063701 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:46.063701 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:46.069769 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 349/697] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:46.069769 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54889df-fd5b-41f2-8239-3d181ef3d5b5 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:46.069769 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54889df-fd5b-41f2-8239-3d181ef3d5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:46.069769 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54889df-fd5b-41f2-8239-3d181ef3d5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:46.086427 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-e54889df-fd5b-41f2-8239-3d181ef3d5b5 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:46.087658 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-e54889df-fd5b-41f2-8239-3d181ef3d5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:46.134298 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb097851-d9be-4f26-bb40-2539dcca0306 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:46.155670 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 350/698] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:46.157014 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2c9f1-b712-46bb-95fb-3a6c4d6d2e25 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:46.157301 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2c9f1-b712-46bb-95fb-3a6c4d6d2e25 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:46.157582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2c9f1-b712-46bb-95fb-3a6c4d6d2e25 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:46.158980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 351/699] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:46.163545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2c9f1-b712-46bb-95fb-3a6c4d6d2e25 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:46.180788 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb332b5-4fda-4226-8665-225d8a537f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:46.181563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb332b5-4fda-4226-8665-225d8a537f7a None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:46.181847 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb332b5-4fda-4226-8665-225d8a537f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:46.182170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb332b5-4fda-4226-8665-225d8a537f7a None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:46.182901 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb332b5-4fda-4226-8665-225d8a537f7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:46.183217 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb332b5-4fda-4226-8665-225d8a537f7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:46.184735 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb332b5-4fda-4226-8665-225d8a537f7a None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:46.198090 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 349/700] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:46.199530 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992b740-ee35-4998-b934-5857855e5ef7 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:46.199821 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992b740-ee35-4998-b934-5857855e5ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:46.200098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992b740-ee35-4998-b934-5857855e5ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:46.218158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-7992b740-ee35-4998-b934-5857855e5ef7 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:46.219382 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-7992b740-ee35-4998-b934-5857855e5ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:46.272614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2c9f1-b712-46bb-95fb-3a6c4d6d2e25 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:46.286738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:46.307436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 350/701] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:46.307436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992b740-ee35-4998-b934-5857855e5ef7 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:46.312486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072070b-8754-4e8d-8f13-47bb1ae55f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:46.313164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072070b-8754-4e8d-8f13-47bb1ae55f52 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:46.313448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072070b-8754-4e8d-8f13-47bb1ae55f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:46.313733 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072070b-8754-4e8d-8f13-47bb1ae55f52 None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:46.314580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072070b-8754-4e8d-8f13-47bb1ae55f52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:46.314888 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072070b-8754-4e8d-8f13-47bb1ae55f52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:46.316399 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072070b-8754-4e8d-8f13-47bb1ae55f52 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:46.321825 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:46.330131 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 352/702] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:46.330773 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072070b-8754-4e8d-8f13-47bb1ae55f52 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:46.418097 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992b740-ee35-4998-b934-5857855e5ef7 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:46.433673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072070b-8754-4e8d-8f13-47bb1ae55f52 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:46.455667 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5270fd-51a5-4a78-85cb-1f4670cb8370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:46.456673 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5270fd-51a5-4a78-85cb-1f4670cb8370 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:46.456957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5270fd-51a5-4a78-85cb-1f4670cb8370 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:46.457230 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5270fd-51a5-4a78-85cb-1f4670cb8370 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:46.467263 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5270fd-51a5-4a78-85cb-1f4670cb8370 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:46.468750 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5270fd-51a5-4a78-85cb-1f4670cb8370 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:46.468939 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792b56f-51ed-4572-91a2-d565e1c6eac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:46.469723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792b56f-51ed-4572-91a2-d565e1c6eac4 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:46.470010 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792b56f-51ed-4572-91a2-d565e1c6eac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:46.470315 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792b56f-51ed-4572-91a2-d565e1c6eac4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:46.477639 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792b56f-51ed-4572-91a2-d565e1c6eac4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:46.479087 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792b56f-51ed-4572-91a2-d565e1c6eac4 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:46.486385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-5d5270fd-51a5-4a78-85cb-1f4670cb8370 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:46.486385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:46.486385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:46.486385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:46.486385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:46.486385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:46.486385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:46.486385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:46.486385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:46.486385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:46.486385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:46.486385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:46.486385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:46.486385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:46.486385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:46.487329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:46.487329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:46.487329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:46.487329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:46.487329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:46.487329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:46.487329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:46.487329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:46.487329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:46.487329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:46.487329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:46.487329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:46.487329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:46.487329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:46.487329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:46.487329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:46.487329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:46.493523 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:46.493523 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:46.493523 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:46.493523 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:46.493523 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 351/703] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:46.493523 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5270fd-51a5-4a78-85cb-1f4670cb8370 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:46.494109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-1792b56f-51ed-4572-91a2-d565e1c6eac4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:46.494109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:46.494109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:46.494109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:46.494109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:46.494109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:46.494109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:46.494109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:46.494109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:46.494109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:46.494109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:46.494109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:46.494109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:51:46.494109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:51:46.494109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:51:46.494922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:51:46.494922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:46.494922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:46.494922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:46.494922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:46.494922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:46.494922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:46.494922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:46.494922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:46.494922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:46.494922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:46.494922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:46.494922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:46.494922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:46.494922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:46.494922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:46.494922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:46.495835 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:51:46.495835 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:51:46.495835 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:51:46.495835 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:51:46.495835 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:51:46.495835 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:51:46.495835 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:46.495835 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:46.495835 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 353/704] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:46.497164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792b56f-51ed-4572-91a2-d565e1c6eac4 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:46.532670 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:46.563887 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:46.605446 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5270fd-51a5-4a78-85cb-1f4670cb8370 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:46.609204 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792b56f-51ed-4572-91a2-d565e1c6eac4 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:46.643906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a267258-6eee-458c-a5c7-48aa0b21fd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:46.644768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a267258-6eee-458c-a5c7-48aa0b21fd08 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:46.645015 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a267258-6eee-458c-a5c7-48aa0b21fd08 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:46.645288 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a267258-6eee-458c-a5c7-48aa0b21fd08 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:46.645447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67200908-47a2-4182-b0e7-0b4f95718b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:46.645955 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a267258-6eee-458c-a5c7-48aa0b21fd08 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:46.646230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67200908-47a2-4182-b0e7-0b4f95718b40 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:46.646512 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67200908-47a2-4182-b0e7-0b4f95718b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:46.646784 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67200908-47a2-4182-b0e7-0b4f95718b40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:46.647336 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a267258-6eee-458c-a5c7-48aa0b21fd08 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:46.654222 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67200908-47a2-4182-b0e7-0b4f95718b40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:46.655684 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67200908-47a2-4182-b0e7-0b4f95718b40 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:46.661866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-2a267258-6eee-458c-a5c7-48aa0b21fd08 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 01:51:46.661866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:46.661866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:51:46.661866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:51:46.661866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:51:46.661866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:51:46.661866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:51:46.661866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:51:46.661866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 01:51:46.661866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:46.661866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:51:46.661866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:46.661866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:46.661866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:46.661866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:46.661866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:46.662838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:46.662838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:46.662838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:46.662838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:46.662838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:46.662838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:46.662838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:46.662838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:51:46.662838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:51:46.662838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:51:46.662838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:51:46.662838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:46.662838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:46.662838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:46.662838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:46.662838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:46.668981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:46.668981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:46.668981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:46.668981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:46.668981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:46.668981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:46.668981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:46.668981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:46.668981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:46.668981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:46.668981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:46.668981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:51:46.668981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:51:46.668981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 01:51:46.668981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:46.668981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 352/705] 10.222.0.13 () {56 vars in 1129 bytes} [Thu Jun 23 01:51:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:46.669823 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a267258-6eee-458c-a5c7-48aa0b21fd08 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:46.669904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-67200908-47a2-4182-b0e7-0b4f95718b40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:46.669904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:46.669904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:46.669904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:46.669904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:46.669904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:46.669904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:46.669904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:46.669904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:46.669904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:46.669904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:46.669904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:46.669904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:51:46.669904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:51:46.669904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:51:46.676798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:51:46.676798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:46.676798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:46.676798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:46.676798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:46.676798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:46.676798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:46.676798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:46.676798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:46.676798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:46.676798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:46.676798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:46.676798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:46.676798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:46.676798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:46.676798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:46.676798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:46.677711 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:51:46.677711 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:51:46.677711 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:51:46.677711 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:51:46.677711 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:51:46.677711 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:51:46.677711 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:46.677711 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:46.677711 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 354/706] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:46.677711 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67200908-47a2-4182-b0e7-0b4f95718b40 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:46.775307 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:46.780932 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a267258-6eee-458c-a5c7-48aa0b21fd08 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:46.786501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67200908-47a2-4182-b0e7-0b4f95718b40 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:46.809107 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:46.817930 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8a611-d3e2-49ea-9f9f-a33b47518dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:46.818599 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8a611-d3e2-49ea-9f9f-a33b47518dcb None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:46.818879 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8a611-d3e2-49ea-9f9f-a33b47518dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:46.819143 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8a611-d3e2-49ea-9f9f-a33b47518dcb None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:46.819897 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8a611-d3e2-49ea-9f9f-a33b47518dcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:46.820198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8a611-d3e2-49ea-9f9f-a33b47518dcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:46.821581 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8a611-d3e2-49ea-9f9f-a33b47518dcb None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:46.825041 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dc52f-2a9c-4a70-b443-23c4f8958ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:46.825713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dc52f-2a9c-4a70-b443-23c4f8958ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:46.825995 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dc52f-2a9c-4a70-b443-23c4f8958ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:46.826271 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dc52f-2a9c-4a70-b443-23c4f8958ae9 None admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:46.827067 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dc52f-2a9c-4a70-b443-23c4f8958ae9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:46.827380 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dc52f-2a9c-4a70-b443-23c4f8958ae9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:46.828838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dc52f-2a9c-4a70-b443-23c4f8958ae9 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:46.834131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 353/707] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:46.835159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8a611-d3e2-49ea-9f9f-a33b47518dcb None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:46.845815 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 355/708] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:51:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:46.845815 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dc52f-2a9c-4a70-b443-23c4f8958ae9 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:46.945203 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8a611-d3e2-49ea-9f9f-a33b47518dcb None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:46.951549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dc52f-2a9c-4a70-b443-23c4f8958ae9 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:46.981138 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836f6fd-0701-4c54-a6f9-6b7ccc1d2370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:46.981803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836f6fd-0701-4c54-a6f9-6b7ccc1d2370 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:46.982085 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836f6fd-0701-4c54-a6f9-6b7ccc1d2370 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:46.982357 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836f6fd-0701-4c54-a6f9-6b7ccc1d2370 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:46.983072 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836f6fd-0701-4c54-a6f9-6b7ccc1d2370 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:46.983357 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836f6fd-0701-4c54-a6f9-6b7ccc1d2370 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:46.984797 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836f6fd-0701-4c54-a6f9-6b7ccc1d2370 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:46.985058 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be4da9-496e-4bb4-9601-4172b74a27a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:46.985758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be4da9-496e-4bb4-9601-4172b74a27a1 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:46.986045 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be4da9-496e-4bb4-9601-4172b74a27a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:46.986319 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be4da9-496e-4bb4-9601-4172b74a27a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:46.987106 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be4da9-496e-4bb4-9601-4172b74a27a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:46.987473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be4da9-496e-4bb4-9601-4172b74a27a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:46.989014 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be4da9-496e-4bb4-9601-4172b74a27a1 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:46.990296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 354/709] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Jun 23 01:51:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:46.991388 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836f6fd-0701-4c54-a6f9-6b7ccc1d2370 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:47.005573 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 356/710] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:51:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:47.006715 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be4da9-496e-4bb4-9601-4172b74a27a1 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:47.024418 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:47.056409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:47.105734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836f6fd-0701-4c54-a6f9-6b7ccc1d2370 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:47.109273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be4da9-496e-4bb4-9601-4172b74a27a1 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:47.141923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8732ab-e4ad-4b1a-866c-d685eb26658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:47.142604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8732ab-e4ad-4b1a-866c-d685eb26658c None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:47.142887 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8732ab-e4ad-4b1a-866c-d685eb26658c None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:47.143168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8732ab-e4ad-4b1a-866c-d685eb26658c None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:47.144020 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8732ab-e4ad-4b1a-866c-d685eb26658c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:47.145343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f19e0-e345-45e7-befd-0a9869973e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:47.145534 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8732ab-e4ad-4b1a-866c-d685eb26658c None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:47.145943 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f19e0-e345-45e7-befd-0a9869973e3b None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:47.146205 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f19e0-e345-45e7-befd-0a9869973e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:47.146545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f19e0-e345-45e7-befd-0a9869973e3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:47.147537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f19e0-e345-45e7-befd-0a9869973e3b None admin] RBAC: Adding query filter params (role.id=58e04437159e4eb39aa4a43c213ea34c, scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018, user.id=9d3b5180fb7144c394c39d4db28713b9) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:47.147860 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f19e0-e345-45e7-befd-0a9869973e3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:47.149572 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f19e0-e345-45e7-befd-0a9869973e3b None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:47.156525 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 357/711] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:51:47 2022] GET /identity/v3/role_assignments?user.id=9d3b5180fb7144c394c39d4db28713b9&scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018&role.id=58e04437159e4eb39aa4a43c213ea34c => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:47.157152 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f19e0-e345-45e7-befd-0a9869973e3b None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:47.183697 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 355/712] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 01:51:46 2022] POST /identity/v3/users => generated 254 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:51:47.185055 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8732ab-e4ad-4b1a-866c-d685eb26658c None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:47.327080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8732ab-e4ad-4b1a-866c-d685eb26658c None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:47.337393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:47.367662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:47.377823 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d877fd4-de50-4ee8-8226-4176e8e2b9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:47.379148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d877fd4-de50-4ee8-8226-4176e8e2b9aa None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:47.379707 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d877fd4-de50-4ee8-8226-4176e8e2b9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:47.380204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d877fd4-de50-4ee8-8226-4176e8e2b9aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:47.381380 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d877fd4-de50-4ee8-8226-4176e8e2b9aa None admin] RBAC: Adding query filter params (role.id=c8b68b76c1b44e549cc7520e5546d374, scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018, user.id=1ae132c4d0b5461aa26ab929a017cb08) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:47.381853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d877fd4-de50-4ee8-8226-4176e8e2b9aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:47.383516 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d877fd4-de50-4ee8-8226-4176e8e2b9aa None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:47.390984 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 356/713] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:51:47 2022] GET /identity/v3/role_assignments?user.id=1ae132c4d0b5461aa26ab929a017cb08&scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018&role.id=c8b68b76c1b44e549cc7520e5546d374 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:47.395252 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f19e0-e345-45e7-befd-0a9869973e3b None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:47.446560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09777a8f-fa8b-4ea3-ac73-ef6869fdf52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:47.447464 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09777a8f-fa8b-4ea3-ac73-ef6869fdf52e None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:47.447752 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09777a8f-fa8b-4ea3-ac73-ef6869fdf52e None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:47.448027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09777a8f-fa8b-4ea3-ac73-ef6869fdf52e None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:47.448763 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09777a8f-fa8b-4ea3-ac73-ef6869fdf52e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:47.449070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09777a8f-fa8b-4ea3-ac73-ef6869fdf52e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:47.450490 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09777a8f-fa8b-4ea3-ac73-ef6869fdf52e None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:47.457849 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 358/714] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Jun 23 01:51:47 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:47.618983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a1c51-dba0-4472-9963-4bc7a363cc53 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:47.619177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a1c51-dba0-4472-9963-4bc7a363cc53 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:47.619477 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a1c51-dba0-4472-9963-4bc7a363cc53 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:47.621089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 357/715] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:47.626924 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3f18d-7a22-4b2d-836f-28d953eae0a1 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:47.627588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3f18d-7a22-4b2d-836f-28d953eae0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:47.628177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3f18d-7a22-4b2d-836f-28d953eae0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:47.646755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-06a3f18d-7a22-4b2d-836f-28d953eae0a1 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:47.648312 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-06a3f18d-7a22-4b2d-836f-28d953eae0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:47.722841 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 359/716] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:47.746224 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a1c51-dba0-4472-9963-4bc7a363cc53 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:47.865182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a1c51-dba0-4472-9963-4bc7a363cc53 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:47.912386 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992654ce-e090-4c66-acf9-c64d45be201e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:47.913479 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992654ce-e090-4c66-acf9-c64d45be201e None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:47.913913 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992654ce-e090-4c66-acf9-c64d45be201e None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:47.914489 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992654ce-e090-4c66-acf9-c64d45be201e None admin] PATH_INFO: `/v3/services/network` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:47.915304 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992654ce-e090-4c66-acf9-c64d45be201e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:47.916891 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992654ce-e090-4c66-acf9-c64d45be201e None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:47.934049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-992654ce-e090-4c66-acf9-c64d45be201e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 01:51:47.934049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:47.934049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:51:47.934049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:51:47.934049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:51:47.934049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:51:47.934049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:51:47.934049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:51:47.934049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 01:51:47.934049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:47.934049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:51:47.934049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:47.934049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:47.934049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:47.934049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:47.934049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:47.934049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:47.935041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:47.935041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:47.935041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:47.935041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:47.935041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:47.935041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:47.935041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:51:47.935041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:51:47.935041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:51:47.935041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:51:47.935041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:47.935041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:47.935041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:47.935041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:47.935041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:47.935041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:47.936240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:47.936240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:47.936240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:47.936240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:47.936240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:47.936240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:47.936240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:47.936240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:47.936240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:47.936240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:47.936240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:51:47.936240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:51:47.936240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 01:51:47.936240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:47.936240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 358/717] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:47 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:47.944509 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3f18d-7a22-4b2d-836f-28d953eae0a1 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:48.071882 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:48.107830 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3f18d-7a22-4b2d-836f-28d953eae0a1 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:48.144695 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a4908-4c45-4260-8d03-e61254cacdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:48.145379 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a4908-4c45-4260-8d03-e61254cacdb9 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:48.145662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a4908-4c45-4260-8d03-e61254cacdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:48.145939 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a4908-4c45-4260-8d03-e61254cacdb9 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:48.146657 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a4908-4c45-4260-8d03-e61254cacdb9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:48.146967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a4908-4c45-4260-8d03-e61254cacdb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:48.148383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a4908-4c45-4260-8d03-e61254cacdb9 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:48.154724 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 360/718] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 01:51:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:48.160202 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992654ce-e090-4c66-acf9-c64d45be201e None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:48.224363 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:48.307137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992654ce-e090-4c66-acf9-c64d45be201e None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:48.358492 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183d8ad-c7b9-4d17-996e-d8723949a958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:48.359171 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183d8ad-c7b9-4d17-996e-d8723949a958 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:48.359470 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183d8ad-c7b9-4d17-996e-d8723949a958 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:48.359748 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183d8ad-c7b9-4d17-996e-d8723949a958 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:48.360465 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183d8ad-c7b9-4d17-996e-d8723949a958 None admin] RBAC: Adding query filter params (type=network) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:48.360768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183d8ad-c7b9-4d17-996e-d8723949a958 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:48.362159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183d8ad-c7b9-4d17-996e-d8723949a958 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:48.372627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 359/719] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 01:51:48 2022] GET /identity/v3/services?type=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:49.395880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab33ac-8593-420e-8624-fd6eae702f73 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:49.396410 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab33ac-8593-420e-8624-fd6eae702f73 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:49.396410 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab33ac-8593-420e-8624-fd6eae702f73 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:49.398059 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 361/720] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:49.403598 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19dc77-6fe1-4d54-9354-3ced07a7c2d3 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:49.404139 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19dc77-6fe1-4d54-9354-3ced07a7c2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:49.404139 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19dc77-6fe1-4d54-9354-3ced07a7c2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:49.422319 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-ae19dc77-6fe1-4d54-9354-3ced07a7c2d3 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:49.423545 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-ae19dc77-6fe1-4d54-9354-3ced07a7c2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:49.523977 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 360/721] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:51:49.546677 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab33ac-8593-420e-8624-fd6eae702f73 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:49.651483 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab33ac-8593-420e-8624-fd6eae702f73 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:49.687584 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb1458-575b-474a-ab85-284d1b19d5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:49.688390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb1458-575b-474a-ab85-284d1b19d5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:49.688722 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb1458-575b-474a-ab85-284d1b19d5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:49.688998 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb1458-575b-474a-ab85-284d1b19d5e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:49.692080 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:49.700751 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb1458-575b-474a-ab85-284d1b19d5e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:49.713727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-0adb1458-575b-474a-ab85-284d1b19d5e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:51:49.713727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:49.713727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:49.713727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:49.713727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:49.713727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:49.713727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:49.713727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:49.713727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:49.713727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:49.713727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:49.713727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:49.713727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:49.713727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:49.713727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:49.713727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:49.715898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:49.715898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:49.715898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:49.715898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:49.715898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:49.715898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:49.715898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:49.715898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:49.715898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:49.715898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:49.715898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:49.715898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:49.715898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:49.715898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:49.715898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:49.715898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:49.717897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:49.717897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:49.717897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:49.717897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:49.717897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:49.717897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:49.717897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:49.717897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:49.717897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:49.717897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:49.717897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:51:49.717897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:49.717897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 362/722] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:51:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:49.723432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19dc77-6fe1-4d54-9354-3ced07a7c2d3 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:49.778693 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:49.869986 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19dc77-6fe1-4d54-9354-3ced07a7c2d3 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:49.884482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c2d82-5b6c-42dc-a600-f5c5ccbb4699 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:49.884770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c2d82-5b6c-42dc-a600-f5c5ccbb4699 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:49.885038 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c2d82-5b6c-42dc-a600-f5c5ccbb4699 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:49.886747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 363/723] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:51:49.891918 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a17c4-8620-4973-9079-6714ad88f7b8 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:49.892205 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a17c4-8620-4973-9079-6714ad88f7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:49.892485 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a17c4-8620-4973-9079-6714ad88f7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:49.917019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-d69a17c4-8620-4973-9079-6714ad88f7b8 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:49.918223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-d69a17c4-8620-4973-9079-6714ad88f7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:49.932126 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b191fd-299d-4018-96bc-ef1ffc12b99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:49.932819 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b191fd-299d-4018-96bc-ef1ffc12b99d None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:49.933098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b191fd-299d-4018-96bc-ef1ffc12b99d None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:49.933368 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b191fd-299d-4018-96bc-ef1ffc12b99d None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:49.934131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b191fd-299d-4018-96bc-ef1ffc12b99d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:49.934443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b191fd-299d-4018-96bc-ef1ffc12b99d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:49.936197 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b191fd-299d-4018-96bc-ef1ffc12b99d None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:49.963517 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 361/724] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:49.963517 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b14f72-7abb-4b35-865e-9312aee0fe35 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:49.963517 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b14f72-7abb-4b35-865e-9312aee0fe35 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:49.963517 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b14f72-7abb-4b35-865e-9312aee0fe35 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:49.963517 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 362/725] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:49.967829 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b14f72-7abb-4b35-865e-9312aee0fe35 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:50.005326 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 364/726] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 01:51:50.016177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661c08e-1fad-474e-abbd-6e0bc8bf177d None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:50.016752 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661c08e-1fad-474e-abbd-6e0bc8bf177d None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:50.017177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661c08e-1fad-474e-abbd-6e0bc8bf177d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:50.048513 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-9661c08e-1fad-474e-abbd-6e0bc8bf177d None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:50.049726 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-9661c08e-1fad-474e-abbd-6e0bc8bf177d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:50.097169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:50.111570 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b14f72-7abb-4b35-865e-9312aee0fe35 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:50.135435 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 365/727] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:50.135435 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661c08e-1fad-474e-abbd-6e0bc8bf177d None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:50.170580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a64dc5-31a5-4a9b-8027-d62705618beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:50.171972 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a64dc5-31a5-4a9b-8027-d62705618beb None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:50.172609 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a64dc5-31a5-4a9b-8027-d62705618beb None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:50.173401 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a64dc5-31a5-4a9b-8027-d62705618beb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:50.188171 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a64dc5-31a5-4a9b-8027-d62705618beb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:50.190299 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a64dc5-31a5-4a9b-8027-d62705618beb None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:50.208953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:50.218615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-03a64dc5-31a5-4a9b-8027-d62705618beb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:50.218615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:50.218615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:50.218615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:50.218615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:50.218615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:50.218615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:50.218615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:50.218615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:50.218615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:50.218615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:50.218615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:50.218615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:50.218615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:50.218615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:50.219536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:50.219536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:50.219536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:50.219536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:50.219536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:50.219536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:50.219536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:50.219536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:50.219536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:50.219536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:50.219536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:50.219536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:50.219536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:50.219536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:50.219536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:50.219536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:50.219536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:50.220441 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:50.220441 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:50.220441 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:50.220441 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:50.221184 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 363/728] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:50.226927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a64dc5-31a5-4a9b-8027-d62705618beb None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:50.269378 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661c08e-1fad-474e-abbd-6e0bc8bf177d None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:50.319156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddbe4b-b5bc-4b19-9916-f9b305fb9d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:50.319997 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddbe4b-b5bc-4b19-9916-f9b305fb9d85 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:50.320277 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddbe4b-b5bc-4b19-9916-f9b305fb9d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:50.320550 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddbe4b-b5bc-4b19-9916-f9b305fb9d85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:50.334410 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddbe4b-b5bc-4b19-9916-f9b305fb9d85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:50.345363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-bdddbe4b-b5bc-4b19-9916-f9b305fb9d85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:50.345363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:50.345363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:50.345363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:50.345363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:50.345363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:50.345363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:50.345363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:50.345363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:50.345363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:50.345363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:50.345363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:50.345363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:50.345363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:50.345363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:50.345363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:50.346304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:50.346304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:50.346304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:50.346304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:50.346304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:50.346304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:50.346304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:50.346304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:50.346304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:50.346304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:50.346304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:50.346304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:50.346304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:50.346304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:50.346304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:50.346304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:50.348126 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:50.348126 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:50.348126 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:50.348126 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:50.348126 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:50.348126 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:50.348126 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:50.348126 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:50.348126 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:50.348126 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:50.348126 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:50.348126 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:50.351875 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 366/729] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 01:51:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:50.352754 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddbe4b-b5bc-4b19-9916-f9b305fb9d85 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:50.358441 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a64dc5-31a5-4a9b-8027-d62705618beb None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:50.401423 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db7ca5-357a-4e38-bb94-34401d80bb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:50.402098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db7ca5-357a-4e38-bb94-34401d80bb5e None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:50.402415 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db7ca5-357a-4e38-bb94-34401d80bb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:50.402651 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db7ca5-357a-4e38-bb94-34401d80bb5e None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:50.403437 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db7ca5-357a-4e38-bb94-34401d80bb5e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:50.404792 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db7ca5-357a-4e38-bb94-34401d80bb5e None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:50.427539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 364/730] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 01:51:50 2022] POST /identity/v3/services => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:51:50.427539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db7ca5-357a-4e38-bb94-34401d80bb5e None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:50.432508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:50.474140 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddbe4b-b5bc-4b19-9916-f9b305fb9d85 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:50.491913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:50.528913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb168a66-abdc-4a79-827b-2c76302695d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:50.529796 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb168a66-abdc-4a79-827b-2c76302695d6 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:50.530170 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb168a66-abdc-4a79-827b-2c76302695d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:50.530534 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb168a66-abdc-4a79-827b-2c76302695d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:50.531375 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb168a66-abdc-4a79-827b-2c76302695d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:50.531804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb168a66-abdc-4a79-827b-2c76302695d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:50.533330 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb168a66-abdc-4a79-827b-2c76302695d6 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:50.546974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 367/731] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:50.549408 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf005ef-275f-4e77-a84d-35058a12e72f None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:50.549809 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf005ef-275f-4e77-a84d-35058a12e72f None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:50.550228 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf005ef-275f-4e77-a84d-35058a12e72f None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:50.555539 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 368/732] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:50.556597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf005ef-275f-4e77-a84d-35058a12e72f None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:50.577218 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db7ca5-357a-4e38-bb94-34401d80bb5e None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:50.621351 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61a780-b4e5-477b-93e5-6a536ecf1408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:50.622050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61a780-b4e5-477b-93e5-6a536ecf1408 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:50.622336 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61a780-b4e5-477b-93e5-6a536ecf1408 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:50.622612 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61a780-b4e5-477b-93e5-6a536ecf1408 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:50.623381 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61a780-b4e5-477b-93e5-6a536ecf1408 None admin] RBAC: Adding query filter params (name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:50.623898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61a780-b4e5-477b-93e5-6a536ecf1408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:50.625628 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61a780-b4e5-477b-93e5-6a536ecf1408 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:50.635902 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 365/733] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 01:51:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:50.641790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13691a1d-0a7a-46ac-8102-2fe4ce1e3f53 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:50.642235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13691a1d-0a7a-46ac-8102-2fe4ce1e3f53 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:50.642554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13691a1d-0a7a-46ac-8102-2fe4ce1e3f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:50.663886 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-13691a1d-0a7a-46ac-8102-2fe4ce1e3f53 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:50.666924 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-13691a1d-0a7a-46ac-8102-2fe4ce1e3f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:50.690612 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf005ef-275f-4e77-a84d-35058a12e72f None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:50.741247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf6d38-e986-4be6-9a9f-963b6cdede83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:50.742931 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf6d38-e986-4be6-9a9f-963b6cdede83 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:50.743397 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf6d38-e986-4be6-9a9f-963b6cdede83 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:50.743856 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf6d38-e986-4be6-9a9f-963b6cdede83 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:50.745542 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:50.754986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf6d38-e986-4be6-9a9f-963b6cdede83 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:50.755397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 366/734] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:50.756349 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13691a1d-0a7a-46ac-8102-2fe4ce1e3f53 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:50.757094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf6d38-e986-4be6-9a9f-963b6cdede83 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:50.776230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-3bbf6d38-e986-4be6-9a9f-963b6cdede83 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 01:51:50.776230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:50.776230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:50.776230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:50.776230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:50.776230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:50.776230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:50.776230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:50.776230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:50.776230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:50.776230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:50.776230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:50.776230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:51:50.776230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:51:50.776230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:51:50.776230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:51:50.777414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:50.777414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:50.777414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:51:50.777414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:50.777414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:51:50.777414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:50.777414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:50.777414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:50.777414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:50.777414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:50.777414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:50.777414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:50.777414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:50.777414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:50.777414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:50.777414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:50.777414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:50.777414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:50.778582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:50.778582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:50.778582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:51:50.778582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:51:50.778582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:51:50.778582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:51:50.778582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:51:50.778582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:51:50.778582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 01:51:50.778582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:50.781319 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 369/735] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 23 01:51:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:50.786942 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf6d38-e986-4be6-9a9f-963b6cdede83 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:50.821031 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:50.873457 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13691a1d-0a7a-46ac-8102-2fe4ce1e3f53 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:50.894847 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf6d38-e986-4be6-9a9f-963b6cdede83 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:50.916795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b8497-86ea-4414-a26a-f776cdbf7d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:50.917611 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b8497-86ea-4414-a26a-f776cdbf7d17 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:50.917895 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b8497-86ea-4414-a26a-f776cdbf7d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:50.918180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b8497-86ea-4414-a26a-f776cdbf7d17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:50.932298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6a490-14b5-430a-aa91-8c64aadf6306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:50.933187 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6a490-14b5-430a-aa91-8c64aadf6306 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:50.933468 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6a490-14b5-430a-aa91-8c64aadf6306 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:50.933837 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6a490-14b5-430a-aa91-8c64aadf6306 None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:50.934779 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6a490-14b5-430a-aa91-8c64aadf6306 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:50.935209 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6a490-14b5-430a-aa91-8c64aadf6306 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:50.937076 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6a490-14b5-430a-aa91-8c64aadf6306 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:50.938159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b8497-86ea-4414-a26a-f776cdbf7d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:50.939831 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b8497-86ea-4414-a26a-f776cdbf7d17 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:50.959690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 370/736] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 23 01:51:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:51:50.960588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6a490-14b5-430a-aa91-8c64aadf6306 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:50.961196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-058b8497-86ea-4414-a26a-f776cdbf7d17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:50.961196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:50.961196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:50.961196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:50.961196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:50.961196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:50.961196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:50.961196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:50.961196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:50.961196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:50.961196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:50.961196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:50.961196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:50.961196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:50.961196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:50.962108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:50.962108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:50.962108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:50.962108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:50.962108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:50.962108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:50.962108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:50.962108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:50.962108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:50.962108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:50.962108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:50.962108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:50.962108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:50.962108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:50.962108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:50.962108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:50.962108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:50.963004 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:50.963004 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:50.963004 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:50.963004 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:50.963004 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 367/737] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:50.963970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33bdf9-942a-4091-abc2-4d6f50684581 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:50.963970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33bdf9-942a-4091-abc2-4d6f50684581 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:50.964229 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33bdf9-942a-4091-abc2-4d6f50684581 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:50.968643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 368/738] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:50.968643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33bdf9-942a-4091-abc2-4d6f50684581 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:51.023036 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:51.056269 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:51.069624 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6a490-14b5-430a-aa91-8c64aadf6306 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:51.079888 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33bdf9-942a-4091-abc2-4d6f50684581 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:51.104708 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec50f1-9420-4148-a266-f73a6149db3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:51.105517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec50f1-9420-4148-a266-f73a6149db3b None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:51.105795 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec50f1-9420-4148-a266-f73a6149db3b None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:51.106064 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec50f1-9420-4148-a266-f73a6149db3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:51.115938 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6573d-b466-4b86-ad34-c938f15a0900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:51.116732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec50f1-9420-4148-a266-f73a6149db3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:51.116840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6573d-b466-4b86-ad34-c938f15a0900 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:51.117013 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6573d-b466-4b86-ad34-c938f15a0900 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:51.117292 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6573d-b466-4b86-ad34-c938f15a0900 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:51.124430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-6bec50f1-9420-4148-a266-f73a6149db3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:51:51.124430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:51.124430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:51.124430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:51.124430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:51.124430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:51.124430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:51.124430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:51.124430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:51.124430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:51.124430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:51.124430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:51.124430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:51.124430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:51.124430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:51.124430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:51.125429 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:51.125429 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:51.125429 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:51.125429 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:51.125429 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:51.125429 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:51.125429 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:51.125429 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:51.125429 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:51.125429 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:51.125429 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:51.125429 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:51.125429 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:51.125429 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:51.125429 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:51.125429 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:51.131298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:51.131298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:51.131298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:51.131298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:51.131298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:51.131298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:51.131298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:51.131298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:51.131298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:51.131298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:51.131298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:51:51.131298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:51.131298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 371/739] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:51:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:51.131298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec50f1-9420-4148-a266-f73a6149db3b None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:51.135503 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6573d-b466-4b86-ad34-c938f15a0900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:51.137003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6573d-b466-4b86-ad34-c938f15a0900 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:51.157168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-cdb6573d-b466-4b86-ad34-c938f15a0900 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:51.157168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:51.157168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:51.157168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:51.157168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:51.157168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:51.157168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:51.157168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:51.157168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:51.157168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:51.157168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:51.157168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:51.157168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:51.157168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:51.157168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:51.158158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:51.158158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:51.158158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:51.158158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:51.158158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:51.158158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:51.158158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:51.158158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:51.158158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:51.158158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:51.158158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:51.158158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:51.158158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:51.158158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:51.158158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:51.158158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:51.158158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:51.159716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:51.159716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:51.159716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:51.159716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:51.159716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 369/740] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:51.160919 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570660cb-8b0c-424e-8dc3-3b915ca998f3 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:51.161178 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570660cb-8b0c-424e-8dc3-3b915ca998f3 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:51.161480 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570660cb-8b0c-424e-8dc3-3b915ca998f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:51.180476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-570660cb-8b0c-424e-8dc3-3b915ca998f3 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:51.181721 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-570660cb-8b0c-424e-8dc3-3b915ca998f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:51.260592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 370/741] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 01:51:51.261472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570660cb-8b0c-424e-8dc3-3b915ca998f3 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:51.297381 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:51.373470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec50f1-9420-4148-a266-f73a6149db3b None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:51.377826 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570660cb-8b0c-424e-8dc3-3b915ca998f3 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:51.408241 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455a79b-a9f4-4d84-9bf0-5b287bfcb1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:51.408915 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455a79b-a9f4-4d84-9bf0-5b287bfcb1cb None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:51.409361 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455a79b-a9f4-4d84-9bf0-5b287bfcb1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:51.409536 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455a79b-a9f4-4d84-9bf0-5b287bfcb1cb None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:51.410233 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455a79b-a9f4-4d84-9bf0-5b287bfcb1cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:51.410543 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455a79b-a9f4-4d84-9bf0-5b287bfcb1cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:51.411961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455a79b-a9f4-4d84-9bf0-5b287bfcb1cb None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:51.414676 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49385472-d835-40f2-bde6-084fcfc97ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:51.415924 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49385472-d835-40f2-bde6-084fcfc97ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:51.416388 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49385472-d835-40f2-bde6-084fcfc97ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:51.416827 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49385472-d835-40f2-bde6-084fcfc97ca4 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:51.417732 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49385472-d835-40f2-bde6-084fcfc97ca4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:51.418343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49385472-d835-40f2-bde6-084fcfc97ca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:51.419737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49385472-d835-40f2-bde6-084fcfc97ca4 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:51.427865 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 372/742] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:51.427865 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455a79b-a9f4-4d84-9bf0-5b287bfcb1cb None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:51.437370 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 371/743] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:51.437370 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49385472-d835-40f2-bde6-084fcfc97ca4 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:51.441513 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:51.531880 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:51.541702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49385472-d835-40f2-bde6-084fcfc97ca4 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:51.546137 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455a79b-a9f4-4d84-9bf0-5b287bfcb1cb None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:51.578444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d698f0-2d7f-4b35-9eb7-6f3011bddbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:51.579143 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d698f0-2d7f-4b35-9eb7-6f3011bddbc7 None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:51.579394 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d698f0-2d7f-4b35-9eb7-6f3011bddbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:51.579721 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d698f0-2d7f-4b35-9eb7-6f3011bddbc7 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:51.580440 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d698f0-2d7f-4b35-9eb7-6f3011bddbc7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:51.581882 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d698f0-2d7f-4b35-9eb7-6f3011bddbc7 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:51.582089 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701b7c5-58d0-405a-865b-2e08a78da5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:51.582756 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701b7c5-58d0-405a-865b-2e08a78da5bd None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:51.583037 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701b7c5-58d0-405a-865b-2e08a78da5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:51.583309 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701b7c5-58d0-405a-865b-2e08a78da5bd None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:51.584064 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701b7c5-58d0-405a-865b-2e08a78da5bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:51.584366 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701b7c5-58d0-405a-865b-2e08a78da5bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:51.585723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701b7c5-58d0-405a-865b-2e08a78da5bd None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:51.595196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 372/744] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 01:51:51 2022] POST /identity/v3/services => generated 240 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:51:51.596230 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d698f0-2d7f-4b35-9eb7-6f3011bddbc7 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:51.609171 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 373/745] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:51.610595 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701b7c5-58d0-405a-865b-2e08a78da5bd None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:51.707303 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:51.735611 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d698f0-2d7f-4b35-9eb7-6f3011bddbc7 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:51.742450 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701b7c5-58d0-405a-865b-2e08a78da5bd None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:51.776632 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d237f-7b18-47f5-9d2a-e098b8a1142f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:51.777960 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d237f-7b18-47f5-9d2a-e098b8a1142f None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:51.779070 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d237f-7b18-47f5-9d2a-e098b8a1142f None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:51.779070 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d237f-7b18-47f5-9d2a-e098b8a1142f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:51.782656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332a903-e8ae-4f0d-b1d0-a01ca21c4a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:51.783446 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332a903-e8ae-4f0d-b1d0-a01ca21c4a71 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:51.783722 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332a903-e8ae-4f0d-b1d0-a01ca21c4a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:51.783994 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332a903-e8ae-4f0d-b1d0-a01ca21c4a71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:51.786905 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d237f-7b18-47f5-9d2a-e098b8a1142f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:51.789066 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d237f-7b18-47f5-9d2a-e098b8a1142f None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:51.799264 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332a903-e8ae-4f0d-b1d0-a01ca21c4a71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:51.800876 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332a903-e8ae-4f0d-b1d0-a01ca21c4a71 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:51.807836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-191d237f-7b18-47f5-9d2a-e098b8a1142f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 01:51:51.807836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:51.807836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:51.807836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:51.807836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:51.807836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:51.807836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:51.807836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:51.807836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:51.807836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:51.807836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:51.807836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:51.807836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:51:51.807836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:51:51.807836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:51:51.807836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:51:51.808758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:51.808758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:51.808758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:51:51.808758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:51.808758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:51:51.808758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:51.808758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:51.808758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:51.808758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:51.808758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:51.808758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:51.808758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:51.808758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:51.808758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:51.808758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:51.808758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:51.808758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:51.808758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:51.809721 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:51.809721 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:51.809721 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:51:51.809721 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:51:51.809721 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:51:51.809721 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:51:51.809721 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:51:51.809721 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:51:51.809721 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 01:51:51.809721 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:51.809721 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 373/746] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 23 01:51:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:51.811437 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d237f-7b18-47f5-9d2a-e098b8a1142f None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:51.821883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-3332a903-e8ae-4f0d-b1d0-a01ca21c4a71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:51.821883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:51.821883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:51.821883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:51.821883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:51.821883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:51.821883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:51.821883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:51.821883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:51.821883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:51.821883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:51.821883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:51.821883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:51.821883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:51.821883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:51.822836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:51.822836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:51.822836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:51.822836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:51.822836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:51.822836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:51.822836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:51.822836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:51.822836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:51.822836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:51.822836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:51.822836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:51.822836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:51.822836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:51.822836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:51.822836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:51.822836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:51.823760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:51.823760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:51.823760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:51.823760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:51.824286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 374/747] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:51.825042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332a903-e8ae-4f0d-b1d0-a01ca21c4a71 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:51.829810 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:51.946365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d237f-7b18-47f5-9d2a-e098b8a1142f None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:51.974654 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332a903-e8ae-4f0d-b1d0-a01ca21c4a71 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:51.981726 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc692729-4d64-4d99-b8ef-5bfadfc3fb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:51.982806 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc692729-4d64-4d99-b8ef-5bfadfc3fb50 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:51.983305 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc692729-4d64-4d99-b8ef-5bfadfc3fb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:51.983822 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc692729-4d64-4d99-b8ef-5bfadfc3fb50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:51.993157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc692729-4d64-4d99-b8ef-5bfadfc3fb50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:51.995122 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc692729-4d64-4d99-b8ef-5bfadfc3fb50 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:51.999291 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:52.012702 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d3395-196c-4107-a651-958863525d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:52.013382 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d3395-196c-4107-a651-958863525d83 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:52.013661 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d3395-196c-4107-a651-958863525d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:52.013935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d3395-196c-4107-a651-958863525d83 None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:52.014802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-cc692729-4d64-4d99-b8ef-5bfadfc3fb50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:52.014802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:52.014802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:52.014802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:52.014802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:52.014802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:52.014802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:52.014802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:52.014802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:52.014802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:52.014802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:52.014802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:52.014802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:51:52.014802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:51:52.014802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:51:52.015705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:51:52.015705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:52.015705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:52.015705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:52.015705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:52.015705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:52.015705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:52.015705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:52.015705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:52.015705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:52.015705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:52.015705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:52.015705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:52.015705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:52.015705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:52.015705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:52.015705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:52.016592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:51:52.016592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:51:52.016592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:51:52.016592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:51:52.016592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:51:52.016592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:51:52.016592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:52.016592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:52.017022 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d3395-196c-4107-a651-958863525d83 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:52.017022 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d3395-196c-4107-a651-958863525d83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:52.017022 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d3395-196c-4107-a651-958863525d83 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:52.019976 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 374/748] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:52.021039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc692729-4d64-4d99-b8ef-5bfadfc3fb50 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:52.045889 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 375/749] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Jun 23 01:51:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:52.047031 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d3395-196c-4107-a651-958863525d83 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:52.104957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:52.143108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc692729-4d64-4d99-b8ef-5bfadfc3fb50 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:52.180659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b644b4-4849-4f7c-9d0e-b1934ff2c804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:52.181332 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b644b4-4849-4f7c-9d0e-b1934ff2c804 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:52.181614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b644b4-4849-4f7c-9d0e-b1934ff2c804 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:52.181892 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b644b4-4849-4f7c-9d0e-b1934ff2c804 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:52.182415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d3395-196c-4107-a651-958863525d83 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:52.182620 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b644b4-4849-4f7c-9d0e-b1934ff2c804 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:52.182930 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b644b4-4849-4f7c-9d0e-b1934ff2c804 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:52.184476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b644b4-4849-4f7c-9d0e-b1934ff2c804 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:52.202219 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 375/750] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:52.203236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b644b4-4849-4f7c-9d0e-b1934ff2c804 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:52.222349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e4ad4-ce63-42f8-87df-6685276c048c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:52.223023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e4ad4-ce63-42f8-87df-6685276c048c None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:52.223343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e4ad4-ce63-42f8-87df-6685276c048c None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:52.223667 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e4ad4-ce63-42f8-87df-6685276c048c None admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:52.224466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e4ad4-ce63-42f8-87df-6685276c048c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:52.224775 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e4ad4-ce63-42f8-87df-6685276c048c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:52.226217 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e4ad4-ce63-42f8-87df-6685276c048c None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:52.243337 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 376/751] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:51:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:52.244247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e4ad4-ce63-42f8-87df-6685276c048c None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:52.287161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:52.331218 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b644b4-4849-4f7c-9d0e-b1934ff2c804 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:52.348139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e4ad4-ce63-42f8-87df-6685276c048c None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:52.365108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:52.374859 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbd822-7fc0-4461-9ffa-7a304833a413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:52.375346 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbd822-7fc0-4461-9ffa-7a304833a413 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:52.375687 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbd822-7fc0-4461-9ffa-7a304833a413 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:52.375967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbd822-7fc0-4461-9ffa-7a304833a413 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:52.392106 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e14561-2243-4ab6-b34b-0c7c18405733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:52.393935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e14561-2243-4ab6-b34b-0c7c18405733 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:52.394438 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e14561-2243-4ab6-b34b-0c7c18405733 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:52.395111 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e14561-2243-4ab6-b34b-0c7c18405733 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:52.405438 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e14561-2243-4ab6-b34b-0c7c18405733 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:52.407924 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e14561-2243-4ab6-b34b-0c7c18405733 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:52.427144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-44e14561-2243-4ab6-b34b-0c7c18405733 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 01:51:52.427144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:52.427144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:52.427144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:52.427144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:52.427144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:52.427144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:52.427144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:52.427144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:52.427144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:52.427144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:52.427144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:52.427144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:51:52.427144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:51:52.427144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:51:52.427144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:51:52.428268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:52.428268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:52.428268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:51:52.428268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:52.428268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:51:52.428268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:52.428268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:52.428268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:52.428268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:52.428268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:52.428268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:52.428268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:52.428268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:52.428268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:52.428268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:52.428268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:52.428268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:52.428268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:52.429227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:52.429227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:52.429227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:51:52.429227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:51:52.429227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:51:52.429227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:51:52.429227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:51:52.429227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:51:52.429227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 01:51:52.429227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:52.431965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 377/752] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:51:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:52.432917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e14561-2243-4ab6-b34b-0c7c18405733 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:52.456978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbd822-7fc0-4461-9ffa-7a304833a413 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:52.458583 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbd822-7fc0-4461-9ffa-7a304833a413 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:52.537267 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:52.545355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e14561-2243-4ab6-b34b-0c7c18405733 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:52.573481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 376/753] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 01:51:52.574496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbd822-7fc0-4461-9ffa-7a304833a413 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:52.583378 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655cea3-249a-42cc-b537-3554f38e554a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:52.585003 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655cea3-249a-42cc-b537-3554f38e554a None admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:52.585507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655cea3-249a-42cc-b537-3554f38e554a None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:52.586019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655cea3-249a-42cc-b537-3554f38e554a None admin] PATH_INFO: `/v3/projects/3f3b06be1b5a4b3a8235ebf22da2a018/users/9d3b5180fb7144c394c39d4db28713b9/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:52.588309 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655cea3-249a-42cc-b537-3554f38e554a None admin] RBAC: Authorizing `identity:create_grant(project_id=3f3b06be1b5a4b3a8235ebf22da2a018, user_id=9d3b5180fb7144c394c39d4db28713b9, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:52.590107 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655cea3-249a-42cc-b537-3554f38e554a None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:52.605556 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:52.607917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 378/754] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:51:52 2022] PUT /identity/v3/projects/3f3b06be1b5a4b3a8235ebf22da2a018/users/9d3b5180fb7144c394c39d4db28713b9/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:51:52.609093 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655cea3-249a-42cc-b537-3554f38e554a None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:52.690319 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbd822-7fc0-4461-9ffa-7a304833a413 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:52.726872 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655cea3-249a-42cc-b537-3554f38e554a None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:52.729944 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a329db-65fb-4b67-a000-ddb1f7ade62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:52.731114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a329db-65fb-4b67-a000-ddb1f7ade62d None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:52.731114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a329db-65fb-4b67-a000-ddb1f7ade62d None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:52.731305 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a329db-65fb-4b67-a000-ddb1f7ade62d None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:52.732168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a329db-65fb-4b67-a000-ddb1f7ade62d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:52.732490 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a329db-65fb-4b67-a000-ddb1f7ade62d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:52.734136 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a329db-65fb-4b67-a000-ddb1f7ade62d None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:52.759914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 377/755] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Jun 23 01:51:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:52.761516 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7f2cf-e9ac-468a-84ec-b51cdfde6028 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:52.761811 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7f2cf-e9ac-468a-84ec-b51cdfde6028 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:52.762089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7f2cf-e9ac-468a-84ec-b51cdfde6028 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:52.763835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 378/756] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:52.765381 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7f2cf-e9ac-468a-84ec-b51cdfde6028 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:52.768706 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ace68-8f59-4111-a376-b9744c3fe4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:52.769877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ace68-8f59-4111-a376-b9744c3fe4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:52.770400 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ace68-8f59-4111-a376-b9744c3fe4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:52.770882 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ace68-8f59-4111-a376-b9744c3fe4e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:52.783775 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ace68-8f59-4111-a376-b9744c3fe4e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:52.785959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ace68-8f59-4111-a376-b9744c3fe4e0 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:52.807216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-911ace68-8f59-4111-a376-b9744c3fe4e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:52.807216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:52.807216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:52.807216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:52.807216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:52.807216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:52.807216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:52.807216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:52.807216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:52.807216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:52.807216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:52.807216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:52.807216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:52.807216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:52.807216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:52.808313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:52.808313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:52.808313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:52.808313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:52.808313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:52.808313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:52.808313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:52.808313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:52.808313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:52.808313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:52.808313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:52.808313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:52.808313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:52.808313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:52.808313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:52.808313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:52.808313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:52.809324 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:52.809324 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:52.809324 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:52.809324 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:52.809324 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 379/757] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:52.809858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbef34-10cc-42ba-bef5-0a84f1d42e5d None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:52.810162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbef34-10cc-42ba-bef5-0a84f1d42e5d None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:52.810428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbef34-10cc-42ba-bef5-0a84f1d42e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:52.827898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-dcbbef34-10cc-42ba-bef5-0a84f1d42e5d None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:52.829102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-dcbbef34-10cc-42ba-bef5-0a84f1d42e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:52.840537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:52.886708 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:52.904690 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7f2cf-e9ac-468a-84ec-b51cdfde6028 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:52.919437 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 380/758] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:51:52.919437 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbef34-10cc-42ba-bef5-0a84f1d42e5d None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:52.959398 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a69a8a-2f1d-4990-8712-70cf59a0d330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:52.960096 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a69a8a-2f1d-4990-8712-70cf59a0d330 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:52.960374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a69a8a-2f1d-4990-8712-70cf59a0d330 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:52.960643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a69a8a-2f1d-4990-8712-70cf59a0d330 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:53.029915 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbef34-10cc-42ba-bef5-0a84f1d42e5d None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:53.030261 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a69a8a-2f1d-4990-8712-70cf59a0d330 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:53.031668 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a69a8a-2f1d-4990-8712-70cf59a0d330 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:53.066136 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0286389-0110-4802-9c84-b1ea26ecdc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:53.067662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0286389-0110-4802-9c84-b1ea26ecdc2f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:53.067948 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0286389-0110-4802-9c84-b1ea26ecdc2f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:53.068223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0286389-0110-4802-9c84-b1ea26ecdc2f None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:53.069000 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0286389-0110-4802-9c84-b1ea26ecdc2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:53.069306 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0286389-0110-4802-9c84-b1ea26ecdc2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:53.070718 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0286389-0110-4802-9c84-b1ea26ecdc2f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:53.087026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 381/759] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:53.088334 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0286389-0110-4802-9c84-b1ea26ecdc2f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:53.092132 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:53.123530 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:53.142889 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 379/760] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 01:51:53.144073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a69a8a-2f1d-4990-8712-70cf59a0d330 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:53.229447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0286389-0110-4802-9c84-b1ea26ecdc2f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:53.254634 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a69a8a-2f1d-4990-8712-70cf59a0d330 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:53.278165 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c5af4-37b8-4be2-ba25-5cc9e22f4759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:53.279909 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c5af4-37b8-4be2-ba25-5cc9e22f4759 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:53.280419 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c5af4-37b8-4be2-ba25-5cc9e22f4759 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:53.281119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c5af4-37b8-4be2-ba25-5cc9e22f4759 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:53.282212 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c5af4-37b8-4be2-ba25-5cc9e22f4759 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:53.284711 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c5af4-37b8-4be2-ba25-5cc9e22f4759 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:53.293888 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eac7c1-3687-4fed-b4b6-31cdb195a44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:53.294762 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eac7c1-3687-4fed-b4b6-31cdb195a44a None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:53.295128 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eac7c1-3687-4fed-b4b6-31cdb195a44a None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:53.295514 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eac7c1-3687-4fed-b4b6-31cdb195a44a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:53.302654 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eac7c1-3687-4fed-b4b6-31cdb195a44a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:53.303607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-4e8c5af4-37b8-4be2-ba25-5cc9e22f4759 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 01:51:53.303607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:53.303607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:51:53.303607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:51:53.303607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:51:53.303607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:51:53.303607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:51:53.303607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:51:53.303607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 01:51:53.303607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:53.303607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:51:53.303607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:53.303607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:53.303607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:53.303607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:53.303607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:53.304565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:53.304565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:53.304565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:53.304565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:53.304565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:53.304565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:53.304565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:53.304565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:51:53.304565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:51:53.304565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:51:53.304565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:51:53.304565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:53.304565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:53.304565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:53.304565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:53.304565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:53.305428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:53.305428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:53.305428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:53.305428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:53.305428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:53.305428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:53.305428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:53.305428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:53.305428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:53.305428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:53.305428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:53.305428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:51:53.305428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:51:53.305428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 01:51:53.305428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:53.306258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eac7c1-3687-4fed-b4b6-31cdb195a44a None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:53.313834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 382/761] 10.222.0.13 () {56 vars in 1129 bytes} [Thu Jun 23 01:51:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:53.313834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c5af4-37b8-4be2-ba25-5cc9e22f4759 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:53.323535 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-d2eac7c1-3687-4fed-b4b6-31cdb195a44a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:53.323535 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:53.323535 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:53.323535 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:53.323535 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:53.323535 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:53.323535 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:53.323535 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:53.323535 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:53.323535 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:53.323535 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:53.323535 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:53.323535 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:51:53.323535 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:51:53.323535 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:51:53.324481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:51:53.324481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:53.324481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:53.324481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:53.324481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:53.324481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:53.324481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:53.324481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:53.324481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:53.324481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:53.324481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:53.324481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:53.324481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:53.324481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:53.324481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:53.324481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:53.324481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:53.325387 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:51:53.325387 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:51:53.325387 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:51:53.325387 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:51:53.325387 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:51:53.325387 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:51:53.325387 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:53.325387 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:53.325387 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 380/762] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:53.326326 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eac7c1-3687-4fed-b4b6-31cdb195a44a None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:53.386002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:53.393799 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:53.436460 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c5af4-37b8-4be2-ba25-5cc9e22f4759 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:53.452133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eac7c1-3687-4fed-b4b6-31cdb195a44a None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:53.472122 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0aaca-c67f-48f0-9bcb-097536c1d77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:53.473227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0aaca-c67f-48f0-9bcb-097536c1d77f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:53.473651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0aaca-c67f-48f0-9bcb-097536c1d77f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:53.474081 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0aaca-c67f-48f0-9bcb-097536c1d77f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:53.485448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0aaca-c67f-48f0-9bcb-097536c1d77f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:53.487153 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0aaca-c67f-48f0-9bcb-097536c1d77f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:53.488941 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca790487-ddb3-42ce-9308-e103e93bc012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:53.489701 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca790487-ddb3-42ce-9308-e103e93bc012 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:53.489874 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca790487-ddb3-42ce-9308-e103e93bc012 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:53.490147 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca790487-ddb3-42ce-9308-e103e93bc012 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:53.490854 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca790487-ddb3-42ce-9308-e103e93bc012 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:53.491157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca790487-ddb3-42ce-9308-e103e93bc012 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:53.492565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca790487-ddb3-42ce-9308-e103e93bc012 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:53.501947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 381/763] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Jun 23 01:51:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:53.502783 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca790487-ddb3-42ce-9308-e103e93bc012 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:53.507299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-a1c0aaca-c67f-48f0-9bcb-097536c1d77f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:53.507299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:53.507299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:53.507299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:53.507299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:53.507299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:53.507299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:53.507299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:53.507299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:53.507299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:53.507299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:53.507299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:53.507299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:53.507299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:53.507299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:53.508215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:53.508215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:53.508215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:53.508215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:53.508215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:53.508215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:53.508215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:53.508215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:53.508215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:53.508215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:53.508215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:53.508215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:53.508215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:53.508215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:53.508215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:53.508215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:53.508215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:53.509108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:53.509108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:53.509108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:53.509108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:53.511253 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 383/764] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:53.512257 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0aaca-c67f-48f0-9bcb-097536c1d77f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:53.608208 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca790487-ddb3-42ce-9308-e103e93bc012 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:53.617008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0aaca-c67f-48f0-9bcb-097536c1d77f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:53.620946 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:53.636791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:53.648677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbe0bc-8413-43bd-9b65-a937412d8e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:53.649463 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbe0bc-8413-43bd-9b65-a937412d8e64 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:53.649720 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbe0bc-8413-43bd-9b65-a937412d8e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:53.650000 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbe0bc-8413-43bd-9b65-a937412d8e64 None admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:53.650917 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbe0bc-8413-43bd-9b65-a937412d8e64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:53.651190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbe0bc-8413-43bd-9b65-a937412d8e64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:53.652756 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbe0bc-8413-43bd-9b65-a937412d8e64 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:53.656738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93666f0-2b6d-4f15-89b4-1208eac04211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:53.657648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93666f0-2b6d-4f15-89b4-1208eac04211 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:53.658129 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93666f0-2b6d-4f15-89b4-1208eac04211 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:53.658596 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93666f0-2b6d-4f15-89b4-1208eac04211 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:53.659792 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93666f0-2b6d-4f15-89b4-1208eac04211 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:53.660872 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93666f0-2b6d-4f15-89b4-1208eac04211 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:53.662931 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93666f0-2b6d-4f15-89b4-1208eac04211 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:53.666121 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 382/765] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:51:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:53.667016 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbe0bc-8413-43bd-9b65-a937412d8e64 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:53.669290 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 384/766] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Jun 23 01:51:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:53.671589 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93666f0-2b6d-4f15-89b4-1208eac04211 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:53.785008 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbe0bc-8413-43bd-9b65-a937412d8e64 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:53.791310 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93666f0-2b6d-4f15-89b4-1208eac04211 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:53.821335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab971c-040e-41f0-b636-87ebea6f46f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:53.822006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab971c-040e-41f0-b636-87ebea6f46f8 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:53.822288 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab971c-040e-41f0-b636-87ebea6f46f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:53.822554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab971c-040e-41f0-b636-87ebea6f46f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:53.823274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab971c-040e-41f0-b636-87ebea6f46f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:53.823607 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab971c-040e-41f0-b636-87ebea6f46f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:53.825015 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab971c-040e-41f0-b636-87ebea6f46f8 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:53.826348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ceb4d-65db-4177-a43d-47b4f0ce9e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:53.827248 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ceb4d-65db-4177-a43d-47b4f0ce9e80 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:53.828107 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ceb4d-65db-4177-a43d-47b4f0ce9e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:53.828394 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ceb4d-65db-4177-a43d-47b4f0ce9e80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:53.829259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ceb4d-65db-4177-a43d-47b4f0ce9e80 None admin] RBAC: Adding query filter params (role.id=c8b68b76c1b44e549cc7520e5546d374, scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018, user.id=0dbf596d8f964d4695944a23dd8e4cef) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:53.829572 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ceb4d-65db-4177-a43d-47b4f0ce9e80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:53.831096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ceb4d-65db-4177-a43d-47b4f0ce9e80 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:53.846109 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 383/767] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:53.846109 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab971c-040e-41f0-b636-87ebea6f46f8 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:53.846399 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 385/768] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:51:53 2022] GET /identity/v3/role_assignments?user.id=0dbf596d8f964d4695944a23dd8e4cef&scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018&role.id=c8b68b76c1b44e549cc7520e5546d374 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:51:53.846399 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4152f0-eb2e-4599-b86e-cc4c22e7179b None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:53.846399 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4152f0-eb2e-4599-b86e-cc4c22e7179b None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:53.846399 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4152f0-eb2e-4599-b86e-cc4c22e7179b None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:53.846399 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 386/769] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:53.846399 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4152f0-eb2e-4599-b86e-cc4c22e7179b None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:53.880958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:53.912610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:53.982333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4152f0-eb2e-4599-b86e-cc4c22e7179b None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:53.982791 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab971c-040e-41f0-b636-87ebea6f46f8 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:54.030205 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd0241-4082-4318-86b7-a60c043a3ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:54.030509 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db183cc2-4940-4fb1-921e-42ba35fefedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:54.031188 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db183cc2-4940-4fb1-921e-42ba35fefedc None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:54.031311 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd0241-4082-4318-86b7-a60c043a3ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:54.031490 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db183cc2-4940-4fb1-921e-42ba35fefedc None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:54.031771 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db183cc2-4940-4fb1-921e-42ba35fefedc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:54.031872 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd0241-4082-4318-86b7-a60c043a3ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:54.032238 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd0241-4082-4318-86b7-a60c043a3ff4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:54.032574 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db183cc2-4940-4fb1-921e-42ba35fefedc None admin] RBAC: Adding query filter params (interface=public, service_id=89b0e01b5df74305a16648089831051f, region_id=RegionOne) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:54.032890 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db183cc2-4940-4fb1-921e-42ba35fefedc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:54.034643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db183cc2-4940-4fb1-921e-42ba35fefedc None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:54.039965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd0241-4082-4318-86b7-a60c043a3ff4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:54.041492 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd0241-4082-4318-86b7-a60c043a3ff4 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:54.043809 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 384/770] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Jun 23 01:51:53 2022] GET /identity/v3/endpoints?service_id=89b0e01b5df74305a16648089831051f&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:54.045548 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6f30e-ebb9-4065-8131-555ab459172b None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:54.046042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6f30e-ebb9-4065-8131-555ab459172b None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:54.046494 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6f30e-ebb9-4065-8131-555ab459172b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:54.056605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-99cd0241-4082-4318-86b7-a60c043a3ff4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:54.056605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:54.056605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:54.056605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:54.056605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:54.056605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:54.056605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:54.056605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:54.056605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:54.056605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:54.056605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:54.056605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:54.056605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:51:54.056605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:51:54.056605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:51:54.057518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:51:54.057518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:54.057518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:54.057518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:54.057518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:54.057518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:54.057518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:54.057518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:54.057518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:54.057518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:54.057518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:54.057518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:54.057518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:54.057518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:54.057518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:54.057518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:54.057518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:54.058400 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:51:54.058400 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:51:54.058400 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:51:54.058400 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:51:54.058400 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:51:54.058400 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:51:54.058400 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:54.058400 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:54.063189 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 387/771] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:54.064183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd0241-4082-4318-86b7-a60c043a3ff4 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:54.067609 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-7ba6f30e-ebb9-4065-8131-555ab459172b None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:54.069936 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-7ba6f30e-ebb9-4065-8131-555ab459172b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:54.159227 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 385/772] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:51:54.160434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6f30e-ebb9-4065-8131-555ab459172b None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:54.192000 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:54.193841 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd0241-4082-4318-86b7-a60c043a3ff4 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:54.227997 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:54.232840 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d3b7a-e189-4192-9931-c74623b79507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:54.233812 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d3b7a-e189-4192-9931-c74623b79507 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:54.234162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d3b7a-e189-4192-9931-c74623b79507 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:54.234505 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d3b7a-e189-4192-9931-c74623b79507 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:54.235278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d3b7a-e189-4192-9931-c74623b79507 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:54.236941 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d3b7a-e189-4192-9931-c74623b79507 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:54.243068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 388/773] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 23 01:51:54 2022] GET /identity/v3/services => generated 772 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:54.243981 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d3b7a-e189-4192-9931-c74623b79507 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:54.314396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6f30e-ebb9-4065-8131-555ab459172b None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:54.393159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484407ce-9a5e-4b12-8fc4-ae03bc2c3d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:54.394604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484407ce-9a5e-4b12-8fc4-ae03bc2c3d27 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:54.396255 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484407ce-9a5e-4b12-8fc4-ae03bc2c3d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:54.396870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484407ce-9a5e-4b12-8fc4-ae03bc2c3d27 None admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:54.398098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484407ce-9a5e-4b12-8fc4-ae03bc2c3d27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:54.400455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484407ce-9a5e-4b12-8fc4-ae03bc2c3d27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:54.402243 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484407ce-9a5e-4b12-8fc4-ae03bc2c3d27 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:54.427619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 386/774] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:51:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:54.433850 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484407ce-9a5e-4b12-8fc4-ae03bc2c3d27 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:54.450339 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d3b7a-e189-4192-9931-c74623b79507 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:54.498037 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96564b-2d63-4389-8c1d-45c452823a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:54.498853 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96564b-2d63-4389-8c1d-45c452823a6c None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:54.499132 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96564b-2d63-4389-8c1d-45c452823a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:54.499404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96564b-2d63-4389-8c1d-45c452823a6c None admin] PATH_INFO: `/v3/services/network` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:54.500091 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96564b-2d63-4389-8c1d-45c452823a6c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:54.502310 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96564b-2d63-4389-8c1d-45c452823a6c None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:54.518404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-3b96564b-2d63-4389-8c1d-45c452823a6c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 01:51:54.518404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:54.518404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:51:54.518404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:51:54.518404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:51:54.518404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:51:54.518404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:51:54.518404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:51:54.518404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 01:51:54.518404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:54.518404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:51:54.518404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:54.518404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:54.518404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:54.518404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:54.518404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:54.518404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:54.519898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:54.519898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:54.519898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:54.519898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:54.519898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:54.519898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:54.519898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:51:54.519898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:51:54.519898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:51:54.519898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:51:54.519898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:54.519898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:54.519898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:54.519898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:54.519898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:54.519898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:54.520743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:54.520743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:54.520743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:54.520743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:54.520743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:54.520743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:54.520743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:54.520743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:54.520743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:54.520743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:54.520743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:51:54.520743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:51:54.520743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 01:51:54.520743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:54.520743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 389/775] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:54 2022] GET /identity/v3/services/network => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:54.531225 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96564b-2d63-4389-8c1d-45c452823a6c None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:54.546516 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:54.563704 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484407ce-9a5e-4b12-8fc4-ae03bc2c3d27 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:54.600129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953c3e4-a660-47c2-b5c3-8572e0b2cf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:54.601163 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953c3e4-a660-47c2-b5c3-8572e0b2cf49 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:54.601668 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953c3e4-a660-47c2-b5c3-8572e0b2cf49 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:54.602153 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:54.602984 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953c3e4-a660-47c2-b5c3-8572e0b2cf49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:54.604119 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953c3e4-a660-47c2-b5c3-8572e0b2cf49 None admin] RBAC: Adding query filter params (role.id=58e04437159e4eb39aa4a43c213ea34c, scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018, user.id=1ae132c4d0b5461aa26ab929a017cb08) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:54.604739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953c3e4-a660-47c2-b5c3-8572e0b2cf49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:54.606452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953c3e4-a660-47c2-b5c3-8572e0b2cf49 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:54.614276 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 387/776] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:51:54 2022] GET /identity/v3/role_assignments?user.id=1ae132c4d0b5461aa26ab929a017cb08&scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018&role.id=58e04437159e4eb39aa4a43c213ea34c => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:54.697253 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96564b-2d63-4389-8c1d-45c452823a6c None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:54.738067 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc996e6-f1de-494f-a172-8a9911f1f419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:54.739111 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc996e6-f1de-494f-a172-8a9911f1f419 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:54.739640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc996e6-f1de-494f-a172-8a9911f1f419 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:54.740152 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc996e6-f1de-494f-a172-8a9911f1f419 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:54.741063 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc996e6-f1de-494f-a172-8a9911f1f419 None admin] RBAC: Adding query filter params (name=network) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:54.741602 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc996e6-f1de-494f-a172-8a9911f1f419 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:54.743210 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc996e6-f1de-494f-a172-8a9911f1f419 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:54.751358 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 390/777] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 01:51:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:54.757241 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953c3e4-a660-47c2-b5c3-8572e0b2cf49 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:54.835802 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82aae2-f089-4aa8-8071-c80e559e8248 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:54.836448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82aae2-f089-4aa8-8071-c80e559e8248 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:54.836926 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82aae2-f089-4aa8-8071-c80e559e8248 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:54.838537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 391/778] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:51:54.853499 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61eeb7-c3d5-4912-ac88-3416e9268015 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:54.854262 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61eeb7-c3d5-4912-ac88-3416e9268015 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:54.854752 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61eeb7-c3d5-4912-ac88-3416e9268015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:54.884395 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-da61eeb7-c3d5-4912-ac88-3416e9268015 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:54.886586 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-da61eeb7-c3d5-4912-ac88-3416e9268015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:54.929601 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953c3e4-a660-47c2-b5c3-8572e0b2cf49 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:54.969371 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 392/779] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 01:51:54.991449 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ffbe3-fe38-4fe8-be8e-73e57de76355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:54.992066 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ffbe3-fe38-4fe8-be8e-73e57de76355 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:54.992353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ffbe3-fe38-4fe8-be8e-73e57de76355 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:54.992631 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ffbe3-fe38-4fe8-be8e-73e57de76355 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:54.993403 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ffbe3-fe38-4fe8-be8e-73e57de76355 None admin] RBAC: Adding query filter params (type=network) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:54.993712 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ffbe3-fe38-4fe8-be8e-73e57de76355 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:54.995155 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ffbe3-fe38-4fe8-be8e-73e57de76355 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:55.000686 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 388/780] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 01:51:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:55.005031 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61eeb7-c3d5-4912-ac88-3416e9268015 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:55.013313 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ffbe3-fe38-4fe8-be8e-73e57de76355 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:55.043609 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:55.051817 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:55.182484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61eeb7-c3d5-4912-ac88-3416e9268015 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:55.212657 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ffbe3-fe38-4fe8-be8e-73e57de76355 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:55.243388 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc0be9-6c18-4e43-b712-db369724671e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:55.244143 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc0be9-6c18-4e43-b712-db369724671e None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:55.244421 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc0be9-6c18-4e43-b712-db369724671e None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:55.244690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc0be9-6c18-4e43-b712-db369724671e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:55.250669 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c7f4c-fe0d-4f51-9b64-29bc2cadb5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:55.251456 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c7f4c-fe0d-4f51-9b64-29bc2cadb5dd None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:55.251940 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c7f4c-fe0d-4f51-9b64-29bc2cadb5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:55.252218 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c7f4c-fe0d-4f51-9b64-29bc2cadb5dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:55.254487 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c7f4c-fe0d-4f51-9b64-29bc2cadb5dd None admin] RBAC: Adding query filter params (interface=public, service_id=086439a14d6a4205af36fa9eaad5fa03, region_id=RegionOne) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:55.254891 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c7f4c-fe0d-4f51-9b64-29bc2cadb5dd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:55.256578 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c7f4c-fe0d-4f51-9b64-29bc2cadb5dd None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:55.262601 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 389/781] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Jun 23 01:51:55 2022] GET /identity/v3/endpoints?service_id=086439a14d6a4205af36fa9eaad5fa03&interface=public®ion_id=RegionOne => generated 194 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:55.270303 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c7f4c-fe0d-4f51-9b64-29bc2cadb5dd None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:55.275997 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc0be9-6c18-4e43-b712-db369724671e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:55.283819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-93dc0be9-6c18-4e43-b712-db369724671e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:51:55.283819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:55.283819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:55.283819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:55.283819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:55.283819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:55.283819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:55.283819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:55.283819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:55.283819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:55.283819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:55.283819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:55.283819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:55.283819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:55.283819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:55.283819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:55.284806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:55.284806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:55.284806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:55.284806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:55.284806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:55.284806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:55.284806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:55.284806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:55.284806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:55.284806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:55.284806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:55.284806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:55.284806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:55.284806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:55.284806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:55.284806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:55.285653 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:55.285653 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:55.285653 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:55.285653 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:55.285653 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:55.285653 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:55.285653 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:55.285653 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:55.285653 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:55.285653 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:55.285653 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:51:55.285653 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:55.285653 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 393/782] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:51:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:55.296381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc0be9-6c18-4e43-b712-db369724671e None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:55.363790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:55.402959 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c7f4c-fe0d-4f51-9b64-29bc2cadb5dd None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:55.470764 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6afaf-90a1-4745-8a51-4ca682accc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:55.471465 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6afaf-90a1-4745-8a51-4ca682accc21 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:55.473973 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6afaf-90a1-4745-8a51-4ca682accc21 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:55.474261 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6afaf-90a1-4745-8a51-4ca682accc21 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:55.474969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6afaf-90a1-4745-8a51-4ca682accc21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:55.476486 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6afaf-90a1-4745-8a51-4ca682accc21 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:55.488599 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 390/783] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 23 01:51:55 2022] GET /identity/v3/services => generated 772 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:55.493008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:55.509321 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc0be9-6c18-4e43-b712-db369724671e None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:55.547467 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015cd9e-0f80-4c33-8b99-2ce1e55261b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:55.548237 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015cd9e-0f80-4c33-8b99-2ce1e55261b3 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:55.548526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015cd9e-0f80-4c33-8b99-2ce1e55261b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:55.548809 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015cd9e-0f80-4c33-8b99-2ce1e55261b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:55.549626 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015cd9e-0f80-4c33-8b99-2ce1e55261b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:55.549998 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015cd9e-0f80-4c33-8b99-2ce1e55261b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:55.552262 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015cd9e-0f80-4c33-8b99-2ce1e55261b3 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:55.562706 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 394/784] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:55.568660 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6afaf-90a1-4745-8a51-4ca682accc21 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:55.704039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6afaf-90a1-4745-8a51-4ca682accc21 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:55.743032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fba36-b8cf-4e2a-a556-347bc035e90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:55.743899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fba36-b8cf-4e2a-a556-347bc035e90f None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:55.744322 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fba36-b8cf-4e2a-a556-347bc035e90f None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:55.744601 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fba36-b8cf-4e2a-a556-347bc035e90f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:55.754612 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:55.756936 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966fba36-b8cf-4e2a-a556-347bc035e90f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:55.758565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966fba36-b8cf-4e2a-a556-347bc035e90f None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:55.777504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-966fba36-b8cf-4e2a-a556-347bc035e90f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:55.777504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:55.777504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:55.777504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:55.777504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:55.777504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:55.777504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:55.777504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:55.777504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:55.777504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:55.777504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:55.777504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:55.777504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:55.777504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:55.777504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:55.778402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:55.778402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:55.778402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:55.778402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:55.778402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:55.778402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:55.778402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:55.778402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:55.778402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:55.778402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:55.778402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:55.778402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:55.778402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:55.778402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:55.778402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:55.778402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:55.778402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:55.779303 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:55.779303 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:55.779303 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:55.779303 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:55.779303 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 391/785] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:55.785358 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015cd9e-0f80-4c33-8b99-2ce1e55261b3 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:55.897824 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015cd9e-0f80-4c33-8b99-2ce1e55261b3 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:55.949614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf03d1-2ff3-43ae-9485-66fea35895e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:55.949614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf03d1-2ff3-43ae-9485-66fea35895e6 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:55.949614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf03d1-2ff3-43ae-9485-66fea35895e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:55.950243 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf03d1-2ff3-43ae-9485-66fea35895e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:55.950649 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf03d1-2ff3-43ae-9485-66fea35895e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:55.950958 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf03d1-2ff3-43ae-9485-66fea35895e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:55.952518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf03d1-2ff3-43ae-9485-66fea35895e6 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:55.965894 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 395/786] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:55.971707 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fba36-b8cf-4e2a-a556-347bc035e90f None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:56.083318 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fba36-b8cf-4e2a-a556-347bc035e90f None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:56.119059 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab5773-6916-49a6-b352-128d238410dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:56.119950 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab5773-6916-49a6-b352-128d238410dd None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:56.120236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab5773-6916-49a6-b352-128d238410dd None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:56.120514 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab5773-6916-49a6-b352-128d238410dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:56.129468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab5773-6916-49a6-b352-128d238410dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:56.130963 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab5773-6916-49a6-b352-128d238410dd None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:56.146898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-efab5773-6916-49a6-b352-128d238410dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 01:51:56.146898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:56.146898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:56.146898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:56.146898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:56.146898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:56.146898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:56.146898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:56.146898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:56.146898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:56.146898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:56.146898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:56.146898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:51:56.146898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:51:56.146898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:51:56.146898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:51:56.149150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:56.149150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:56.149150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:51:56.149150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:56.149150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:51:56.149150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:56.149150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:56.149150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:56.149150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:56.149150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:56.149150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:56.149150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:56.149150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:56.149150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:56.149150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:56.149150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:56.149150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:56.149150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:56.151381 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:56.151381 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:56.151381 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:51:56.151381 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:51:56.151381 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:51:56.151381 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:51:56.151381 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:51:56.151381 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:51:56.151381 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 01:51:56.151381 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:56.151381 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 392/787] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 23 01:51:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:56.159461 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf03d1-2ff3-43ae-9485-66fea35895e6 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:56.167757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b2b15-6a4d-47e7-89cd-b8bed0ddc737 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:56.168045 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b2b15-6a4d-47e7-89cd-b8bed0ddc737 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:56.168325 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b2b15-6a4d-47e7-89cd-b8bed0ddc737 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:56.171888 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 393/788] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:56.172189 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:56.177284 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c5067-91ef-4190-94d3-2ebb08b5ab21 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:56.177609 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c5067-91ef-4190-94d3-2ebb08b5ab21 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:56.177894 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c5067-91ef-4190-94d3-2ebb08b5ab21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:56.217844 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-c47c5067-91ef-4190-94d3-2ebb08b5ab21 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:56.219058 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-c47c5067-91ef-4190-94d3-2ebb08b5ab21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:56.318481 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf03d1-2ff3-43ae-9485-66fea35895e6 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:56.356660 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:56.357660 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205db1f8-4f62-4b3b-94ab-b2a13e97c402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:56.358354 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205db1f8-4f62-4b3b-94ab-b2a13e97c402 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:56.358641 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205db1f8-4f62-4b3b-94ab-b2a13e97c402 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:56.358919 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205db1f8-4f62-4b3b-94ab-b2a13e97c402 None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:56.359882 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205db1f8-4f62-4b3b-94ab-b2a13e97c402 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:56.360241 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205db1f8-4f62-4b3b-94ab-b2a13e97c402 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:56.362089 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205db1f8-4f62-4b3b-94ab-b2a13e97c402 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:56.383353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 396/789] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 23 01:51:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:56.389403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205db1f8-4f62-4b3b-94ab-b2a13e97c402 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:56.445161 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 394/790] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:51:56.475330 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:56.476920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c5067-91ef-4190-94d3-2ebb08b5ab21 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:56.499888 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205db1f8-4f62-4b3b-94ab-b2a13e97c402 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:56.539874 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9162a0-a0da-49a3-8679-689cab980726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:56.541075 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9162a0-a0da-49a3-8679-689cab980726 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:56.541547 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9162a0-a0da-49a3-8679-689cab980726 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:56.542056 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9162a0-a0da-49a3-8679-689cab980726 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:56.623953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9162a0-a0da-49a3-8679-689cab980726 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:56.625716 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9162a0-a0da-49a3-8679-689cab980726 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:56.677258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c5067-91ef-4190-94d3-2ebb08b5ab21 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:56.708055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:56.715521 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c818b-476b-43a7-99b0-b75efcb29d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:56.716565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c818b-476b-43a7-99b0-b75efcb29d52 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:56.716985 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c818b-476b-43a7-99b0-b75efcb29d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:56.717394 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c818b-476b-43a7-99b0-b75efcb29d52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:56.728746 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c818b-476b-43a7-99b0-b75efcb29d52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:56.737269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-b55c818b-476b-43a7-99b0-b75efcb29d52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:56.737269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:56.737269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:56.737269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:56.737269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:56.737269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:56.737269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:56.737269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:56.737269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:56.737269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:56.737269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:56.737269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:56.737269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:56.737269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:56.737269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:56.737269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:56.738432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:56.738432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:56.738432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:56.738432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:56.738432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:56.738432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:56.738432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:56.738432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:56.738432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:56.738432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:56.738432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:56.738432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:56.738432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:56.738432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:56.738432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:56.738432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:56.739478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:56.739478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:56.739478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:56.739478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:56.739478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:56.739478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:56.739478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:56.739478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:56.739478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:56.739478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:56.739478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:51:56.739478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:56.741977 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 395/791] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 01:51:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:51:56.747996 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c818b-476b-43a7-99b0-b75efcb29d52 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:56.751375 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 397/792] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:51:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 01:51:56.760476 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9162a0-a0da-49a3-8679-689cab980726 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:56.855784 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:56.877078 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9162a0-a0da-49a3-8679-689cab980726 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:56.928084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c818b-476b-43a7-99b0-b75efcb29d52 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:56.940067 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f3eb7-1f72-42db-ad73-09ff8d887faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:56.942313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f3eb7-1f72-42db-ad73-09ff8d887faa None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:56.942704 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f3eb7-1f72-42db-ad73-09ff8d887faa None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:56.943082 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f3eb7-1f72-42db-ad73-09ff8d887faa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:56.958612 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f3eb7-1f72-42db-ad73-09ff8d887faa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:56.960952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f3eb7-1f72-42db-ad73-09ff8d887faa None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:56.967052 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2829227-c4a8-41d6-954d-4ed9db02e4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:56.967756 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2829227-c4a8-41d6-954d-4ed9db02e4fe None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:56.968035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2829227-c4a8-41d6-954d-4ed9db02e4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:56.968303 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2829227-c4a8-41d6-954d-4ed9db02e4fe None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:56.969055 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2829227-c4a8-41d6-954d-4ed9db02e4fe None admin] RBAC: Adding query filter params (name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:56.969356 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2829227-c4a8-41d6-954d-4ed9db02e4fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:56.970713 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2829227-c4a8-41d6-954d-4ed9db02e4fe None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:56.983902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-731f3eb7-1f72-42db-ad73-09ff8d887faa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:56.983902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:56.983902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:56.983902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:56.983902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:56.983902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:56.983902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:56.983902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:56.983902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:56.983902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:56.983902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:56.983902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:56.983902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:56.983902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:56.983902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:56.985086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:56.985086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:56.985086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:56.985086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:56.985086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:56.985086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:56.985086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:56.985086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:56.985086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:56.985086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:56.985086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:56.985086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:56.985086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:56.985086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:56.985086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:56.985086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:56.985086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:56.986165 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:56.986165 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:56.986165 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:56.986165 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:56.986439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 396/793] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 01:51:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:51:56.986439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f522a67-2740-4832-8d51-124d8df8a428 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:56.986439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f522a67-2740-4832-8d51-124d8df8a428 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:56.986668 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f522a67-2740-4832-8d51-124d8df8a428 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:56.988477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 398/795] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:51:56.991943 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 397/795] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:56.993439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b090a-f458-453a-81ec-7b982e07dd9e None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:56.993763 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f3eb7-1f72-42db-ad73-09ff8d887faa None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:56.993895 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b090a-f458-453a-81ec-7b982e07dd9e None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:56.994273 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b090a-f458-453a-81ec-7b982e07dd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:57.012437 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-9f0b090a-f458-453a-81ec-7b982e07dd9e None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:57.013760 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-9f0b090a-f458-453a-81ec-7b982e07dd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:57.022899 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:57.094958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 398/796] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 01:51:57.096072 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b090a-f458-453a-81ec-7b982e07dd9e None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:57.124494 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f3eb7-1f72-42db-ad73-09ff8d887faa None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:57.149993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:57.170268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515a375-4d7b-4cd4-9359-32b33f8681ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:57.171617 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515a375-4d7b-4cd4-9359-32b33f8681ae None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:57.172047 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515a375-4d7b-4cd4-9359-32b33f8681ae None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:57.172467 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515a375-4d7b-4cd4-9359-32b33f8681ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:57.186107 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515a375-4d7b-4cd4-9359-32b33f8681ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:57.187704 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515a375-4d7b-4cd4-9359-32b33f8681ae None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:57.205198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-6515a375-4d7b-4cd4-9359-32b33f8681ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:57.205198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:57.205198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:57.205198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:57.205198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:57.205198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:57.205198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:57.205198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:57.205198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:57.205198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:57.205198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:57.205198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:57.205198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:57.205198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:57.205198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:57.206640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:57.206640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:57.206640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:57.206640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:57.206640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:57.206640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:57.206640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:57.206640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:57.206640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:57.206640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:57.206640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:57.206640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:57.206640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:57.206640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:57.206640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:57.206640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:57.206640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:57.207889 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:57.207889 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:57.207889 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:57.207889 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:57.213438 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 399/797] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:57.214469 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515a375-4d7b-4cd4-9359-32b33f8681ae None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:57.241030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b090a-f458-453a-81ec-7b982e07dd9e None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:57.283832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d20cee-5337-4eb5-a315-58461bc9fa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:57.284803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d20cee-5337-4eb5-a315-58461bc9fa2c None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:57.284925 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d20cee-5337-4eb5-a315-58461bc9fa2c None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:57.285118 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d20cee-5337-4eb5-a315-58461bc9fa2c None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:57.285836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d20cee-5337-4eb5-a315-58461bc9fa2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:57.286140 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d20cee-5337-4eb5-a315-58461bc9fa2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:57.288193 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d20cee-5337-4eb5-a315-58461bc9fa2c None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:57.292608 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:57.300263 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 399/798] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:57.300919 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d20cee-5337-4eb5-a315-58461bc9fa2c None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:57.331861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515a375-4d7b-4cd4-9359-32b33f8681ae None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:57.367790 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b473e-9ec4-4c34-a9f9-6412ae740011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:57.368624 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b473e-9ec4-4c34-a9f9-6412ae740011 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:57.368907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b473e-9ec4-4c34-a9f9-6412ae740011 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:57.369184 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b473e-9ec4-4c34-a9f9-6412ae740011 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:57.369844 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b473e-9ec4-4c34-a9f9-6412ae740011 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:57.371218 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b473e-9ec4-4c34-a9f9-6412ae740011 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:57.384471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-6c9b473e-9ec4-4c34-a9f9-6412ae740011 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 01:51:57.384471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:57.384471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:51:57.384471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:51:57.384471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:51:57.384471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:51:57.384471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:51:57.384471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:51:57.384471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 01:51:57.384471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:57.384471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:51:57.384471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:57.384471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:57.384471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:57.384471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:57.384471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:57.385614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:57.385614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:57.385614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:57.385614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:57.385614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:57.385614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:57.385614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:57.385614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:51:57.385614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:51:57.385614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:51:57.385614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:51:57.385614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:57.385614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:57.385614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:57.385614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:57.385614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:57.386472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:57.386472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:57.386472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:57.386472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:57.386472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:57.386472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:57.386472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:57.386472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:57.386472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:57.386472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:57.386472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:57.386472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:51:57.386472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:51:57.386472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 01:51:57.386472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:57.386472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 400/799] 10.222.0.13 () {56 vars in 1129 bytes} [Thu Jun 23 01:51:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:57.387380 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9ab6b-6f94-4081-a01b-c15bb8572ef3 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:57.387658 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9ab6b-6f94-4081-a01b-c15bb8572ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:57.387852 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9ab6b-6f94-4081-a01b-c15bb8572ef3 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:57.393216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 401/800] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:57.393216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9ab6b-6f94-4081-a01b-c15bb8572ef3 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:57.406636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:57.413781 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d20cee-5337-4eb5-a315-58461bc9fa2c None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:57.447892 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05011df4-95ed-4fd1-a2b2-68da51161cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:57.448562 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05011df4-95ed-4fd1-a2b2-68da51161cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:57.448930 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05011df4-95ed-4fd1-a2b2-68da51161cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:57.449114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05011df4-95ed-4fd1-a2b2-68da51161cc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:57.449838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05011df4-95ed-4fd1-a2b2-68da51161cc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:57.450142 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05011df4-95ed-4fd1-a2b2-68da51161cc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:57.451533 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05011df4-95ed-4fd1-a2b2-68da51161cc0 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:57.464643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 400/801] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:57.465434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05011df4-95ed-4fd1-a2b2-68da51161cc0 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:57.514967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9ab6b-6f94-4081-a01b-c15bb8572ef3 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:57.551433 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d372c02-c1de-4afb-b564-b17587d9fbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:57.552276 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d372c02-c1de-4afb-b564-b17587d9fbff None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:57.552553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d372c02-c1de-4afb-b564-b17587d9fbff None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:57.553014 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d372c02-c1de-4afb-b564-b17587d9fbff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:57.555869 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:57.562050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d372c02-c1de-4afb-b564-b17587d9fbff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:57.563800 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d372c02-c1de-4afb-b564-b17587d9fbff None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:57.578096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-9d372c02-c1de-4afb-b564-b17587d9fbff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:57.578096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:57.578096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:57.578096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:57.578096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:57.578096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:57.578096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:57.578096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:57.578096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:57.578096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:57.578096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:57.578096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:57.578096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:51:57.578096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:51:57.578096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:51:57.579015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:51:57.579015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:57.579015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:57.579015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:57.579015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:57.579015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:57.579015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:57.579015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:57.579015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:57.579015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:57.579015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:57.579015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:57.579015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:57.579015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:57.579015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:57.579015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:57.579015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:57.585582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:51:57.585582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:51:57.585582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:51:57.585582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:51:57.585582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:51:57.585582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:51:57.585582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:57.585582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:57.586026 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05011df4-95ed-4fd1-a2b2-68da51161cc0 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:57.586102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 402/802] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:57.586102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d1fcf-a326-4103-bfc6-335eaf95c8ca None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:57.586102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d1fcf-a326-4103-bfc6-335eaf95c8ca None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:57.586102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d1fcf-a326-4103-bfc6-335eaf95c8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:57.598961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-b27d1fcf-a326-4103-bfc6-335eaf95c8ca None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:57.600214 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-b27d1fcf-a326-4103-bfc6-335eaf95c8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:57.624321 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41aded-1406-4474-86e8-f04331dfca29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:57.624991 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41aded-1406-4474-86e8-f04331dfca29 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:57.625272 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41aded-1406-4474-86e8-f04331dfca29 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:57.625535 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41aded-1406-4474-86e8-f04331dfca29 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:57.626236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41aded-1406-4474-86e8-f04331dfca29 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:57.626540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41aded-1406-4474-86e8-f04331dfca29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:57.627997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41aded-1406-4474-86e8-f04331dfca29 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:57.632789 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 401/803] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Jun 23 01:51:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:57.636610 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41aded-1406-4474-86e8-f04331dfca29 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:57.657929 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:57.683433 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 403/804] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:51:57.683433 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d1fcf-a326-4103-bfc6-335eaf95c8ca None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:57.746220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41aded-1406-4474-86e8-f04331dfca29 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:57.781926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefbfae-8b48-4d59-b83f-9cf5238ee5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:57.782792 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefbfae-8b48-4d59-b83f-9cf5238ee5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:57.783017 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefbfae-8b48-4d59-b83f-9cf5238ee5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:57.783287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefbfae-8b48-4d59-b83f-9cf5238ee5d4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:57.786810 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d1fcf-a326-4103-bfc6-335eaf95c8ca None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:57.790789 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefbfae-8b48-4d59-b83f-9cf5238ee5d4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:57.792266 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefbfae-8b48-4d59-b83f-9cf5238ee5d4 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:57.808353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-6eefbfae-8b48-4d59-b83f-9cf5238ee5d4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 01:51:57.808353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:57.808353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:57.808353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:57.808353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:57.808353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:57.808353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:57.808353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:57.808353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:57.808353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:57.808353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:57.808353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:57.808353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:51:57.808353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:51:57.808353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:51:57.808353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:51:57.809702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:57.809702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:57.809702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:51:57.809702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:57.809702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:51:57.809702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:57.809702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:57.809702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:57.809702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:57.809702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:57.809702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:57.809702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:57.809702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:57.809702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:57.809702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:57.809702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:57.809702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:57.809702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:57.811329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:57.811329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:57.811329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:51:57.811329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:51:57.811329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:51:57.811329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:51:57.811329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:51:57.811329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:51:57.811329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 01:51:57.811329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:57.811329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 402/805] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 23 01:51:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:57.811329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefbfae-8b48-4d59-b83f-9cf5238ee5d4 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:57.815498 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:57.824440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f19ca-b057-4dc3-ad91-9b485e9d73ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:57.825048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f19ca-b057-4dc3-ad91-9b485e9d73ef None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:57.825320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f19ca-b057-4dc3-ad91-9b485e9d73ef None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:57.825597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f19ca-b057-4dc3-ad91-9b485e9d73ef None admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:57.826388 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f19ca-b057-4dc3-ad91-9b485e9d73ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:57.826693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f19ca-b057-4dc3-ad91-9b485e9d73ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:57.828171 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f19ca-b057-4dc3-ad91-9b485e9d73ef None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:57.839734 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 404/806] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:51:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:57.840504 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f19ca-b057-4dc3-ad91-9b485e9d73ef None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:57.891985 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:57.914543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefbfae-8b48-4d59-b83f-9cf5238ee5d4 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:57.939382 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f19ca-b057-4dc3-ad91-9b485e9d73ef None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:57.949758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807956fe-d349-4311-8b63-acb64fcfe3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:57.950426 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807956fe-d349-4311-8b63-acb64fcfe3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:57.950704 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807956fe-d349-4311-8b63-acb64fcfe3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:57.950973 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807956fe-d349-4311-8b63-acb64fcfe3f6 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:57.951709 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807956fe-d349-4311-8b63-acb64fcfe3f6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:57.952047 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807956fe-d349-4311-8b63-acb64fcfe3f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:57.953440 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807956fe-d349-4311-8b63-acb64fcfe3f6 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:57.958566 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 403/807] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Jun 23 01:51:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:57.959787 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4970d18-cec5-4732-a1ba-e8dffb35bda4 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:57.960097 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4970d18-cec5-4732-a1ba-e8dffb35bda4 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:57.960366 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4970d18-cec5-4732-a1ba-e8dffb35bda4 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:57.964893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 404/808] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:51:57.964893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4970d18-cec5-4732-a1ba-e8dffb35bda4 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:57.978926 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665a7a6-eee4-4fd4-b03f-9417429fb114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:57.979885 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665a7a6-eee4-4fd4-b03f-9417429fb114 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:57.980177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665a7a6-eee4-4fd4-b03f-9417429fb114 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:57.980509 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665a7a6-eee4-4fd4-b03f-9417429fb114 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:57.991815 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665a7a6-eee4-4fd4-b03f-9417429fb114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:51:57.999575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-7665a7a6-eee4-4fd4-b03f-9417429fb114 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:51:57.999575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:57.999575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:57.999575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:57.999575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:57.999575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:57.999575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:57.999575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:57.999575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:57.999575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:57.999575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:57.999575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:57.999575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:51:57.999575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:51:57.999575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:51:57.999575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:51:58.000685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:51:58.000685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:51:58.000685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:51:58.000685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:51:58.000685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:58.000685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:58.000685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:58.000685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:58.000685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:58.000685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:58.000685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:58.000685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:58.000685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:58.000685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:58.000685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:58.000685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:58.001697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:58.001697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:58.001697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:58.001697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:58.001697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:51:58.001697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:51:58.001697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:51:58.001697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:51:58.001697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:51:58.001697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:51:58.001697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:51:58.001697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:58.001697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 405/809] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:51:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:58.001697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665a7a6-eee4-4fd4-b03f-9417429fb114 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:58.048007 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:58.073567 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4970d18-cec5-4732-a1ba-e8dffb35bda4 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:58.100600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665a7a6-eee4-4fd4-b03f-9417429fb114 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:58.108772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a4a04-e606-4556-b55b-1822d1cfac3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:58.109498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a4a04-e606-4556-b55b-1822d1cfac3f None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:58.109779 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a4a04-e606-4556-b55b-1822d1cfac3f None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:58.110052 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a4a04-e606-4556-b55b-1822d1cfac3f None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:58.110884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a4a04-e606-4556-b55b-1822d1cfac3f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:58.111198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a4a04-e606-4556-b55b-1822d1cfac3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:58.112753 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a4a04-e606-4556-b55b-1822d1cfac3f None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:58.126332 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:58.130290 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 405/810] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Jun 23 01:51:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:58.131137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a4a04-e606-4556-b55b-1822d1cfac3f None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:58.137698 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd89f30-d8ec-4062-8271-5c9eaa38beda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:58.138351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd89f30-d8ec-4062-8271-5c9eaa38beda None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:58.138634 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd89f30-d8ec-4062-8271-5c9eaa38beda None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:58.138902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd89f30-d8ec-4062-8271-5c9eaa38beda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:58.139764 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd89f30-d8ec-4062-8271-5c9eaa38beda None admin] RBAC: Adding query filter params (role.id=58e04437159e4eb39aa4a43c213ea34c, scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018, user.id=9d3b5180fb7144c394c39d4db28713b9) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:58.140068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd89f30-d8ec-4062-8271-5c9eaa38beda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:58.141498 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd89f30-d8ec-4062-8271-5c9eaa38beda None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:58.159647 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 406/811] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:51:58 2022] GET /identity/v3/role_assignments?user.id=9d3b5180fb7144c394c39d4db28713b9&scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018&role.id=58e04437159e4eb39aa4a43c213ea34c => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:58.159647 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d0fea-9791-4fa1-b125-671cae1503ab None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:58.159647 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d0fea-9791-4fa1-b125-671cae1503ab None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:58.159647 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d0fea-9791-4fa1-b125-671cae1503ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:58.173536 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-fb4d0fea-9791-4fa1-b125-671cae1503ab None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:51:58.174932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-fb4d0fea-9791-4fa1-b125-671cae1503ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:51:58.250999 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a4a04-e606-4556-b55b-1822d1cfac3f None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:58.251398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 407/812] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:51:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:51:58.252288 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d0fea-9791-4fa1-b125-671cae1503ab None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:58.288531 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c8a40-603b-487c-958a-f96bbd4a7bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:58.289222 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c8a40-603b-487c-958a-f96bbd4a7bf5 None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:58.289501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c8a40-603b-487c-958a-f96bbd4a7bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:58.289773 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c8a40-603b-487c-958a-f96bbd4a7bf5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:58.290522 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c8a40-603b-487c-958a-f96bbd4a7bf5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:58.291955 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c8a40-603b-487c-958a-f96bbd4a7bf5 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:58.305051 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:58.319026 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 406/813] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 23 01:51:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:51:58.320015 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c8a40-603b-487c-958a-f96bbd4a7bf5 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:58.389350 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d0fea-9791-4fa1-b125-671cae1503ab None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:58.396979 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:58.453919 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db89a2e-67ae-42a2-937a-fb62bf09b197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:58.454629 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db89a2e-67ae-42a2-937a-fb62bf09b197 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:58.455445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db89a2e-67ae-42a2-937a-fb62bf09b197 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:58.455802 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db89a2e-67ae-42a2-937a-fb62bf09b197 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:58.456999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db89a2e-67ae-42a2-937a-fb62bf09b197 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:58.457566 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db89a2e-67ae-42a2-937a-fb62bf09b197 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:58.459260 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db89a2e-67ae-42a2-937a-fb62bf09b197 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:58.459585 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c8a40-603b-487c-958a-f96bbd4a7bf5 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:58.471476 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 408/814] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:51:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:58.475547 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db89a2e-67ae-42a2-937a-fb62bf09b197 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:58.503433 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef815d-fad7-4e5a-8970-c2c099201d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:58.504256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef815d-fad7-4e5a-8970-c2c099201d4f None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:58.504534 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef815d-fad7-4e5a-8970-c2c099201d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:58.504808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef815d-fad7-4e5a-8970-c2c099201d4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:58.516270 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef815d-fad7-4e5a-8970-c2c099201d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:58.517730 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef815d-fad7-4e5a-8970-c2c099201d4f None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:58.537594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-c1ef815d-fad7-4e5a-8970-c2c099201d4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:58.537594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:58.537594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:58.537594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:58.537594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:58.537594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:58.537594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:58.537594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:58.537594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:58.537594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:58.537594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:58.537594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:58.537594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:58.537594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:58.537594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:58.538614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:58.538614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:58.538614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:58.538614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:58.538614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:58.538614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:58.538614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:58.538614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:58.538614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:58.538614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:58.538614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:58.538614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:58.538614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:58.538614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:58.538614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:58.538614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:58.538614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:58.539551 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:58.539551 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:58.539551 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:58.539551 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:58.539551 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 407/815] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:58.539843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef815d-fad7-4e5a-8970-c2c099201d4f None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:58.579843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:58.583403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db89a2e-67ae-42a2-937a-fb62bf09b197 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:58.618584 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e900a-269a-4767-944f-73ec5e605b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:58.619435 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e900a-269a-4767-944f-73ec5e605b3e None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:58.619740 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e900a-269a-4767-944f-73ec5e605b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:58.620018 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e900a-269a-4767-944f-73ec5e605b3e None admin] PATH_INFO: `/v3/services/network` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:58.620681 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e900a-269a-4767-944f-73ec5e605b3e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:58.622054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e900a-269a-4767-944f-73ec5e605b3e None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:58.634357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-324e900a-269a-4767-944f-73ec5e605b3e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 01:51:58.634357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:58.634357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:51:58.634357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:51:58.634357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:51:58.634357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:51:58.634357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:51:58.634357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:51:58.634357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 01:51:58.634357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:58.634357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:51:58.634357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:58.634357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:58.634357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:58.634357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:58.634357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:58.634357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:58.636753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:58.636753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:58.636753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:58.636753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:58.636753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:58.636753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:58.636753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:51:58.636753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:51:58.636753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:51:58.636753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:51:58.636753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:58.636753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:58.636753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:58.636753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:58.636753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:58.636753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:58.638732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:58.638732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:58.638732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:58.638732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:58.638732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:58.638732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:58.638732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:58.638732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:58.638732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:58.638732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:58.638732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:51:58.638732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:51:58.638732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 01:51:58.638732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:58.638732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 409/816] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:58 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:58.640641 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e900a-269a-4767-944f-73ec5e605b3e None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:58.654213 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef815d-fad7-4e5a-8970-c2c099201d4f None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:58.663783 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:58.689760 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b42c0-00a0-4571-8652-752abd450cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:58.690809 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b42c0-00a0-4571-8652-752abd450cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:58.691106 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b42c0-00a0-4571-8652-752abd450cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:58.691383 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b42c0-00a0-4571-8652-752abd450cc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:58.702428 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b42c0-00a0-4571-8652-752abd450cc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:58.703998 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b42c0-00a0-4571-8652-752abd450cc7 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:58.723636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-0b6b42c0-00a0-4571-8652-752abd450cc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:58.723636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:58.723636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:58.723636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:58.723636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:58.723636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:58.723636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:58.723636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:58.723636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:58.723636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:58.723636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:58.723636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:58.723636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:58.723636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:58.723636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:58.724621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:58.724621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:58.724621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:58.724621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:58.724621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:58.724621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:58.724621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:58.724621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:58.724621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:58.724621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:58.724621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:58.724621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:58.724621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:58.724621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:58.724621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:58.724621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:58.724621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:58.725517 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:58.725517 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:58.725517 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:58.725517 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:58.725517 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 408/817] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:58.726254 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b42c0-00a0-4571-8652-752abd450cc7 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:58.739849 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e900a-269a-4767-944f-73ec5e605b3e None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:58.775159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6ae75-3a67-428d-a93a-286c9350404d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:58.776119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6ae75-3a67-428d-a93a-286c9350404d None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:58.776445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6ae75-3a67-428d-a93a-286c9350404d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:58.776722 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6ae75-3a67-428d-a93a-286c9350404d None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:58.777612 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6ae75-3a67-428d-a93a-286c9350404d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:58.778202 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6ae75-3a67-428d-a93a-286c9350404d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:58.779680 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6ae75-3a67-428d-a93a-286c9350404d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:58.799173 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 410/818] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:58.800139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6ae75-3a67-428d-a93a-286c9350404d None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:58.842347 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b42c0-00a0-4571-8652-752abd450cc7 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:58.866699 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:58.885946 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11be681-62fb-4d4b-8d31-b6660eac3578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:58.886623 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11be681-62fb-4d4b-8d31-b6660eac3578 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:58.886904 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11be681-62fb-4d4b-8d31-b6660eac3578 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:58.887178 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11be681-62fb-4d4b-8d31-b6660eac3578 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:58.887918 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11be681-62fb-4d4b-8d31-b6660eac3578 None admin] RBAC: Adding query filter params (name=network) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:58.888220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11be681-62fb-4d4b-8d31-b6660eac3578 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:58.889609 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11be681-62fb-4d4b-8d31-b6660eac3578 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:58.899051 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 409/819] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 01:51:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:58.900108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11be681-62fb-4d4b-8d31-b6660eac3578 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:58.935158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:58.940471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6ae75-3a67-428d-a93a-286c9350404d None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:58.988232 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbfa12-649e-4953-977e-bab3ce111209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:58.988910 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbfa12-649e-4953-977e-bab3ce111209 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:58.989187 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbfa12-649e-4953-977e-bab3ce111209 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:58.989459 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbfa12-649e-4953-977e-bab3ce111209 None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:58.990217 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbfa12-649e-4953-977e-bab3ce111209 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:58.990525 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbfa12-649e-4953-977e-bab3ce111209 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:58.991939 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbfa12-649e-4953-977e-bab3ce111209 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:59.004164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 411/820] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:59.005101 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbfa12-649e-4953-977e-bab3ce111209 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:59.025725 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11be681-62fb-4d4b-8d31-b6660eac3578 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:59.073090 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225c13a-c317-4cf8-b603-31c6d0c20535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:59.074786 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225c13a-c317-4cf8-b603-31c6d0c20535 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:59.075506 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225c13a-c317-4cf8-b603-31c6d0c20535 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:59.075993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225c13a-c317-4cf8-b603-31c6d0c20535 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:59.085585 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225c13a-c317-4cf8-b603-31c6d0c20535 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:59.087984 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225c13a-c317-4cf8-b603-31c6d0c20535 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:59.090457 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:59.110056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-d225c13a-c317-4cf8-b603-31c6d0c20535 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:59.110056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:59.110056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:59.110056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:59.110056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:59.110056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:59.110056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:59.110056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:59.110056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:59.110056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:59.110056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:59.110056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:59.110056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:51:59.110056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:51:59.110056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:51:59.111010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:51:59.111010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:59.111010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:59.111010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:59.111010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:59.111010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:59.111010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:59.111010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:59.111010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:59.111010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:59.111010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:59.111010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:59.111010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:59.111010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:59.111010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:59.111010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:59.111010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:59.111923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:51:59.111923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:51:59.111923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:51:59.111923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:51:59.111923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:51:59.111923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:51:59.111923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:51:59.111923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:59.112404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbfa12-649e-4953-977e-bab3ce111209 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:59.115317 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 410/821] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:51:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:59.116293 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225c13a-c317-4cf8-b603-31c6d0c20535 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:59.155934 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b10b2-8760-4fa7-8a5b-7ec056b4ec71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:59.156610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b10b2-8760-4fa7-8a5b-7ec056b4ec71 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:59.156887 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b10b2-8760-4fa7-8a5b-7ec056b4ec71 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:59.157157 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b10b2-8760-4fa7-8a5b-7ec056b4ec71 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:59.157880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b10b2-8760-4fa7-8a5b-7ec056b4ec71 None admin] RBAC: Adding query filter params (type=network) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:59.158172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b10b2-8760-4fa7-8a5b-7ec056b4ec71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:59.159612 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b10b2-8760-4fa7-8a5b-7ec056b4ec71 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:59.169520 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 412/822] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 01:51:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:59.170356 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b10b2-8760-4fa7-8a5b-7ec056b4ec71 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:59.233308 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:59.254705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225c13a-c317-4cf8-b603-31c6d0c20535 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:59.287025 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b10b2-8760-4fa7-8a5b-7ec056b4ec71 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:59.290837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9c6d9-f5d5-49fb-a452-d28861e5aa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:59.291575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9c6d9-f5d5-49fb-a452-d28861e5aa54 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:59.291920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9c6d9-f5d5-49fb-a452-d28861e5aa54 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:59.292256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9c6d9-f5d5-49fb-a452-d28861e5aa54 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:59.300207 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9c6d9-f5d5-49fb-a452-d28861e5aa54 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:59.301746 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9c6d9-f5d5-49fb-a452-d28861e5aa54 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:59.317312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-dce9c6d9-f5d5-49fb-a452-d28861e5aa54 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 01:51:59.317312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:59.317312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:59.317312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:59.317312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:59.317312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:59.317312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:59.317312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:59.317312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:59.317312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:59.317312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:59.317312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:59.317312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:51:59.317312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:51:59.317312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:51:59.317312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:51:59.318310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:59.318310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:59.318310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:51:59.318310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:59.318310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:51:59.318310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:51:59.318310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:59.318310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:59.318310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:59.318310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:59.318310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:59.318310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:59.318310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:59.318310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:59.318310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:59.318310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:59.318310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:59.318310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:59.319256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:59.319256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:59.319256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:51:59.319256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:51:59.319256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:51:59.319256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:51:59.319256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:51:59.319256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:51:59.319256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 01:51:59.319256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:51:59.319256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 411/823] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:51:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:59.319871 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9c6d9-f5d5-49fb-a452-d28861e5aa54 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:59.332804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ad2bb-83ba-4edd-bd09-0af317481391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:59.334079 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ad2bb-83ba-4edd-bd09-0af317481391 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:59.334748 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ad2bb-83ba-4edd-bd09-0af317481391 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:59.335201 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ad2bb-83ba-4edd-bd09-0af317481391 None admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:59.336433 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ad2bb-83ba-4edd-bd09-0af317481391 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:59.336893 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ad2bb-83ba-4edd-bd09-0af317481391 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:59.339205 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ad2bb-83ba-4edd-bd09-0af317481391 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:59.356734 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 413/824] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:51:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:59.357880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ad2bb-83ba-4edd-bd09-0af317481391 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:59.369232 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:59.436060 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9c6d9-f5d5-49fb-a452-d28861e5aa54 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:59.473839 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a6fe8-b40d-488e-b7dd-833512a148b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:59.474502 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a6fe8-b40d-488e-b7dd-833512a148b0 None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:59.474780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a6fe8-b40d-488e-b7dd-833512a148b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:59.475048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a6fe8-b40d-488e-b7dd-833512a148b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:59.475836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a6fe8-b40d-488e-b7dd-833512a148b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:59.477219 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a6fe8-b40d-488e-b7dd-833512a148b0 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:59.492360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ad2bb-83ba-4edd-bd09-0af317481391 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:59.495751 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:59.499306 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 412/825] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 23 01:51:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:51:59.500323 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a6fe8-b40d-488e-b7dd-833512a148b0 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:59.543071 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781bc36-c600-4dad-94dc-ce84fc3b2095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:59.544361 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781bc36-c600-4dad-94dc-ce84fc3b2095 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:59.544900 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781bc36-c600-4dad-94dc-ce84fc3b2095 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:59.545403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781bc36-c600-4dad-94dc-ce84fc3b2095 None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:59.546539 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781bc36-c600-4dad-94dc-ce84fc3b2095 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:51:59.547062 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781bc36-c600-4dad-94dc-ce84fc3b2095 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:59.549054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781bc36-c600-4dad-94dc-ce84fc3b2095 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:59.571342 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 414/826] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Jun 23 01:51:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:51:59.583604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781bc36-c600-4dad-94dc-ce84fc3b2095 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:59.630942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a6fe8-b40d-488e-b7dd-833512a148b0 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:59.670506 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494bf68-6458-48ff-b20d-88b00fff3c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:59.671431 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494bf68-6458-48ff-b20d-88b00fff3c14 None admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:59.671877 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494bf68-6458-48ff-b20d-88b00fff3c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:59.672153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494bf68-6458-48ff-b20d-88b00fff3c14 None admin] PATH_INFO: `/v3/projects/3f3b06be1b5a4b3a8235ebf22da2a018/users/0dbf596d8f964d4695944a23dd8e4cef/roles/c8b68b76c1b44e549cc7520e5546d374` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:59.690545 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494bf68-6458-48ff-b20d-88b00fff3c14 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f3b06be1b5a4b3a8235ebf22da2a018, user_id=0dbf596d8f964d4695944a23dd8e4cef, role_id=c8b68b76c1b44e549cc7520e5546d374)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:59.692172 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494bf68-6458-48ff-b20d-88b00fff3c14 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:59.723166 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 413/827] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:51:59 2022] PUT /identity/v3/projects/3f3b06be1b5a4b3a8235ebf22da2a018/users/0dbf596d8f964d4695944a23dd8e4cef/roles/c8b68b76c1b44e549cc7520e5546d374 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:51:59.743842 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:51:59.790299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781bc36-c600-4dad-94dc-ce84fc3b2095 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:51:59.830539 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031efeea-478d-40dd-aa8c-7a4e6bedd9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:51:59.831874 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031efeea-478d-40dd-aa8c-7a4e6bedd9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:51:59.832389 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031efeea-478d-40dd-aa8c-7a4e6bedd9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:51:59.832873 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031efeea-478d-40dd-aa8c-7a4e6bedd9f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:51:59.844635 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031efeea-478d-40dd-aa8c-7a4e6bedd9f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:51:59.846629 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031efeea-478d-40dd-aa8c-7a4e6bedd9f4 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:51:59.867953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-031efeea-478d-40dd-aa8c-7a4e6bedd9f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:59.867953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:51:59.867953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:51:59.867953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:51:59.867953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:51:59.867953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:51:59.867953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:51:59.867953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:51:59.867953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:51:59.867953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:51:59.867953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:51:59.867953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:51:59.867953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:51:59.867953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:51:59.867953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:51:59.868965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:51:59.868965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:51:59.868965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:51:59.868965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:51:59.868965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:51:59.868965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:51:59.868965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:51:59.868965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:51:59.868965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:51:59.868965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:51:59.868965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:51:59.868965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:51:59.868965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:51:59.868965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:51:59.868965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:51:59.868965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:51:59.868965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:51:59.869839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:51:59.869839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:51:59.869839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:51:59.869839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:51:59.872310 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 415/828] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:51:59.878099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494bf68-6458-48ff-b20d-88b00fff3c14 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:51:59.954957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:00.015864 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494bf68-6458-48ff-b20d-88b00fff3c14 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:00.056736 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c07cf-b41a-40c8-bacd-d42d23403f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:00.057405 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c07cf-b41a-40c8-bacd-d42d23403f40 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:00.057729 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c07cf-b41a-40c8-bacd-d42d23403f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:00.058007 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c07cf-b41a-40c8-bacd-d42d23403f40 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:00.058726 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c07cf-b41a-40c8-bacd-d42d23403f40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:00.059030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c07cf-b41a-40c8-bacd-d42d23403f40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:00.060821 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c07cf-b41a-40c8-bacd-d42d23403f40 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:00.073398 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 414/829] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:00.078578 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031efeea-478d-40dd-aa8c-7a4e6bedd9f4 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:00.180280 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031efeea-478d-40dd-aa8c-7a4e6bedd9f4 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:00.195154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:00.216180 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1b209-3d81-488f-81a6-ebfb3a0cce94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:00.216993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1b209-3d81-488f-81a6-ebfb3a0cce94 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:00.217276 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1b209-3d81-488f-81a6-ebfb3a0cce94 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:00.217551 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1b209-3d81-488f-81a6-ebfb3a0cce94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:00.224597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1b209-3d81-488f-81a6-ebfb3a0cce94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:00.226049 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1b209-3d81-488f-81a6-ebfb3a0cce94 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:00.240177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-e9f1b209-3d81-488f-81a6-ebfb3a0cce94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:52:00.240177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:00.240177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:00.240177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:00.240177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:00.240177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:00.240177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:00.240177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:00.240177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:00.240177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:00.240177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:00.240177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:00.240177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:52:00.240177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:52:00.240177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:52:00.241176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:52:00.241176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:00.241176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:00.241176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:00.241176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:00.241176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:00.241176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:00.241176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:00.241176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:00.241176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:00.241176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:00.241176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:00.241176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:00.241176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:00.241176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:00.241176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:00.241176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:00.242083 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:52:00.242083 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:52:00.242083 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:52:00.242083 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:52:00.242083 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:52:00.242083 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:52:00.242083 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:52:00.242083 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:00.242083 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 416/830] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:52:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:00.248520 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c07cf-b41a-40c8-bacd-d42d23403f40 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:00.332036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13ce7f-0920-4fd9-8a59-cc9e18ebd672 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:00.332333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13ce7f-0920-4fd9-8a59-cc9e18ebd672 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:00.332606 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13ce7f-0920-4fd9-8a59-cc9e18ebd672 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:00.334254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 417/831] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:52:00.339507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf62224-b0ed-4cf3-88fc-23b4eb1563b4 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:00.339800 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf62224-b0ed-4cf3-88fc-23b4eb1563b4 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:00.340083 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf62224-b0ed-4cf3-88fc-23b4eb1563b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:00.353978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c07cf-b41a-40c8-bacd-d42d23403f40 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:00.360589 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-abf62224-b0ed-4cf3-88fc-23b4eb1563b4 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:00.361870 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-abf62224-b0ed-4cf3-88fc-23b4eb1563b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:00.367910 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:00.396004 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20f717-640c-41e4-abb2-c1687f21dfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:00.397005 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20f717-640c-41e4-abb2-c1687f21dfb2 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:00.397557 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20f717-640c-41e4-abb2-c1687f21dfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:00.397839 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20f717-640c-41e4-abb2-c1687f21dfb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:00.398637 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20f717-640c-41e4-abb2-c1687f21dfb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:00.400175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20f717-640c-41e4-abb2-c1687f21dfb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:00.403328 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20f717-640c-41e4-abb2-c1687f21dfb2 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:00.422246 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 415/832] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:52:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:00.427875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20f717-640c-41e4-abb2-c1687f21dfb2 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:00.451641 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 418/833] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:00.474233 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf62224-b0ed-4cf3-88fc-23b4eb1563b4 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:00.547269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20f717-640c-41e4-abb2-c1687f21dfb2 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:00.580618 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf62224-b0ed-4cf3-88fc-23b4eb1563b4 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:00.582420 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:00.586073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170364c-110d-412d-9264-68c3d377b8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:00.587106 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170364c-110d-412d-9264-68c3d377b8ca None admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:00.587394 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170364c-110d-412d-9264-68c3d377b8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:00.587704 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170364c-110d-412d-9264-68c3d377b8ca None admin] PATH_INFO: `/v3/projects/3f3b06be1b5a4b3a8235ebf22da2a018/users/1ae132c4d0b5461aa26ab929a017cb08/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:00.589742 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170364c-110d-412d-9264-68c3d377b8ca None admin] RBAC: Authorizing `identity:create_grant(project_id=3f3b06be1b5a4b3a8235ebf22da2a018, user_id=1ae132c4d0b5461aa26ab929a017cb08, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:00.591210 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170364c-110d-412d-9264-68c3d377b8ca None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:00.606379 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 416/834] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:52:00 2022] PUT /identity/v3/projects/3f3b06be1b5a4b3a8235ebf22da2a018/users/1ae132c4d0b5461aa26ab929a017cb08/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:52:00.607816 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc46dc9-35ea-4bf1-be71-8157bbaf9093 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:00.608127 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc46dc9-35ea-4bf1-be71-8157bbaf9093 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:00.608403 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc46dc9-35ea-4bf1-be71-8157bbaf9093 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:00.614357 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 417/835] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:00.616119 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0414c2-0508-4d41-a834-2d4637843d4e None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:00.616574 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0414c2-0508-4d41-a834-2d4637843d4e None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:00.616882 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0414c2-0508-4d41-a834-2d4637843d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:00.636335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-cd0414c2-0508-4d41-a834-2d4637843d4e None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:00.637409 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe5f67-83fa-45f1-97b2-d879c8c5a748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:00.637650 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-cd0414c2-0508-4d41-a834-2d4637843d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:00.638735 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe5f67-83fa-45f1-97b2-d879c8c5a748 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:00.639265 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe5f67-83fa-45f1-97b2-d879c8c5a748 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:00.640091 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe5f67-83fa-45f1-97b2-d879c8c5a748 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:00.641940 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe5f67-83fa-45f1-97b2-d879c8c5a748 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:00.643848 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe5f67-83fa-45f1-97b2-d879c8c5a748 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:00.662886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-babe5f67-83fa-45f1-97b2-d879c8c5a748 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 01:52:00.662886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:00.662886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:52:00.662886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:52:00.662886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:52:00.662886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:52:00.662886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:52:00.662886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:00.662886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 01:52:00.662886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:00.662886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:52:00.662886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:00.662886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:00.662886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:00.662886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:00.662886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:00.664006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:00.664006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:00.664006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:00.664006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:00.664006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:00.664006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:00.664006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:00.664006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:52:00.664006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:52:00.664006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:52:00.664006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:52:00.664006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:00.664006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:00.664006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:00.664006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:00.664006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:00.664862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:00.664862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:00.664862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:00.664862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:00.664862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:00.664862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:00.664862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:00.664862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:00.664862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:00.664862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:00.664862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:00.664862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:52:00.664862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:00.664862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 01:52:00.664862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:00.667597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 419/836] 10.222.0.13 () {56 vars in 1132 bytes} [Thu Jun 23 01:52:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:52:00.671181 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe5f67-83fa-45f1-97b2-d879c8c5a748 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:00.703910 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:00.738703 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 418/837] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:00.757021 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0414c2-0508-4d41-a834-2d4637843d4e None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:00.802210 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe5f67-83fa-45f1-97b2-d879c8c5a748 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:00.840698 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccecb3-59c2-440f-8ffa-5439ebb15d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:00.841765 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccecb3-59c2-440f-8ffa-5439ebb15d39 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:00.842242 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccecb3-59c2-440f-8ffa-5439ebb15d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:00.842711 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccecb3-59c2-440f-8ffa-5439ebb15d39 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:00.843667 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdccecb3-59c2-440f-8ffa-5439ebb15d39 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:00.844186 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdccecb3-59c2-440f-8ffa-5439ebb15d39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:00.845760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdccecb3-59c2-440f-8ffa-5439ebb15d39 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:00.851118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 420/838] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 23 01:52:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:00.856311 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccecb3-59c2-440f-8ffa-5439ebb15d39 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:00.875326 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0414c2-0508-4d41-a834-2d4637843d4e None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:00.889354 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:00.921574 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02fffa-8e13-4e28-9718-5b16a2e09ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:00.923225 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02fffa-8e13-4e28-9718-5b16a2e09ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:00.923906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02fffa-8e13-4e28-9718-5b16a2e09ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:00.924327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02fffa-8e13-4e28-9718-5b16a2e09ea9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:00.925727 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02fffa-8e13-4e28-9718-5b16a2e09ea9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:00.927773 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02fffa-8e13-4e28-9718-5b16a2e09ea9 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:00.945002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-5b02fffa-8e13-4e28-9718-5b16a2e09ea9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 01:52:00.945002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:00.945002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:52:00.945002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:52:00.945002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:52:00.945002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:52:00.945002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:52:00.945002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:00.945002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 01:52:00.945002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:00.945002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:52:00.945002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:00.945002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:00.945002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:00.945002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:00.945002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:00.945002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:00.946041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:00.946041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:00.946041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:00.946041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:00.946041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:00.946041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:00.946041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:52:00.946041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:52:00.946041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:52:00.946041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:52:00.946041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:00.946041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:00.946041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:00.946041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:00.946041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:00.946041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:00.946865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:00.946865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:00.946865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:00.946865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:00.946865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:00.946865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:00.946865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:00.946865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:00.946865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:00.946865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:00.946865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:52:00.946865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:00.946865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 01:52:00.946865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:00.946865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 419/839] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 01:52:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:52:00.952094 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02fffa-8e13-4e28-9718-5b16a2e09ea9 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:00.977437 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccecb3-59c2-440f-8ffa-5439ebb15d39 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:00.979246 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:01.012636 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021da70c-943e-4665-bedb-dc88ad3ea653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:01.013476 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021da70c-943e-4665-bedb-dc88ad3ea653 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:01.013868 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021da70c-943e-4665-bedb-dc88ad3ea653 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:01.014222 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021da70c-943e-4665-bedb-dc88ad3ea653 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:01.015027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021da70c-943e-4665-bedb-dc88ad3ea653 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:01.015447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021da70c-943e-4665-bedb-dc88ad3ea653 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:01.017108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021da70c-943e-4665-bedb-dc88ad3ea653 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:01.022424 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 421/840] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 23 01:52:00 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:01.069925 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02fffa-8e13-4e28-9718-5b16a2e09ea9 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:01.110227 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d11b0-6eeb-4c90-a273-eb6c3df3eea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:01.111195 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d11b0-6eeb-4c90-a273-eb6c3df3eea7 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:01.111684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d11b0-6eeb-4c90-a273-eb6c3df3eea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:01.112230 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d11b0-6eeb-4c90-a273-eb6c3df3eea7 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:01.113254 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d11b0-6eeb-4c90-a273-eb6c3df3eea7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:01.113712 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d11b0-6eeb-4c90-a273-eb6c3df3eea7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:01.115395 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d11b0-6eeb-4c90-a273-eb6c3df3eea7 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:01.121472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 420/841] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 01:52:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:01.126760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021da70c-943e-4665-bedb-dc88ad3ea653 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:01.231811 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:01.239867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021da70c-943e-4665-bedb-dc88ad3ea653 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:01.273811 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5d29e-a7f9-432c-81b4-4db83a240a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:01.274476 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5d29e-a7f9-432c-81b4-4db83a240a6f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:01.274754 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5d29e-a7f9-432c-81b4-4db83a240a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:01.275024 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5d29e-a7f9-432c-81b4-4db83a240a6f None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:01.275761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5d29e-a7f9-432c-81b4-4db83a240a6f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:01.276067 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5d29e-a7f9-432c-81b4-4db83a240a6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:01.277443 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5d29e-a7f9-432c-81b4-4db83a240a6f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:01.282295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 422/842] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 01:52:01 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:01.964790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82542533-070a-4ecd-abde-b870dc01e1c5 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:01.965694 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82542533-070a-4ecd-abde-b870dc01e1c5 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:01.966144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82542533-070a-4ecd-abde-b870dc01e1c5 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:01.968064 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 421/843] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:01.973751 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76a11a-9968-46e4-b05f-fd5a64942d77 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:01.974271 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76a11a-9968-46e4-b05f-fd5a64942d77 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:01.974737 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76a11a-9968-46e4-b05f-fd5a64942d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:01.991926 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-db76a11a-9968-46e4-b05f-fd5a64942d77 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:01.993455 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-db76a11a-9968-46e4-b05f-fd5a64942d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:02.066230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 423/844] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:02.089323 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82542533-070a-4ecd-abde-b870dc01e1c5 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:02.184095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:02.199074 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82542533-070a-4ecd-abde-b870dc01e1c5 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:02.234276 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1431a-6cef-437b-9577-094bbe8dff2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:02.235510 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1431a-6cef-437b-9577-094bbe8dff2a None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:02.235987 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1431a-6cef-437b-9577-094bbe8dff2a None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:02.236451 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1431a-6cef-437b-9577-094bbe8dff2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:02.247534 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1431a-6cef-437b-9577-094bbe8dff2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:52:02.255627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-50a1431a-6cef-437b-9577-094bbe8dff2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:52:02.255627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:02.255627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:02.255627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:02.255627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:02.255627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:02.255627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:02.255627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:02.255627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:02.255627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:02.255627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:02.255627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:02.255627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:52:02.255627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:52:02.255627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:52:02.255627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:52:02.256552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:52:02.256552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:52:02.256552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:52:02.256552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:52:02.256552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:02.256552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:02.256552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:02.256552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:02.256552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:02.256552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:02.256552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:02.256552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:02.256552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:02.256552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:02.256552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:02.256552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:02.257393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:02.257393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:02.257393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:02.257393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:02.257393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:52:02.257393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:52:02.257393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:52:02.257393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:52:02.257393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:52:02.257393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:52:02.257393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:52:02.257393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:02.259800 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 422/845] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 01:52:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:02.265866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76a11a-9968-46e4-b05f-fd5a64942d77 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:02.355127 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:02.374617 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76a11a-9968-46e4-b05f-fd5a64942d77 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:02.410467 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1958633-7dc6-46fb-b546-2afed5161a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:02.411158 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1958633-7dc6-46fb-b546-2afed5161a99 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:02.411463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1958633-7dc6-46fb-b546-2afed5161a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:02.411746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1958633-7dc6-46fb-b546-2afed5161a99 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:02.412507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1958633-7dc6-46fb-b546-2afed5161a99 None admin] RBAC: Adding query filter params (name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:02.412816 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1958633-7dc6-46fb-b546-2afed5161a99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:02.414195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1958633-7dc6-46fb-b546-2afed5161a99 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:02.422887 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 424/846] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 01:52:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:02.428633 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1431a-6cef-437b-9577-094bbe8dff2a None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:02.533191 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1431a-6cef-437b-9577-094bbe8dff2a None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:02.568604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d19aa1-f470-4fcb-bd4f-34d2abb46289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:02.569759 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d19aa1-f470-4fcb-bd4f-34d2abb46289 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:02.570237 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d19aa1-f470-4fcb-bd4f-34d2abb46289 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:02.570722 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d19aa1-f470-4fcb-bd4f-34d2abb46289 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:02.582271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d19aa1-f470-4fcb-bd4f-34d2abb46289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:02.584043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d19aa1-f470-4fcb-bd4f-34d2abb46289 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:02.592407 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:02.603233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-b3d19aa1-f470-4fcb-bd4f-34d2abb46289 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:02.603233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:02.603233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:02.603233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:02.603233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:02.603233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:02.603233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:02.603233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:02.603233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:02.603233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:02.603233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:02.603233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:02.603233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:52:02.603233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:52:02.603233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:52:02.604177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:52:02.604177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:02.604177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:02.604177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:02.604177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:02.604177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:02.604177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:02.604177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:02.604177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:02.604177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:02.604177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:02.604177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:02.604177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:02.604177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:02.604177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:02.604177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:02.604177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:02.605092 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:52:02.605092 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:52:02.605092 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:02.605092 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:02.611755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 423/847] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:02.613974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1958633-7dc6-46fb-b546-2afed5161a99 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:02.711608 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778592cf-2e5d-4c9d-9d9a-999a803d4eb3 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:02.711952 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778592cf-2e5d-4c9d-9d9a-999a803d4eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:02.712155 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778592cf-2e5d-4c9d-9d9a-999a803d4eb3 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:02.713889 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 424/848] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:02.717174 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1958633-7dc6-46fb-b546-2afed5161a99 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:02.718856 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0058c9-5817-4c24-acac-9c9b92087a56 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:02.719144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0058c9-5817-4c24-acac-9c9b92087a56 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:02.719438 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0058c9-5817-4c24-acac-9c9b92087a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:02.737017 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-5e0058c9-5817-4c24-acac-9c9b92087a56 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:02.738262 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5e0058c9-5817-4c24-acac-9c9b92087a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:02.755555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3d04f-8974-485e-8d35-98b2209d1e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:02.756231 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3d04f-8974-485e-8d35-98b2209d1e42 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:02.756509 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3d04f-8974-485e-8d35-98b2209d1e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:02.756780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3d04f-8974-485e-8d35-98b2209d1e42 None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:02.757619 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3d04f-8974-485e-8d35-98b2209d1e42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:02.757926 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3d04f-8974-485e-8d35-98b2209d1e42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:02.759443 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3d04f-8974-485e-8d35-98b2209d1e42 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:02.772754 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 425/849] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:02.780433 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3d04f-8974-485e-8d35-98b2209d1e42 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:02.793216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:02.830578 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 425/850] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 01:52:02.853306 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0058c9-5817-4c24-acac-9c9b92087a56 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:02.892094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3d04f-8974-485e-8d35-98b2209d1e42 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:02.929723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaa6ff-f645-48e9-abda-1c8e3ecb217a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:02.930958 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaa6ff-f645-48e9-abda-1c8e3ecb217a None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:02.931473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaa6ff-f645-48e9-abda-1c8e3ecb217a None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:02.932019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaa6ff-f645-48e9-abda-1c8e3ecb217a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:02.940526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eaa6ff-f645-48e9-abda-1c8e3ecb217a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:02.942362 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eaa6ff-f645-48e9-abda-1c8e3ecb217a None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:02.958951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-37eaa6ff-f645-48e9-abda-1c8e3ecb217a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 01:52:02.958951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:02.958951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:02.958951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:02.958951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:02.958951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:02.958951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:02.958951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:02.958951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:02.958951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:02.958951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:02.958951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:02.958951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:52:02.958951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:52:02.958951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:52:02.958951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:52:02.959967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:02.959967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:02.959967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:52:02.959967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:52:02.959967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:52:02.959967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:52:02.959967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:02.959967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:02.959967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:02.959967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:02.959967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:02.959967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:02.959967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:02.959967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:02.959967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:02.959967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:02.959967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:02.959967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:02.960934 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:02.960934 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:02.960934 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:52:02.960934 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:52:02.960934 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:52:02.960934 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:52:02.960934 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:52:02.960934 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:52:02.960934 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 01:52:02.960934 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:02.962172 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0058c9-5817-4c24-acac-9c9b92087a56 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:02.963843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 426/851] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 23 01:52:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:02.969264 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaa6ff-f645-48e9-abda-1c8e3ecb217a None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:02.995348 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:02.999700 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09762b47-38aa-4fac-bf36-001982f5ed06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:03.001137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09762b47-38aa-4fac-bf36-001982f5ed06 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:03.001794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09762b47-38aa-4fac-bf36-001982f5ed06 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:03.002261 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09762b47-38aa-4fac-bf36-001982f5ed06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:03.017595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09762b47-38aa-4fac-bf36-001982f5ed06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:52:03.025563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-09762b47-38aa-4fac-bf36-001982f5ed06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:52:03.025563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:03.025563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:03.025563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:03.025563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:03.025563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:03.025563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:03.025563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:03.025563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:03.025563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:03.025563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:03.025563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:03.025563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:52:03.025563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:52:03.025563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:52:03.025563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:52:03.026497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:52:03.026497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:52:03.026497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:52:03.026497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:52:03.026497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:03.026497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:03.026497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:03.026497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:03.026497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:03.026497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:03.026497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:03.026497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:03.026497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:03.026497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:03.026497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:03.026497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:03.027444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:03.027444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:03.027444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:03.027444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:03.027444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:52:03.027444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:52:03.027444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:52:03.027444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:52:03.027444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:52:03.027444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:52:03.027444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:52:03.027444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:03.031649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 426/852] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:52:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:52:03.032608 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09762b47-38aa-4fac-bf36-001982f5ed06 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:03.062548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:03.096158 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaa6ff-f645-48e9-abda-1c8e3ecb217a None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:03.131441 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081daa7-676f-4b40-a4bb-f6f11e39e20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:03.132504 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081daa7-676f-4b40-a4bb-f6f11e39e20b None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:03.132980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081daa7-676f-4b40-a4bb-f6f11e39e20b None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:03.133471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081daa7-676f-4b40-a4bb-f6f11e39e20b None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:03.134500 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081daa7-676f-4b40-a4bb-f6f11e39e20b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:03.135010 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081daa7-676f-4b40-a4bb-f6f11e39e20b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:03.136680 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081daa7-676f-4b40-a4bb-f6f11e39e20b None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:03.136913 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09762b47-38aa-4fac-bf36-001982f5ed06 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:03.155847 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 427/853] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Jun 23 01:52:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:03.161788 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081daa7-676f-4b40-a4bb-f6f11e39e20b None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:03.173336 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fe6cb-f3e3-482a-bb41-0a1d98a20b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:03.174068 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fe6cb-f3e3-482a-bb41-0a1d98a20b90 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:03.174354 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fe6cb-f3e3-482a-bb41-0a1d98a20b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:03.174746 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fe6cb-f3e3-482a-bb41-0a1d98a20b90 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:03.175721 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fe6cb-f3e3-482a-bb41-0a1d98a20b90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:03.176067 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fe6cb-f3e3-482a-bb41-0a1d98a20b90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:03.177604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fe6cb-f3e3-482a-bb41-0a1d98a20b90 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:03.191768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 427/854] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:52:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:03.193476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fe6cb-f3e3-482a-bb41-0a1d98a20b90 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:03.246773 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:03.284005 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081daa7-676f-4b40-a4bb-f6f11e39e20b None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:03.303780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fe6cb-f3e3-482a-bb41-0a1d98a20b90 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:03.310943 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:03.320049 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38736c52-251b-4bab-bac1-79e20623a28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:03.320647 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38736c52-251b-4bab-bac1-79e20623a28d None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:03.320932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38736c52-251b-4bab-bac1-79e20623a28d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:03.321211 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38736c52-251b-4bab-bac1-79e20623a28d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:03.337276 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240b5a2-dfbd-4e74-8072-6606cc34baa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:03.338070 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240b5a2-dfbd-4e74-8072-6606cc34baa9 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:03.338347 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240b5a2-dfbd-4e74-8072-6606cc34baa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:03.338615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240b5a2-dfbd-4e74-8072-6606cc34baa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:03.392348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38736c52-251b-4bab-bac1-79e20623a28d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:03.393866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38736c52-251b-4bab-bac1-79e20623a28d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:03.465622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240b5a2-dfbd-4e74-8072-6606cc34baa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:03.467075 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240b5a2-dfbd-4e74-8072-6606cc34baa9 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:03.485374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-f240b5a2-dfbd-4e74-8072-6606cc34baa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:03.485374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:03.485374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:03.485374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:03.485374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:03.485374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:03.485374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:03.485374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:03.485374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:03.485374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:03.485374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:03.485374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:03.485374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:52:03.485374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:52:03.485374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:52:03.486352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:52:03.486352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:03.486352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:03.486352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:03.486352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:03.486352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:03.486352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:03.486352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:03.486352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:03.486352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:03.486352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:03.486352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:03.486352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:03.486352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:03.486352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:03.486352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:03.486352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:03.487438 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:52:03.487438 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:52:03.487438 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:03.487438 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:03.487438 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 428/855] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:52:03.487989 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b516a3-2e06-4c42-b5b3-63aad24cb2f7 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:03.488265 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b516a3-2e06-4c42-b5b3-63aad24cb2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:03.488540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b516a3-2e06-4c42-b5b3-63aad24cb2f7 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:03.490109 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 429/856] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:03.490925 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0fbcc-04d3-4488-a530-8ad54cb66e08 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:03.491204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0fbcc-04d3-4488-a530-8ad54cb66e08 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:03.491528 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0fbcc-04d3-4488-a530-8ad54cb66e08 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:03.493045 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 430/857] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:03.494339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0fbcc-04d3-4488-a530-8ad54cb66e08 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:03.508659 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 428/858] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:52:03 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 01:52:03.508659 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413662e-3ba6-43ea-b3a9-da3024ad5626 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:03.508659 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413662e-3ba6-43ea-b3a9-da3024ad5626 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:03.508659 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413662e-3ba6-43ea-b3a9-da3024ad5626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:03.522133 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-5413662e-3ba6-43ea-b3a9-da3024ad5626 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:03.523322 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-5413662e-3ba6-43ea-b3a9-da3024ad5626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:03.544815 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:03.589770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 429/859] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:03.591031 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5d225-94b9-4756-95b9-1ff0d99c098d None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:03.591318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5d225-94b9-4756-95b9-1ff0d99c098d None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:03.591626 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5d225-94b9-4756-95b9-1ff0d99c098d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:03.607432 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-d7b5d225-94b9-4756-95b9-1ff0d99c098d None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:03.608710 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-d7b5d225-94b9-4756-95b9-1ff0d99c098d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:03.615049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0fbcc-04d3-4488-a530-8ad54cb66e08 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:03.617508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:03.648516 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886eb0f-9b10-41a3-ae7f-23ec80aec4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:03.649172 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886eb0f-9b10-41a3-ae7f-23ec80aec4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:03.649451 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886eb0f-9b10-41a3-ae7f-23ec80aec4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:03.649722 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886eb0f-9b10-41a3-ae7f-23ec80aec4c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:03.650441 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886eb0f-9b10-41a3-ae7f-23ec80aec4c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:03.650744 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886eb0f-9b10-41a3-ae7f-23ec80aec4c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:03.652165 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886eb0f-9b10-41a3-ae7f-23ec80aec4c6 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:03.663457 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 431/860] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:03.664244 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886eb0f-9b10-41a3-ae7f-23ec80aec4c6 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:03.683037 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 430/861] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:03.683928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5d225-94b9-4756-95b9-1ff0d99c098d None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:03.771218 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:03.772476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886eb0f-9b10-41a3-ae7f-23ec80aec4c6 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:03.784495 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5d225-94b9-4756-95b9-1ff0d99c098d None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:03.805797 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff167cf-11a4-40eb-90a2-c705bf29b01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:03.806592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff167cf-11a4-40eb-90a2-c705bf29b01c None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:03.806869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff167cf-11a4-40eb-90a2-c705bf29b01c None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:03.807140 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff167cf-11a4-40eb-90a2-c705bf29b01c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:03.818185 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff167cf-11a4-40eb-90a2-c705bf29b01c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:03.819216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebc005-400d-4c40-b05d-659c3bf995d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:03.819675 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff167cf-11a4-40eb-90a2-c705bf29b01c None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:03.819922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebc005-400d-4c40-b05d-659c3bf995d6 None admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:03.820209 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebc005-400d-4c40-b05d-659c3bf995d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:03.820491 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebc005-400d-4c40-b05d-659c3bf995d6 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:03.821224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feebc005-400d-4c40-b05d-659c3bf995d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:03.822585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feebc005-400d-4c40-b05d-659c3bf995d6 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:03.836303 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 431/862] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 01:52:03 2022] POST /identity/v3/services => generated 269 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:52:03.837044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-0ff167cf-11a4-40eb-90a2-c705bf29b01c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:03.837044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:03.837044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:03.837044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:03.837044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:03.837044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:03.837044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:03.837044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:03.837044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:03.837044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:03.837044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:03.837044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:03.837044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:52:03.837044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:52:03.837044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:52:03.837980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:52:03.837980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:03.837980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:03.837980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:03.837980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:03.837980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:03.837980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:03.837980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:03.837980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:03.837980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:03.837980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:03.837980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:03.837980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:03.837980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:03.837980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:03.837980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:03.837980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:03.838872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:52:03.838872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:52:03.838872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:03.838872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:03.839114 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebc005-400d-4c40-b05d-659c3bf995d6 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:03.839187 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 432/863] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:03.839187 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff167cf-11a4-40eb-90a2-c705bf29b01c None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:03.868251 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:03.965414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff167cf-11a4-40eb-90a2-c705bf29b01c None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:03.978938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebc005-400d-4c40-b05d-659c3bf995d6 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:04.006223 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d82be-6bb1-45d7-8722-8338d3dc7321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:04.006883 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d82be-6bb1-45d7-8722-8338d3dc7321 None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:04.007161 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d82be-6bb1-45d7-8722-8338d3dc7321 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:04.007454 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d82be-6bb1-45d7-8722-8338d3dc7321 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:04.008587 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d82be-6bb1-45d7-8722-8338d3dc7321 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:04.010208 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d82be-6bb1-45d7-8722-8338d3dc7321 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:04.023052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45559cd1-5f19-4196-a5db-8e9fcccb8cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:04.023052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45559cd1-5f19-4196-a5db-8e9fcccb8cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:04.023507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45559cd1-5f19-4196-a5db-8e9fcccb8cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:04.023774 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45559cd1-5f19-4196-a5db-8e9fcccb8cc7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:04.029369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 433/864] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 01:52:03 2022] POST /identity/v3/services => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:52:04.030035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d82be-6bb1-45d7-8722-8338d3dc7321 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:04.037384 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45559cd1-5f19-4196-a5db-8e9fcccb8cc7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:04.038613 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45559cd1-5f19-4196-a5db-8e9fcccb8cc7 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:04.055933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-45559cd1-5f19-4196-a5db-8e9fcccb8cc7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 01:52:04.055933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:04.055933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:04.055933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:04.055933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:04.055933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:04.055933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:04.055933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:04.055933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:04.055933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:04.055933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:04.055933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:04.055933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:52:04.055933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:52:04.055933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:52:04.055933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:52:04.057054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:04.057054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:04.057054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:52:04.057054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:52:04.057054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:52:04.057054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:52:04.057054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:04.057054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:04.057054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:04.057054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:04.057054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:04.057054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:04.057054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:04.057054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:04.057054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:04.057054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:04.057054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:04.057054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:04.058018 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:04.058018 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:04.058018 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:52:04.058018 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:52:04.058018 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:52:04.058018 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:52:04.058018 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:52:04.058018 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:52:04.058018 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 01:52:04.058018 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:04.058018 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 432/865] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:52:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:04.063783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45559cd1-5f19-4196-a5db-8e9fcccb8cc7 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:04.070412 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:04.156420 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:04.185142 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d82be-6bb1-45d7-8722-8338d3dc7321 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:04.209268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45559cd1-5f19-4196-a5db-8e9fcccb8cc7 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:04.236099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896db57-44a6-4f4c-9477-9e7cb3bad3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:04.236778 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896db57-44a6-4f4c-9477-9e7cb3bad3cc None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:04.237206 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896db57-44a6-4f4c-9477-9e7cb3bad3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:04.237515 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896db57-44a6-4f4c-9477-9e7cb3bad3cc None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:04.238244 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896db57-44a6-4f4c-9477-9e7cb3bad3cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:04.238550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896db57-44a6-4f4c-9477-9e7cb3bad3cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:04.240288 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896db57-44a6-4f4c-9477-9e7cb3bad3cc None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:04.252656 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 434/866] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:04.254688 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8b7ac-99c2-490e-b7c1-a5927933863f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:04.255389 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8b7ac-99c2-490e-b7c1-a5927933863f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:04.255759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8b7ac-99c2-490e-b7c1-a5927933863f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:04.256038 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8b7ac-99c2-490e-b7c1-a5927933863f None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:04.256910 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8b7ac-99c2-490e-b7c1-a5927933863f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:04.257216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8b7ac-99c2-490e-b7c1-a5927933863f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:04.258045 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896db57-44a6-4f4c-9477-9e7cb3bad3cc None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:04.258683 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8b7ac-99c2-490e-b7c1-a5927933863f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:04.282819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 433/867] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Jun 23 01:52:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:04.288537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8b7ac-99c2-490e-b7c1-a5927933863f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:04.356819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:04.387034 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896db57-44a6-4f4c-9477-9e7cb3bad3cc None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:04.404649 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8b7ac-99c2-490e-b7c1-a5927933863f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:04.418259 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:04.424883 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6465ae-175a-41f2-9772-cd3307f9b150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:04.425831 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6465ae-175a-41f2-9772-cd3307f9b150 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:04.426210 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6465ae-175a-41f2-9772-cd3307f9b150 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:04.426579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6465ae-175a-41f2-9772-cd3307f9b150 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:04.434056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6465ae-175a-41f2-9772-cd3307f9b150 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:04.435989 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6465ae-175a-41f2-9772-cd3307f9b150 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:04.445080 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8b5cf-c367-4f30-b170-0736788b957f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:04.445756 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8b5cf-c367-4f30-b170-0736788b957f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:04.446032 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8b5cf-c367-4f30-b170-0736788b957f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:04.446303 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8b5cf-c367-4f30-b170-0736788b957f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:04.450652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-ef6465ae-175a-41f2-9772-cd3307f9b150 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:52:04.450652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:04.450652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:04.450652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:04.450652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:04.450652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:04.450652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:04.450652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:04.450652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:04.450652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:04.450652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:04.450652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:04.450652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:52:04.450652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:52:04.450652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:52:04.451743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:52:04.451743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:04.451743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:04.451743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:04.451743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:04.451743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:04.451743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:04.451743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:04.451743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:04.451743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:04.451743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:04.451743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:04.451743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:04.451743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:04.451743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:04.451743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:04.451743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:04.453425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:52:04.453425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:52:04.453425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:52:04.453425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:52:04.453425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:52:04.453425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:52:04.453425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:52:04.453425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:04.459448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 435/868] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:52:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:04.462264 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6465ae-175a-41f2-9772-cd3307f9b150 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:04.523670 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8b5cf-c367-4f30-b170-0736788b957f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:04.525238 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8b5cf-c367-4f30-b170-0736788b957f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:04.592886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:04.596679 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6465ae-175a-41f2-9772-cd3307f9b150 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:04.641670 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 434/869] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:52:04 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 01:52:04.642750 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8b5cf-c367-4f30-b170-0736788b957f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:04.643316 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea0942-d762-4599-8f59-f1492d25e11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:04.644257 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea0942-d762-4599-8f59-f1492d25e11b None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:04.644773 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea0942-d762-4599-8f59-f1492d25e11b None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:04.645486 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea0942-d762-4599-8f59-f1492d25e11b None admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:04.647398 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea0942-d762-4599-8f59-f1492d25e11b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:04.647923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea0942-d762-4599-8f59-f1492d25e11b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:04.649536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea0942-d762-4599-8f59-f1492d25e11b None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:04.664463 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 436/870] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:52:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:04.672143 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea0942-d762-4599-8f59-f1492d25e11b None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:04.731579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:04.750829 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8b5cf-c367-4f30-b170-0736788b957f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:04.783511 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea0942-d762-4599-8f59-f1492d25e11b None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:04.787265 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8429c-eaec-4f71-b687-b5492b397812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:04.787987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8429c-eaec-4f71-b687-b5492b397812 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:04.788360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8429c-eaec-4f71-b687-b5492b397812 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:04.788726 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8429c-eaec-4f71-b687-b5492b397812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:04.799277 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8429c-eaec-4f71-b687-b5492b397812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:04.800889 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8429c-eaec-4f71-b687-b5492b397812 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:04.820230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-42d8429c-eaec-4f71-b687-b5492b397812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:04.820230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:04.820230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:04.820230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:04.820230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:04.820230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:04.820230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:04.820230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:04.820230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:04.820230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:04.820230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:04.820230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:04.820230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:52:04.820230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:52:04.820230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:52:04.821227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:52:04.821227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:04.821227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:04.821227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:04.821227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:04.821227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:04.821227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:04.821227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:04.821227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:04.821227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:04.821227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:04.821227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:04.821227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:04.821227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:04.821227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:04.821227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:04.821227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:04.822111 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:52:04.822111 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:52:04.822111 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:04.822111 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:04.825015 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad656e-6fa3-4dda-b4b9-22bb4d85ab7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:04.825923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad656e-6fa3-4dda-b4b9-22bb4d85ab7d None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:04.826497 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 435/871] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:04.826777 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad656e-6fa3-4dda-b4b9-22bb4d85ab7d None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:04.827236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad656e-6fa3-4dda-b4b9-22bb4d85ab7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:04.827340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8429c-eaec-4f71-b687-b5492b397812 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:04.828438 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad656e-6fa3-4dda-b4b9-22bb4d85ab7d None admin] RBAC: Adding query filter params (role.id=c8b68b76c1b44e549cc7520e5546d374, scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018, user.id=0dbf596d8f964d4695944a23dd8e4cef) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:04.828942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad656e-6fa3-4dda-b4b9-22bb4d85ab7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:04.830706 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad656e-6fa3-4dda-b4b9-22bb4d85ab7d None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:04.843649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 437/872] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:52:04 2022] GET /identity/v3/role_assignments?user.id=0dbf596d8f964d4695944a23dd8e4cef&scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018&role.id=c8b68b76c1b44e549cc7520e5546d374 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:04.844557 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:04.937715 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8429c-eaec-4f71-b687-b5492b397812 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:04.975738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963769ef-434b-49cf-9bdf-1c77393d0311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:04.976430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963769ef-434b-49cf-9bdf-1c77393d0311 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:04.976713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963769ef-434b-49cf-9bdf-1c77393d0311 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:04.976993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963769ef-434b-49cf-9bdf-1c77393d0311 None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:04.977739 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963769ef-434b-49cf-9bdf-1c77393d0311 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:04.978043 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963769ef-434b-49cf-9bdf-1c77393d0311 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:04.979451 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963769ef-434b-49cf-9bdf-1c77393d0311 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:04.992884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 436/873] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:04.998432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad656e-6fa3-4dda-b4b9-22bb4d85ab7d None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:05.110462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad656e-6fa3-4dda-b4b9-22bb4d85ab7d None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:05.127650 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:05.146526 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8badd4-1ce1-4428-a66d-d805a6752814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:05.147362 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8badd4-1ce1-4428-a66d-d805a6752814 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:05.147672 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8badd4-1ce1-4428-a66d-d805a6752814 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:05.147897 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8badd4-1ce1-4428-a66d-d805a6752814 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:05.155047 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8badd4-1ce1-4428-a66d-d805a6752814 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:05.156519 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8badd4-1ce1-4428-a66d-d805a6752814 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:05.170622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-7d8badd4-1ce1-4428-a66d-d805a6752814 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:52:05.170622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:05.170622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:05.170622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:05.170622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:05.170622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:05.170622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:05.170622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:05.170622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:05.170622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:05.170622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:05.170622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:05.170622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:52:05.170622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:52:05.170622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:52:05.171595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:52:05.171595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:05.171595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:05.171595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:05.171595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:05.171595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:05.171595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:05.171595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:05.171595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:05.171595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:05.171595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:05.171595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:05.171595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:05.171595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:05.171595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:05.171595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:05.171595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:05.172887 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:52:05.172887 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:52:05.172887 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:52:05.172887 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:52:05.172887 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:52:05.172887 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:52:05.172887 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:52:05.172887 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:05.172887 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 438/874] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:52:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:05.178142 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963769ef-434b-49cf-9bdf-1c77393d0311 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:05.258325 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:05.286047 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963769ef-434b-49cf-9bdf-1c77393d0311 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:05.321984 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37859f-f44e-40d2-8e49-d737ad42bee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:05.323484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37859f-f44e-40d2-8e49-d737ad42bee6 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:05.323966 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37859f-f44e-40d2-8e49-d737ad42bee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:05.324459 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37859f-f44e-40d2-8e49-d737ad42bee6 None admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:05.325441 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37859f-f44e-40d2-8e49-d737ad42bee6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:05.325942 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37859f-f44e-40d2-8e49-d737ad42bee6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:05.327673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37859f-f44e-40d2-8e49-d737ad42bee6 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:05.341070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 437/875] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:52:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:05.351529 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8badd4-1ce1-4428-a66d-d805a6752814 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:05.463832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8badd4-1ce1-4428-a66d-d805a6752814 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:05.499577 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111013de-ed98-4c16-b7fa-672dac3b26a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:05.500243 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111013de-ed98-4c16-b7fa-672dac3b26a9 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:05.500527 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111013de-ed98-4c16-b7fa-672dac3b26a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:05.500805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111013de-ed98-4c16-b7fa-672dac3b26a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:05.501643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111013de-ed98-4c16-b7fa-672dac3b26a9 None admin] RBAC: Adding query filter params (role.id=58e04437159e4eb39aa4a43c213ea34c, scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018, user.id=1ae132c4d0b5461aa26ab929a017cb08) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:05.501957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111013de-ed98-4c16-b7fa-672dac3b26a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:05.503591 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111013de-ed98-4c16-b7fa-672dac3b26a9 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:05.510171 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 439/876] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:52:05 2022] GET /identity/v3/role_assignments?user.id=1ae132c4d0b5461aa26ab929a017cb08&scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018&role.id=58e04437159e4eb39aa4a43c213ea34c => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:05.970695 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05795620-873f-43d8-8b93-d7d981a94945 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:05.971027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05795620-873f-43d8-8b93-d7d981a94945 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:05.971314 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05795620-873f-43d8-8b93-d7d981a94945 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:05.972998 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 438/877] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:05.978369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2881f1-2ce3-41e4-bb92-68f2829f22a3 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:05.978659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2881f1-2ce3-41e4-bb92-68f2829f22a3 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:05.978939 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2881f1-2ce3-41e4-bb92-68f2829f22a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:05.996786 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-6d2881f1-2ce3-41e4-bb92-68f2829f22a3 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:05.998032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-6d2881f1-2ce3-41e4-bb92-68f2829f22a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:06.036128 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:06.072264 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 440/878] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:06.095316 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05795620-873f-43d8-8b93-d7d981a94945 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:06.202543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8bfc5-b62b-44ea-8b4e-c8a7e6ede929 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:06.203051 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8bfc5-b62b-44ea-8b4e-c8a7e6ede929 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:06.203051 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8bfc5-b62b-44ea-8b4e-c8a7e6ede929 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:06.204467 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05795620-873f-43d8-8b93-d7d981a94945 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:06.204664 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 441/879] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:52:06.210409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15696b4-45f8-4510-80e9-721f9093267d None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:06.210696 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15696b4-45f8-4510-80e9-721f9093267d None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:06.210972 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15696b4-45f8-4510-80e9-721f9093267d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:06.238059 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-a15696b4-45f8-4510-80e9-721f9093267d None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:06.239544 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-a15696b4-45f8-4510-80e9-721f9093267d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:06.241985 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8226b7d-441a-4507-a9b2-5afb27a065dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:06.242910 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8226b7d-441a-4507-a9b2-5afb27a065dd None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:06.243193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8226b7d-441a-4507-a9b2-5afb27a065dd None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:06.243488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8226b7d-441a-4507-a9b2-5afb27a065dd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:06.244154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8226b7d-441a-4507-a9b2-5afb27a065dd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:06.245517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8226b7d-441a-4507-a9b2-5afb27a065dd None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:06.247523 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:06.259974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-c8226b7d-441a-4507-a9b2-5afb27a065dd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 01:52:06.259974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:06.259974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:52:06.259974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:52:06.259974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:52:06.259974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:52:06.259974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:52:06.259974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:06.259974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 01:52:06.259974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:06.259974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:52:06.259974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:06.259974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:06.259974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:06.259974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:06.259974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:06.261021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:06.261021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:06.261021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:06.261021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:06.261021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:06.261021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:06.261021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:06.261021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:52:06.261021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:52:06.261021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:52:06.261021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:52:06.261021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:06.261021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:06.261021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:06.261021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:06.261021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:06.261844 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:06.261844 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:06.261844 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:06.261844 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:06.261844 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:06.261844 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:06.261844 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:06.261844 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:06.261844 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:06.261844 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:06.261844 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:06.261844 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:52:06.261844 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:06.261844 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 01:52:06.261844 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:06.262625 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 439/880] 10.222.0.13 () {56 vars in 1132 bytes} [Thu Jun 23 01:52:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:06.269714 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8226b7d-441a-4507-a9b2-5afb27a065dd None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:06.323996 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 442/881] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 01:52:06.347654 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15696b4-45f8-4510-80e9-721f9093267d None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:06.387725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8226b7d-441a-4507-a9b2-5afb27a065dd None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:06.429735 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf52ed-08ff-488f-973d-c0a9919d67f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:06.430834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf52ed-08ff-488f-973d-c0a9919d67f3 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:06.431270 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf52ed-08ff-488f-973d-c0a9919d67f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:06.432488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf52ed-08ff-488f-973d-c0a9919d67f3 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:06.433370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf52ed-08ff-488f-973d-c0a9919d67f3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:06.433827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf52ed-08ff-488f-973d-c0a9919d67f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:06.435671 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf52ed-08ff-488f-973d-c0a9919d67f3 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:06.442908 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 440/882] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 23 01:52:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:06.448074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf52ed-08ff-488f-973d-c0a9919d67f3 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:06.469758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:06.475162 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15696b4-45f8-4510-80e9-721f9093267d None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:06.516282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:06.524758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb6f0b-4a78-4b98-83c9-7c497bf2c017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:06.526092 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb6f0b-4a78-4b98-83c9-7c497bf2c017 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:06.526830 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb6f0b-4a78-4b98-83c9-7c497bf2c017 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:06.527313 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb6f0b-4a78-4b98-83c9-7c497bf2c017 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:06.529076 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb6f0b-4a78-4b98-83c9-7c497bf2c017 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:06.530647 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb6f0b-4a78-4b98-83c9-7c497bf2c017 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:06.547745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-e7bb6f0b-4a78-4b98-83c9-7c497bf2c017 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 01:52:06.547745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:06.547745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:52:06.547745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:52:06.547745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:52:06.547745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:52:06.547745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:52:06.547745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:06.547745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 01:52:06.547745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:06.547745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:52:06.547745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:06.547745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:06.547745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:06.547745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:06.547745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:06.547745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:06.548835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:06.548835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:06.548835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:06.548835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:06.548835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:06.548835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:06.548835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:52:06.548835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:52:06.548835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:52:06.548835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:52:06.548835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:06.548835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:06.548835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:06.548835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:06.548835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:06.548835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:06.549795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:06.549795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:06.549795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:06.549795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:06.549795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:06.549795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:06.549795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:06.549795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:06.549795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:06.549795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:06.549795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:52:06.549795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:06.549795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 01:52:06.549795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:06.554486 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 443/883] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 01:52:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:52:06.559302 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb6f0b-4a78-4b98-83c9-7c497bf2c017 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:06.569862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf52ed-08ff-488f-973d-c0a9919d67f3 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:06.608435 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a335dea-262f-4281-986d-8f429c820fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:06.609270 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a335dea-262f-4281-986d-8f429c820fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:06.609728 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a335dea-262f-4281-986d-8f429c820fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:06.610010 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a335dea-262f-4281-986d-8f429c820fa9 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:06.611521 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a335dea-262f-4281-986d-8f429c820fa9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:06.611521 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a335dea-262f-4281-986d-8f429c820fa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:06.612989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a335dea-262f-4281-986d-8f429c820fa9 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:06.618693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 441/884] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 23 01:52:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:06.624855 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a335dea-262f-4281-986d-8f429c820fa9 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:06.682858 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb6f0b-4a78-4b98-83c9-7c497bf2c017 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:06.718622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1b7d7-e8dd-4f98-a11f-95cf7e215149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:06.719731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1b7d7-e8dd-4f98-a11f-95cf7e215149 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:06.720271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1b7d7-e8dd-4f98-a11f-95cf7e215149 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:06.720757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1b7d7-e8dd-4f98-a11f-95cf7e215149 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:06.721737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1b7d7-e8dd-4f98-a11f-95cf7e215149 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:06.722279 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1b7d7-e8dd-4f98-a11f-95cf7e215149 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:06.724060 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1b7d7-e8dd-4f98-a11f-95cf7e215149 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:06.734009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 444/885] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 01:52:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:06.734925 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a335dea-262f-4281-986d-8f429c820fa9 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:06.735383 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1b7d7-e8dd-4f98-a11f-95cf7e215149 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:06.764073 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:06.768686 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:06.775604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e70411-a095-40d6-94e6-ad38a3000369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:06.776320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e70411-a095-40d6-94e6-ad38a3000369 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:06.776600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e70411-a095-40d6-94e6-ad38a3000369 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:06.776874 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e70411-a095-40d6-94e6-ad38a3000369 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:06.777675 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e70411-a095-40d6-94e6-ad38a3000369 None admin] RBAC: Adding query filter params (interface=public, service_id=3ebe9424c0a147dfaac3f6a43e014f23, region_id=RegionOne) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:06.778091 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e70411-a095-40d6-94e6-ad38a3000369 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:06.779772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e70411-a095-40d6-94e6-ad38a3000369 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:06.793071 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 442/886] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Jun 23 01:52:06 2022] GET /identity/v3/endpoints?service_id=3ebe9424c0a147dfaac3f6a43e014f23&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:06.794344 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e70411-a095-40d6-94e6-ad38a3000369 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:06.850332 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1b7d7-e8dd-4f98-a11f-95cf7e215149 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:06.887778 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1234a4-b0d0-4584-82ba-fab46471ab8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:06.888884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1234a4-b0d0-4584-82ba-fab46471ab8a None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:06.889372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1234a4-b0d0-4584-82ba-fab46471ab8a None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:06.889981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1234a4-b0d0-4584-82ba-fab46471ab8a None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:06.890888 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1234a4-b0d0-4584-82ba-fab46471ab8a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:06.891537 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1234a4-b0d0-4584-82ba-fab46471ab8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:06.893349 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1234a4-b0d0-4584-82ba-fab46471ab8a None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:06.903620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e70411-a095-40d6-94e6-ad38a3000369 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:06.903998 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 445/887] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 01:52:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:06.905697 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1234a4-b0d0-4584-82ba-fab46471ab8a None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:06.950494 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce219ef5-7f7d-40ac-956b-7607f8e72118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:06.951388 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce219ef5-7f7d-40ac-956b-7607f8e72118 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:06.951835 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce219ef5-7f7d-40ac-956b-7607f8e72118 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:06.952307 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce219ef5-7f7d-40ac-956b-7607f8e72118 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:06.953398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce219ef5-7f7d-40ac-956b-7607f8e72118 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:06.954949 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce219ef5-7f7d-40ac-956b-7607f8e72118 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:06.967555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 443/888] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 23 01:52:06 2022] GET /identity/v3/services => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 01:52:07.012725 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:07.024184 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1234a4-b0d0-4584-82ba-fab46471ab8a None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:07.064479 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b40f0-1003-4cde-86da-172138c0e831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:07.065690 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b40f0-1003-4cde-86da-172138c0e831 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:07.066159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b40f0-1003-4cde-86da-172138c0e831 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:07.066611 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b40f0-1003-4cde-86da-172138c0e831 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:07.067660 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b40f0-1003-4cde-86da-172138c0e831 None admin] RBAC: Adding query filter params (interface=public, service_id=e4d72528e7f24ce6a10bae94c3fcf129, region_id=RegionOne) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:07.068157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b40f0-1003-4cde-86da-172138c0e831 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:07.069760 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b40f0-1003-4cde-86da-172138c0e831 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:07.076415 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 446/889] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Jun 23 01:52:06 2022] GET /identity/v3/endpoints?service_id=e4d72528e7f24ce6a10bae94c3fcf129&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:07.084641 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce219ef5-7f7d-40ac-956b-7607f8e72118 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:07.115446 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe400d9c-5743-4939-a3c1-e46c8c1b10a7 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:07.115795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe400d9c-5743-4939-a3c1-e46c8c1b10a7 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:07.116082 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe400d9c-5743-4939-a3c1-e46c8c1b10a7 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:07.117685 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 447/890] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:52:07.123549 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c332682-5e37-4d8f-af2c-8938d1fc50f3 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:07.123877 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c332682-5e37-4d8f-af2c-8938d1fc50f3 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:07.124124 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c332682-5e37-4d8f-af2c-8938d1fc50f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:07.141983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-6c332682-5e37-4d8f-af2c-8938d1fc50f3 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:07.143363 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-6c332682-5e37-4d8f-af2c-8938d1fc50f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:07.155076 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:07.215466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce219ef5-7f7d-40ac-956b-7607f8e72118 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:07.225152 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 448/891] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 01:52:07.248507 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c332682-5e37-4d8f-af2c-8938d1fc50f3 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:07.253575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f9f84-771a-4b06-9e33-31ad5ba70506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:07.254577 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f9f84-771a-4b06-9e33-31ad5ba70506 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:07.255118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f9f84-771a-4b06-9e33-31ad5ba70506 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:07.255623 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f9f84-771a-4b06-9e33-31ad5ba70506 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:07.256520 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f9f84-771a-4b06-9e33-31ad5ba70506 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:07.258207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f9f84-771a-4b06-9e33-31ad5ba70506 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:07.265705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 444/892] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 23 01:52:07 2022] GET /identity/v3/services => generated 1268 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 01:52:07.344266 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:07.362254 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c332682-5e37-4d8f-af2c-8938d1fc50f3 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:07.399550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54fb82-df0d-42ab-879c-c772144f99b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:07.400391 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54fb82-df0d-42ab-879c-c772144f99b1 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:07.400673 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54fb82-df0d-42ab-879c-c772144f99b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:07.400945 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54fb82-df0d-42ab-879c-c772144f99b1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:07.412706 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54fb82-df0d-42ab-879c-c772144f99b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:52:07.421071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-4a54fb82-df0d-42ab-879c-c772144f99b1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 01:52:07.421071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:07.421071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:07.421071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:07.421071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:07.421071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:07.421071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:07.421071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:07.421071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:07.421071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:07.421071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:07.421071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:07.421071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:52:07.421071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:52:07.421071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:52:07.421071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:52:07.422043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:52:07.422043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:52:07.422043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:52:07.422043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:52:07.422043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:07.422043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:07.422043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:07.422043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:07.422043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:07.422043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:07.422043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:07.422043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:07.422043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:07.422043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:07.422043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:07.422043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:07.423326 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:07.423326 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:07.423326 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:07.423326 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:07.423326 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:52:07.423326 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:52:07.423326 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:52:07.423326 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:52:07.423326 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:52:07.423326 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:52:07.423326 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 01:52:07.423326 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:07.423326 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 449/893] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Jun 23 01:52:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:52:07.428521 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f9f84-771a-4b06-9e33-31ad5ba70506 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:07.539300 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f9f84-771a-4b06-9e33-31ad5ba70506 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:07.556912 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:07.576074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5d036-d4ae-4e24-bbf4-85b69f55b71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:07.576761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5d036-d4ae-4e24-bbf4-85b69f55b71a None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:07.577044 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5d036-d4ae-4e24-bbf4-85b69f55b71a None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:07.577320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5d036-d4ae-4e24-bbf4-85b69f55b71a None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:07.578086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5d036-d4ae-4e24-bbf4-85b69f55b71a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:07.578394 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5d036-d4ae-4e24-bbf4-85b69f55b71a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:07.579816 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5d036-d4ae-4e24-bbf4-85b69f55b71a None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:07.589094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 445/894] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Jun 23 01:52:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:07.594492 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54fb82-df0d-42ab-879c-c772144f99b1 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:07.605116 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785e4f5-7c25-42e8-91eb-1639770ce535 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:07.605403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785e4f5-7c25-42e8-91eb-1639770ce535 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:07.605680 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785e4f5-7c25-42e8-91eb-1639770ce535 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:07.607602 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 446/895] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:52:07.613511 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778c9e1-1cd0-41d4-82dc-67f6f5e37bee None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:07.613839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778c9e1-1cd0-41d4-82dc-67f6f5e37bee None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:07.614118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778c9e1-1cd0-41d4-82dc-67f6f5e37bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:07.630928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-a778c9e1-1cd0-41d4-82dc-67f6f5e37bee None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:07.632170 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a778c9e1-1cd0-41d4-82dc-67f6f5e37bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:07.705317 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54fb82-df0d-42ab-879c-c772144f99b1 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:07.709728 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 447/896] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 01:52:07.738488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778c9e1-1cd0-41d4-82dc-67f6f5e37bee None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:07.748583 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a2cb9-1e8d-4a1a-8ca5-a693f05f2883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:07.749518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a2cb9-1e8d-4a1a-8ca5-a693f05f2883 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:07.749912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a2cb9-1e8d-4a1a-8ca5-a693f05f2883 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:07.750274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a2cb9-1e8d-4a1a-8ca5-a693f05f2883 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:07.762239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a2cb9-1e8d-4a1a-8ca5-a693f05f2883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:07.763737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a2cb9-1e8d-4a1a-8ca5-a693f05f2883 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:07.771363 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:07.787476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-a79a2cb9-1e8d-4a1a-8ca5-a693f05f2883 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:07.787476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:07.787476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:07.787476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:07.787476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:07.787476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:07.787476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:07.787476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:07.787476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:07.787476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:07.787476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:07.787476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:07.787476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:52:07.787476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:52:07.787476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:52:07.788496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:52:07.788496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:07.788496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:07.788496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:07.788496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:07.788496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:07.788496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:07.788496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:07.788496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:07.788496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:07.788496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:07.788496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:07.788496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:07.788496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:07.788496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:07.788496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:07.788496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:07.789434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:52:07.789434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:52:07.789434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:07.789434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:07.789434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 450/897] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:07.791119 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a2cb9-1e8d-4a1a-8ca5-a693f05f2883 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:07.868789 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778c9e1-1cd0-41d4-82dc-67f6f5e37bee None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:07.882867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:07.912628 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7d303-c675-42d7-813c-297422e32fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:07.913813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7d303-c675-42d7-813c-297422e32fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:07.914195 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a2cb9-1e8d-4a1a-8ca5-a693f05f2883 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:07.914505 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7d303-c675-42d7-813c-297422e32fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:07.915006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7d303-c675-42d7-813c-297422e32fb8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:07.916317 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7d303-c675-42d7-813c-297422e32fb8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:07.918856 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7d303-c675-42d7-813c-297422e32fb8 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:07.933987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-b1d7d303-c675-42d7-813c-297422e32fb8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 01:52:07.933987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:07.933987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:52:07.933987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:52:07.933987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:52:07.933987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:52:07.933987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:52:07.933987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:07.933987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 01:52:07.933987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:07.933987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:52:07.933987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:07.933987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:07.933987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:07.933987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:07.933987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:07.933987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:07.935027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:07.935027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:07.935027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:07.935027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:07.935027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:07.935027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:07.935027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:52:07.935027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:52:07.935027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:52:07.935027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:52:07.935027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:07.935027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:07.935027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:07.935027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:07.935027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:07.935027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:07.936247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:07.936247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:07.936247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:07.936247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:07.936247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:07.936247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:07.936247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:07.936247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:07.936247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:07.936247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:07.936247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:52:07.936247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:07.936247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 01:52:07.936247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:07.936247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 448/898] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 23 01:52:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:52:07.942254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7d303-c675-42d7-813c-297422e32fb8 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:07.966130 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605f2c1-995d-46f2-b0df-e7dc4edee442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:07.967249 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605f2c1-995d-46f2-b0df-e7dc4edee442 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:07.967760 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605f2c1-995d-46f2-b0df-e7dc4edee442 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:07.968362 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605f2c1-995d-46f2-b0df-e7dc4edee442 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:07.969385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605f2c1-995d-46f2-b0df-e7dc4edee442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:07.969884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605f2c1-995d-46f2-b0df-e7dc4edee442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:07.971779 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605f2c1-995d-46f2-b0df-e7dc4edee442 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:07.985264 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 451/899] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:07.990558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605f2c1-995d-46f2-b0df-e7dc4edee442 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:08.050941 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7d303-c675-42d7-813c-297422e32fb8 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:08.056329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:08.086878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb747ed-3390-4ba4-a793-9db4564a177d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:08.087614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb747ed-3390-4ba4-a793-9db4564a177d None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:08.088038 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb747ed-3390-4ba4-a793-9db4564a177d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:08.088150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb747ed-3390-4ba4-a793-9db4564a177d None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:08.088894 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb747ed-3390-4ba4-a793-9db4564a177d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:08.089217 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb747ed-3390-4ba4-a793-9db4564a177d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:08.090630 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb747ed-3390-4ba4-a793-9db4564a177d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:08.100399 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 449/900] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 23 01:52:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:08.101256 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb747ed-3390-4ba4-a793-9db4564a177d None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:08.105638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605f2c1-995d-46f2-b0df-e7dc4edee442 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:08.142144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:08.143288 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748521a-b5ab-4d1a-88b3-1c989eacdeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:08.145160 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748521a-b5ab-4d1a-88b3-1c989eacdeb6 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:08.145678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748521a-b5ab-4d1a-88b3-1c989eacdeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:08.146140 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748521a-b5ab-4d1a-88b3-1c989eacdeb6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:08.155362 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748521a-b5ab-4d1a-88b3-1c989eacdeb6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:08.157209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748521a-b5ab-4d1a-88b3-1c989eacdeb6 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:08.173824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-1748521a-b5ab-4d1a-88b3-1c989eacdeb6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 01:52:08.173824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:08.173824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:08.173824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:08.173824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:08.173824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:08.173824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:08.173824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:08.173824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:08.173824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:08.173824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:08.173824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:08.173824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:52:08.173824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:52:08.173824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:52:08.173824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:52:08.175084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:08.175084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:08.175084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:52:08.175084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:52:08.175084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:52:08.175084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:52:08.175084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:08.175084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:08.175084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:08.175084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:08.175084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:08.175084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:08.175084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:08.175084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:08.175084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:08.175084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:08.175084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:08.175084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:08.176061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:08.176061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:08.176061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:52:08.176061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:52:08.176061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:52:08.176061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:52:08.176061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:52:08.176061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:52:08.176061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 01:52:08.176061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:08.178857 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 452/901] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 23 01:52:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:52:08.184285 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748521a-b5ab-4d1a-88b3-1c989eacdeb6 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:08.221491 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb747ed-3390-4ba4-a793-9db4564a177d None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:08.270725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916d1cb-e8cd-4696-b251-7b82b6b43210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:08.271575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916d1cb-e8cd-4696-b251-7b82b6b43210 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:08.272101 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916d1cb-e8cd-4696-b251-7b82b6b43210 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:08.272380 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916d1cb-e8cd-4696-b251-7b82b6b43210 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:08.273095 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916d1cb-e8cd-4696-b251-7b82b6b43210 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:08.273400 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916d1cb-e8cd-4696-b251-7b82b6b43210 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:08.275008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916d1cb-e8cd-4696-b251-7b82b6b43210 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:08.287443 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 450/902] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 23 01:52:08 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:08.318664 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748521a-b5ab-4d1a-88b3-1c989eacdeb6 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:08.338843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:08.358490 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e85657-baba-4f04-a65d-2efeb93857e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:08.359183 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e85657-baba-4f04-a65d-2efeb93857e2 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:08.359487 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e85657-baba-4f04-a65d-2efeb93857e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:08.359758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e85657-baba-4f04-a65d-2efeb93857e2 None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:08.360607 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e85657-baba-4f04-a65d-2efeb93857e2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:08.360913 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e85657-baba-4f04-a65d-2efeb93857e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:08.362555 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e85657-baba-4f04-a65d-2efeb93857e2 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:08.383285 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 453/903] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Jun 23 01:52:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:08.388988 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916d1cb-e8cd-4696-b251-7b82b6b43210 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:08.503040 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916d1cb-e8cd-4696-b251-7b82b6b43210 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:08.505470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:08.539996 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abed48-2dd9-44fe-8ad4-44483750aae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:08.540671 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abed48-2dd9-44fe-8ad4-44483750aae8 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:08.540952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abed48-2dd9-44fe-8ad4-44483750aae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:08.541233 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abed48-2dd9-44fe-8ad4-44483750aae8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:08.612192 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abed48-2dd9-44fe-8ad4-44483750aae8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:08.613808 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abed48-2dd9-44fe-8ad4-44483750aae8 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:08.714500 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 451/904] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:52:08 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 01:52:08.720154 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e85657-baba-4f04-a65d-2efeb93857e2 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:08.824520 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e85657-baba-4f04-a65d-2efeb93857e2 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:08.863594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0f272-bd30-47be-a368-b77fb0d394c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:08.865432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0f272-bd30-47be-a368-b77fb0d394c5 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:08.866236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0f272-bd30-47be-a368-b77fb0d394c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:08.866701 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0f272-bd30-47be-a368-b77fb0d394c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:08.878206 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0f272-bd30-47be-a368-b77fb0d394c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:08.880019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0f272-bd30-47be-a368-b77fb0d394c5 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:08.898575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-97e0f272-bd30-47be-a368-b77fb0d394c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:08.898575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:08.898575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:08.898575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:08.898575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:08.898575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:08.898575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:08.898575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:08.898575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:08.898575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:08.898575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:08.898575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:08.898575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:52:08.898575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:52:08.898575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:52:08.899558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:52:08.899558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:08.899558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:08.899558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:08.899558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:08.899558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:08.899558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:08.899558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:08.899558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:08.899558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:08.899558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:08.899558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:08.899558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:08.899558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:08.899558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:08.899558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:08.899558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:08.900476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:52:08.900476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:52:08.900476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:08.900476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:08.902720 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 454/905] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:08.914771 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abed48-2dd9-44fe-8ad4-44483750aae8 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:08.916895 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:09.012843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abed48-2dd9-44fe-8ad4-44483750aae8 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:09.047555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42316f91-56fd-4a75-a600-b3af0458e184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:09.048238 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42316f91-56fd-4a75-a600-b3af0458e184 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:09.048527 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42316f91-56fd-4a75-a600-b3af0458e184 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:09.048810 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42316f91-56fd-4a75-a600-b3af0458e184 None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:09.049677 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42316f91-56fd-4a75-a600-b3af0458e184 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:09.049989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42316f91-56fd-4a75-a600-b3af0458e184 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:09.051588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42316f91-56fd-4a75-a600-b3af0458e184 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:09.065556 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 452/906] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:09.072544 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0f272-bd30-47be-a368-b77fb0d394c5 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:09.102052 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:09.185177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a31e47-d317-4d45-a434-6997ee659d43 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:09.185701 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a31e47-d317-4d45-a434-6997ee659d43 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:09.186121 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a31e47-d317-4d45-a434-6997ee659d43 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:09.187376 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 453/907] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:52:09.193600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b04852-3c85-40ed-8e36-3ec8781d8f0b None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:09.193889 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b04852-3c85-40ed-8e36-3ec8781d8f0b None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:09.194173 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b04852-3c85-40ed-8e36-3ec8781d8f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:09.202284 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0f272-bd30-47be-a368-b77fb0d394c5 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:09.226885 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-c1b04852-3c85-40ed-8e36-3ec8781d8f0b None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:09.228209 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-c1b04852-3c85-40ed-8e36-3ec8781d8f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:09.244786 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34215897-d35f-499b-9a7b-fe6348999364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:09.246559 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34215897-d35f-499b-9a7b-fe6348999364 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:09.247049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34215897-d35f-499b-9a7b-fe6348999364 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:09.247508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34215897-d35f-499b-9a7b-fe6348999364 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:09.263796 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34215897-d35f-499b-9a7b-fe6348999364 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:09.265515 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34215897-d35f-499b-9a7b-fe6348999364 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:09.287501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-34215897-d35f-499b-9a7b-fe6348999364 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:52:09.287501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:09.287501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:09.287501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:09.287501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:09.287501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:09.287501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:09.287501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:09.287501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:09.287501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:09.287501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:09.287501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:09.287501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:52:09.287501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:52:09.287501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:52:09.288448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:52:09.288448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:09.288448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:09.288448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:09.288448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:09.288448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:09.288448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:09.288448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:09.288448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:09.288448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:09.288448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:09.288448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:09.288448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:09.288448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:09.288448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:09.288448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:09.288448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:09.289335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:52:09.289335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:52:09.289335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:52:09.289335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:52:09.289335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:52:09.289335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:52:09.289335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:52:09.289335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:09.297533 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 455/908] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:52:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:09.306651 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34215897-d35f-499b-9a7b-fe6348999364 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:09.345013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:09.366313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 454/909] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:09.397472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b04852-3c85-40ed-8e36-3ec8781d8f0b None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:09.436939 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:09.452222 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34215897-d35f-499b-9a7b-fe6348999364 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:09.494285 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053648e2-02f8-4540-9f9e-1ec302e2a2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:09.494976 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053648e2-02f8-4540-9f9e-1ec302e2a2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:09.495257 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053648e2-02f8-4540-9f9e-1ec302e2a2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:09.495883 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053648e2-02f8-4540-9f9e-1ec302e2a2c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:09.496693 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053648e2-02f8-4540-9f9e-1ec302e2a2c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:09.497007 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053648e2-02f8-4540-9f9e-1ec302e2a2c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:09.498778 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053648e2-02f8-4540-9f9e-1ec302e2a2c0 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:09.518849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 456/910] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:52:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:09.520814 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625f953-f122-4451-ada5-822c51639a63 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:09.521357 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625f953-f122-4451-ada5-822c51639a63 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:09.521857 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625f953-f122-4451-ada5-822c51639a63 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:09.523763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 457/911] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:09.524866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625f953-f122-4451-ada5-822c51639a63 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:09.541109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b04852-3c85-40ed-8e36-3ec8781d8f0b None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:09.593534 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c2590-6ef3-4651-938d-7b44edc750f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:09.594817 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c2590-6ef3-4651-938d-7b44edc750f3 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:09.595264 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c2590-6ef3-4651-938d-7b44edc750f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:09.595573 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c2590-6ef3-4651-938d-7b44edc750f3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:09.596753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c2590-6ef3-4651-938d-7b44edc750f3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:09.598153 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c2590-6ef3-4651-938d-7b44edc750f3 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:09.611723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-a37c2590-6ef3-4651-938d-7b44edc750f3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 01:52:09.611723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:09.611723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:52:09.611723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:52:09.611723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:52:09.611723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:52:09.611723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:52:09.611723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:09.611723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 01:52:09.611723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:09.611723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:52:09.611723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:09.611723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:09.611723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:09.611723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:09.611723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:09.612877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:09.612877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:09.612877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:09.612877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:09.612877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:09.612877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:09.612877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:09.612877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:52:09.612877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:52:09.612877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:52:09.612877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:52:09.612877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:09.612877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:09.612877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:09.612877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:09.612877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:09.616282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:09.616282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:09.616282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:09.616282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:09.616282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:09.616282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:09.616282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:09.616282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:09.616282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:09.616282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:09.616282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:09.616282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:52:09.616282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:09.616282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 01:52:09.616282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:09.616282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 455/912] 10.222.0.13 () {56 vars in 1132 bytes} [Thu Jun 23 01:52:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:52:09.617185 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14939f48-29a6-4375-b1a5-ae0432dbe154 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:09.617185 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14939f48-29a6-4375-b1a5-ae0432dbe154 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:09.617185 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14939f48-29a6-4375-b1a5-ae0432dbe154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:09.633903 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-14939f48-29a6-4375-b1a5-ae0432dbe154 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:09.635312 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-14939f48-29a6-4375-b1a5-ae0432dbe154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:09.657083 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625f953-f122-4451-ada5-822c51639a63 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:09.688277 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:09.692100 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c19cc-ca60-456b-85b7-9d2d429f80a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:09.692734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c19cc-ca60-456b-85b7-9d2d429f80a9 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:09.693009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c19cc-ca60-456b-85b7-9d2d429f80a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:09.693334 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c19cc-ca60-456b-85b7-9d2d429f80a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:09.694167 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c19cc-ca60-456b-85b7-9d2d429f80a9 None admin] RBAC: Adding query filter params (role.id=9c41853f063c46f988b072a76610c245, scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018, user.id=0dbf596d8f964d4695944a23dd8e4cef) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:09.694479 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c19cc-ca60-456b-85b7-9d2d429f80a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:09.695977 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c19cc-ca60-456b-85b7-9d2d429f80a9 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:09.701796 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 458/913] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:52:09 2022] GET /identity/v3/role_assignments?user.id=0dbf596d8f964d4695944a23dd8e4cef&scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018&role.id=9c41853f063c46f988b072a76610c245 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:09.702557 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c19cc-ca60-456b-85b7-9d2d429f80a9 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:09.718613 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:09.723530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 456/914] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:09.746027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14939f48-29a6-4375-b1a5-ae0432dbe154 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:09.818904 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c19cc-ca60-456b-85b7-9d2d429f80a9 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:09.858328 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd33461-692b-46d1-847b-c2457ee42209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:09.859012 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd33461-692b-46d1-847b-c2457ee42209 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:09.859296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd33461-692b-46d1-847b-c2457ee42209 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:09.859624 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd33461-692b-46d1-847b-c2457ee42209 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:09.860313 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd33461-692b-46d1-847b-c2457ee42209 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:09.860615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd33461-692b-46d1-847b-c2457ee42209 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:09.862326 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd33461-692b-46d1-847b-c2457ee42209 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:09.872787 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 459/915] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 23 01:52:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:09.874372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd33461-692b-46d1-847b-c2457ee42209 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:09.876382 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14939f48-29a6-4375-b1a5-ae0432dbe154 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:09.924678 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8a3ab-4332-452c-ac5f-7ee703951140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:09.925376 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8a3ab-4332-452c-ac5f-7ee703951140 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:09.925524 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8a3ab-4332-452c-ac5f-7ee703951140 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:09.931431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8a3ab-4332-452c-ac5f-7ee703951140 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:09.931431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8a3ab-4332-452c-ac5f-7ee703951140 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:09.931431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8a3ab-4332-452c-ac5f-7ee703951140 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:09.945169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-f3f8a3ab-4332-452c-ac5f-7ee703951140 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 01:52:09.945169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:09.945169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:52:09.945169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:52:09.945169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:52:09.945169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:52:09.945169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:52:09.945169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:09.945169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 01:52:09.945169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:09.945169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:52:09.945169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:09.945169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:09.945169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:09.945169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:09.945169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:09.945169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:09.946235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:09.946235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:09.946235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:09.946235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:09.946235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:09.946235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:09.946235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:52:09.946235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:52:09.946235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:52:09.946235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:52:09.946235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:09.946235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:09.946235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:09.946235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:09.946235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:09.946235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:09.947575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:09.947575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:09.947575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:09.947575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:09.947575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:09.947575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:09.947575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:09.947575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:09.947575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:09.947575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:09.947575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:52:09.947575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:09.947575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 01:52:09.947575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:09.947575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 457/916] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 01:52:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:52:09.953020 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8a3ab-4332-452c-ac5f-7ee703951140 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:09.987519 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:10.009660 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:10.021267 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd33461-692b-46d1-847b-c2457ee42209 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:10.063047 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc9f76-b994-4bc9-b900-8564f034e00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:10.063781 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc9f76-b994-4bc9-b900-8564f034e00d None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:10.064125 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc9f76-b994-4bc9-b900-8564f034e00d None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:10.065763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc9f76-b994-4bc9-b900-8564f034e00d None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:10.065879 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc9f76-b994-4bc9-b900-8564f034e00d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:10.066256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc9f76-b994-4bc9-b900-8564f034e00d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:10.067696 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc9f76-b994-4bc9-b900-8564f034e00d None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:10.073386 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8a3ab-4332-452c-ac5f-7ee703951140 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:10.073546 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 460/917] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 23 01:52:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:10.080246 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc9f76-b994-4bc9-b900-8564f034e00d None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:10.117802 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f22e09-6c93-4670-9b37-73457a5d6a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:10.119071 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f22e09-6c93-4670-9b37-73457a5d6a99 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:10.119786 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f22e09-6c93-4670-9b37-73457a5d6a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:10.120235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f22e09-6c93-4670-9b37-73457a5d6a99 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:10.121757 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f22e09-6c93-4670-9b37-73457a5d6a99 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:10.122240 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f22e09-6c93-4670-9b37-73457a5d6a99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:10.124068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f22e09-6c93-4670-9b37-73457a5d6a99 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:10.135168 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 458/918] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 01:52:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:10.135643 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f22e09-6c93-4670-9b37-73457a5d6a99 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:10.204484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc9f76-b994-4bc9-b900-8564f034e00d None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:10.243556 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbb3d5-8c56-462e-8d80-2e9b1fdf9e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:10.244561 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbb3d5-8c56-462e-8d80-2e9b1fdf9e00 None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:10.245010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbb3d5-8c56-462e-8d80-2e9b1fdf9e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:10.245460 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbb3d5-8c56-462e-8d80-2e9b1fdf9e00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:10.246414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbb3d5-8c56-462e-8d80-2e9b1fdf9e00 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:10.248018 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbb3d5-8c56-462e-8d80-2e9b1fdf9e00 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:10.257937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:10.276017 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 461/919] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 23 01:52:10 2022] POST /identity/v3/endpoints => generated 347 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 01:52:10.276466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f22e09-6c93-4670-9b37-73457a5d6a99 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:10.295006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:10.325333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f3c73-ab26-4c3d-bb4a-227ae27c4148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:10.326450 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f3c73-ab26-4c3d-bb4a-227ae27c4148 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:10.326968 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f3c73-ab26-4c3d-bb4a-227ae27c4148 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:10.327460 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f3c73-ab26-4c3d-bb4a-227ae27c4148 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:10.328391 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f3c73-ab26-4c3d-bb4a-227ae27c4148 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:10.328907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f3c73-ab26-4c3d-bb4a-227ae27c4148 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:10.330574 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f3c73-ab26-4c3d-bb4a-227ae27c4148 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:10.337780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 459/920] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 23 01:52:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:10.343976 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbb3d5-8c56-462e-8d80-2e9b1fdf9e00 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:10.457497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbb3d5-8c56-462e-8d80-2e9b1fdf9e00 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:10.493312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431d5c3-8e25-49b2-85d0-2e6d9c61cda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:10.493991 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431d5c3-8e25-49b2-85d0-2e6d9c61cda7 None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:10.494269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431d5c3-8e25-49b2-85d0-2e6d9c61cda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:10.494533 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431d5c3-8e25-49b2-85d0-2e6d9c61cda7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:10.495286 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431d5c3-8e25-49b2-85d0-2e6d9c61cda7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:10.496702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431d5c3-8e25-49b2-85d0-2e6d9c61cda7 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:10.518563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 462/921] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 23 01:52:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:52:10.533280 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816b49d-c7b9-4a69-9d5a-3af64f94acc6 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:10.533660 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816b49d-c7b9-4a69-9d5a-3af64f94acc6 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:10.534031 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816b49d-c7b9-4a69-9d5a-3af64f94acc6 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:10.535474 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 460/922] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:10.541392 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b0635-e330-402f-ba22-63009f3ea729 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:10.541791 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b0635-e330-402f-ba22-63009f3ea729 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:10.542020 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b0635-e330-402f-ba22-63009f3ea729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:10.562224 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-302b0635-e330-402f-ba22-63009f3ea729 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:10.564337 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-302b0635-e330-402f-ba22-63009f3ea729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:10.625671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:10.655876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 463/923] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:10.680542 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816b49d-c7b9-4a69-9d5a-3af64f94acc6 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:10.795534 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816b49d-c7b9-4a69-9d5a-3af64f94acc6 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:10.836707 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a75a6-67af-494b-a5a8-71695edc4423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:10.837396 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a75a6-67af-494b-a5a8-71695edc4423 None admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:10.837681 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a75a6-67af-494b-a5a8-71695edc4423 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:10.837959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a75a6-67af-494b-a5a8-71695edc4423 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:10.838709 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a75a6-67af-494b-a5a8-71695edc4423 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:10.840114 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a75a6-67af-494b-a5a8-71695edc4423 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:10.856825 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 461/924] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 01:52:10 2022] POST /identity/v3/services => generated 241 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:52:11.819104 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46dfa29-5021-410c-8909-2dce347530d6 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:11.819674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46dfa29-5021-410c-8909-2dce347530d6 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:11.819674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46dfa29-5021-410c-8909-2dce347530d6 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:11.821207 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 464/925] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:11.826666 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af16b06-b393-4648-ad32-11f068eab5ad None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:11.827077 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af16b06-b393-4648-ad32-11f068eab5ad None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:11.827251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af16b06-b393-4648-ad32-11f068eab5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:11.844292 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-1af16b06-b393-4648-ad32-11f068eab5ad None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:11.845488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-1af16b06-b393-4648-ad32-11f068eab5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:11.874927 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:11.927191 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 462/926] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:11.949587 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46dfa29-5021-410c-8909-2dce347530d6 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:12.059806 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46dfa29-5021-410c-8909-2dce347530d6 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:12.098426 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb454718-e6e8-4be6-91ab-4644cce881e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:12.099167 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb454718-e6e8-4be6-91ab-4644cce881e1 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:12.099476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb454718-e6e8-4be6-91ab-4644cce881e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:12.099753 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb454718-e6e8-4be6-91ab-4644cce881e1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:12.110412 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb454718-e6e8-4be6-91ab-4644cce881e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:52:12.119041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-cb454718-e6e8-4be6-91ab-4644cce881e1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 01:52:12.119041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:12.119041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:12.119041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:12.119041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:12.119041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:12.119041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:12.119041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:12.119041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:12.119041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:12.119041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:12.119041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:12.119041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:52:12.119041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:52:12.119041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:52:12.119041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:52:12.120041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:52:12.120041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:52:12.120041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:52:12.120041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:52:12.120041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:12.120041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:12.120041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:12.120041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:12.120041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:12.120041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:12.120041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:12.120041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:12.120041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:12.120041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:12.120041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:12.120041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:12.120868 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:12.120868 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:12.120868 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:12.120868 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:12.120868 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:52:12.120868 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:52:12.120868 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:52:12.120868 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:52:12.120868 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:52:12.120868 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:52:12.120868 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 01:52:12.120868 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:12.120868 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 465/927] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Jun 23 01:52:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:12.126804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af16b06-b393-4648-ad32-11f068eab5ad None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:12.229272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af16b06-b393-4648-ad32-11f068eab5ad None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:12.264643 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a309e-3d97-47d8-96bb-5371f717b52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:12.265328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a309e-3d97-47d8-96bb-5371f717b52c None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:12.265614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a309e-3d97-47d8-96bb-5371f717b52c None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:12.265889 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a309e-3d97-47d8-96bb-5371f717b52c None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:12.266646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a309e-3d97-47d8-96bb-5371f717b52c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:12.266955 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a309e-3d97-47d8-96bb-5371f717b52c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:12.268399 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a309e-3d97-47d8-96bb-5371f717b52c None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:12.277234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 463/928] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Jun 23 01:52:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:12.282751 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb454718-e6e8-4be6-91ab-4644cce881e1 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:12.325285 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:12.381353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df353c3-1b5d-47f5-ba1c-359cd254bc38 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:12.381602 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df353c3-1b5d-47f5-ba1c-359cd254bc38 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:12.382031 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df353c3-1b5d-47f5-ba1c-359cd254bc38 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:12.387489 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 464/929] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:12.388036 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb454718-e6e8-4be6-91ab-4644cce881e1 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:12.392712 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5861b28-2cc6-4264-939f-fa0f15329cb9 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:12.393208 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5861b28-2cc6-4264-939f-fa0f15329cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:12.393661 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5861b28-2cc6-4264-939f-fa0f15329cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:12.415234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-d5861b28-2cc6-4264-939f-fa0f15329cb9 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:12.416779 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-d5861b28-2cc6-4264-939f-fa0f15329cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:12.426663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725bfae-978c-4d08-a1ff-7dbbb03cd734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:12.427513 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725bfae-978c-4d08-a1ff-7dbbb03cd734 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:12.427801 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725bfae-978c-4d08-a1ff-7dbbb03cd734 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:12.428077 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725bfae-978c-4d08-a1ff-7dbbb03cd734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:12.438621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:12.441190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725bfae-978c-4d08-a1ff-7dbbb03cd734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:12.442708 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725bfae-978c-4d08-a1ff-7dbbb03cd734 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:12.463039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-d725bfae-978c-4d08-a1ff-7dbbb03cd734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:12.463039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:12.463039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:12.463039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:12.463039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:12.463039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:12.463039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:12.463039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:12.463039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:12.463039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:12.463039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:12.463039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:12.463039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:52:12.463039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:52:12.463039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:52:12.464025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:52:12.464025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:12.464025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:12.464025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:12.464025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:12.464025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:12.464025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:12.464025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:12.464025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:12.464025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:12.464025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:12.464025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:12.464025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:12.464025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:12.464025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:12.464025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:12.464025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:12.465677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:52:12.465677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:52:12.465677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:12.465677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:12.465677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 466/930] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:12.469805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725bfae-978c-4d08-a1ff-7dbbb03cd734 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:12.510461 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 465/931] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:12.532126 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5861b28-2cc6-4264-939f-fa0f15329cb9 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:12.588105 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:12.603050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725bfae-978c-4d08-a1ff-7dbbb03cd734 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:12.648825 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a166c-2781-4a35-a6ae-17eba24dafa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:12.650288 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a166c-2781-4a35-a6ae-17eba24dafa3 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:12.650852 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a166c-2781-4a35-a6ae-17eba24dafa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:12.651332 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a166c-2781-4a35-a6ae-17eba24dafa3 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:12.653211 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a166c-2781-4a35-a6ae-17eba24dafa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:12.653670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a166c-2781-4a35-a6ae-17eba24dafa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:12.655517 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a166c-2781-4a35-a6ae-17eba24dafa3 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:12.657366 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5861b28-2cc6-4264-939f-fa0f15329cb9 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:12.671690 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 467/932] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:12.673319 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308357a-3abf-4579-ac8c-ea5f2e817e2d None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:12.673750 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308357a-3abf-4579-ac8c-ea5f2e817e2d None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:12.675117 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308357a-3abf-4579-ac8c-ea5f2e817e2d None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:12.676832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 468/933] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:12.678172 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308357a-3abf-4579-ac8c-ea5f2e817e2d None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:12.696747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5835d-0e7a-47e7-9a9a-23363757f506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:12.697784 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5835d-0e7a-47e7-9a9a-23363757f506 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:12.698262 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5835d-0e7a-47e7-9a9a-23363757f506 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:12.698681 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5835d-0e7a-47e7-9a9a-23363757f506 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:12.699531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5835d-0e7a-47e7-9a9a-23363757f506 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:12.701044 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5835d-0e7a-47e7-9a9a-23363757f506 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:12.715398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-04b5835d-0e7a-47e7-9a9a-23363757f506 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 01:52:12.715398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:12.715398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:52:12.715398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:52:12.715398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:52:12.715398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:52:12.715398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:52:12.715398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:12.715398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 01:52:12.715398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:12.715398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:52:12.715398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:12.715398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:12.715398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:12.715398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:12.715398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:12.715398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:12.716629 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:12.716629 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:12.716629 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:12.716629 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:12.716629 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:12.716629 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:12.716629 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:52:12.716629 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:52:12.716629 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:52:12.716629 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:52:12.716629 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:12.716629 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:12.716629 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:12.716629 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:12.716629 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:12.716629 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:12.717665 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:12.717665 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:12.717665 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:12.717665 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:12.717665 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:12.717665 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:12.717665 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:12.717665 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:12.717665 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:12.717665 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:12.717665 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:52:12.717665 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:12.717665 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 01:52:12.717665 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:12.719925 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 466/934] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:52:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:52:12.721337 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0374c-3556-437e-8258-17fb3b83e4b8 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:12.721750 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0374c-3556-437e-8258-17fb3b83e4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:12.722150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0374c-3556-437e-8258-17fb3b83e4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:12.740356 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-2da0374c-3556-437e-8258-17fb3b83e4b8 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:12.741544 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-2da0374c-3556-437e-8258-17fb3b83e4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:12.753781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:12.789662 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308357a-3abf-4579-ac8c-ea5f2e817e2d None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:12.823069 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 467/935] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:12.824477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0374c-3556-437e-8258-17fb3b83e4b8 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:12.826360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15253862-e11c-4684-b0e3-0073656668ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:12.827244 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15253862-e11c-4684-b0e3-0073656668ea None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:12.827612 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15253862-e11c-4684-b0e3-0073656668ea None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:12.827901 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15253862-e11c-4684-b0e3-0073656668ea None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:12.837201 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15253862-e11c-4684-b0e3-0073656668ea None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:12.839957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15253862-e11c-4684-b0e3-0073656668ea None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:12.857444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-15253862-e11c-4684-b0e3-0073656668ea None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 01:52:12.857444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:12.857444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:12.857444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:12.857444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:12.857444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:12.857444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:12.857444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:12.857444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:12.857444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:12.857444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:12.857444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:12.857444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:52:12.857444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:52:12.857444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:52:12.857444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:52:12.858453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:12.858453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:12.858453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:52:12.858453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:52:12.858453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:52:12.858453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:52:12.858453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:12.858453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:12.858453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:12.858453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:12.858453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:12.858453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:12.858453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:12.858453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:12.858453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:12.858453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:12.858453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:12.858453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:12.860150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:12.860150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:12.860150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:52:12.860150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:52:12.860150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:52:12.860150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:52:12.860150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:52:12.860150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:52:12.860150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 01:52:12.860150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:12.860150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 469/936] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 23 01:52:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:12.860150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15253862-e11c-4684-b0e3-0073656668ea None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:12.874608 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:12.947454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0374c-3556-437e-8258-17fb3b83e4b8 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:12.974838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15253862-e11c-4684-b0e3-0073656668ea None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:12.984050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad7381-f5cb-4d44-82a0-3595b7f49e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:12.984738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad7381-f5cb-4d44-82a0-3595b7f49e58 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:12.985022 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad7381-f5cb-4d44-82a0-3595b7f49e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:12.985300 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad7381-f5cb-4d44-82a0-3595b7f49e58 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:12.986019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad7381-f5cb-4d44-82a0-3595b7f49e58 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:12.986329 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad7381-f5cb-4d44-82a0-3595b7f49e58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:12.987983 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad7381-f5cb-4d44-82a0-3595b7f49e58 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:12.992694 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 468/937] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 01:52:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:12.995449 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad7381-f5cb-4d44-82a0-3595b7f49e58 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:13.007331 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:13.008918 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559ed7d-27e0-46c3-a688-3a271643439c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:13.009636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559ed7d-27e0-46c3-a688-3a271643439c None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:13.009946 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559ed7d-27e0-46c3-a688-3a271643439c None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:13.010229 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559ed7d-27e0-46c3-a688-3a271643439c None admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:13.010944 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559ed7d-27e0-46c3-a688-3a271643439c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:13.012460 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559ed7d-27e0-46c3-a688-3a271643439c None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:13.013836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: WARNING keystone.server.flask.common [None req-7559ed7d-27e0-46c3-a688-3a271643439c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 23 01:52:13.030719 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.sql.core [None req-7559ed7d-27e0-46c3-a688-3a271643439c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 01:52:13.030719 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 01:52:13.030719 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [parameters: {'id': '6a3c709b2730465eb8463c764499b966', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 01:52:13.030719 dv-cinder-815582-9-smb devstack@keystone.service[80430]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80430) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 01:52:13.047529 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-7559ed7d-27e0-46c3-a688-3a271643439c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6a3c709b2730465eb8463c764499b966.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6a3c709b2730465eb8463c764499b966. Jun 23 01:52:13.047529 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:13.047529 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 01:52:13.047529 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 01:52:13.047529 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 01:52:13.047529 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 01:52:13.047529 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 01:52:13.047529 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 01:52:13.047529 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 01:52:13.047529 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application conn.query(q) Jun 23 01:52:13.047529 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 01:52:13.047529 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 01:52:13.047529 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 01:52:13.048458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application result.read() Jun 23 01:52:13.048458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 01:52:13.048458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 01:52:13.048458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 01:52:13.048458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 01:52:13.048458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 01:52:13.048458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 01:52:13.048458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 01:52:13.048458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 01:52:13.048458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 01:52:13.048458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:13.048458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 01:52:13.048458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:13.048458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:13.048458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 01:52:13.048458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 01:52:13.048458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 23 01:52:13.048458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 23 01:52:13.049505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 01:52:13.049505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application next(self.gen) Jun 23 01:52:13.049505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 01:52:13.049505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application yield resource Jun 23 01:52:13.049505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 01:52:13.049505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application next(self.gen) Jun 23 01:52:13.049505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 01:52:13.049505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 01:52:13.049505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 01:52:13.049505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 01:52:13.049505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 01:52:13.049505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise self.value Jun 23 01:52:13.049505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 01:52:13.049505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 01:52:13.049505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 01:52:13.049505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application session.commit() Jun 23 01:52:13.049505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 01:52:13.050407 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 01:52:13.050407 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 01:52:13.050407 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 01:52:13.050407 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 01:52:13.050407 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self.session.flush() Jun 23 01:52:13.050407 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 01:52:13.050407 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 01:52:13.050407 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 01:52:13.050407 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 01:52:13.050407 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 01:52:13.050407 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application compat.raise_( Jun 23 01:52:13.050407 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 01:52:13.050407 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception Jun 23 01:52:13.050407 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 01:52:13.050407 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 01:52:13.050407 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 01:52:13.050407 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 01:52:13.051343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 01:52:13.051343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 01:52:13.051343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 01:52:13.051343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 01:52:13.051343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 01:52:13.051343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 01:52:13.051343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 01:52:13.051343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 01:52:13.051343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 01:52:13.051343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 01:52:13.051343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 01:52:13.051343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 01:52:13.051343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 01:52:13.051343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 01:52:13.051343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 01:52:13.052196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 01:52:13.052196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 01:52:13.052196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception Jun 23 01:52:13.052196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 01:52:13.052196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 01:52:13.052196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 01:52:13.052196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 01:52:13.052196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 01:52:13.052196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 01:52:13.052196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 01:52:13.052196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application conn.query(q) Jun 23 01:52:13.052196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 01:52:13.052196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 01:52:13.052196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 01:52:13.052196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application result.read() Jun 23 01:52:13.052196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 01:52:13.052196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 01:52:13.053078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 01:52:13.053078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 01:52:13.053078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 01:52:13.053078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 01:52:13.053078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 01:52:13.053078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 01:52:13.053078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 01:52:13.053078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 01:52:13.053078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [parameters: {'id': '6a3c709b2730465eb8463c764499b966', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 01:52:13.053078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 01:52:13.053078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:13.053078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:52:13.053078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:13.053078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:13.053078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 23 01:52:13.053853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 23 01:52:13.053853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 01:52:13.053853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 01:52:13.053853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 23 01:52:13.053853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:13.053853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:52:13.053853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:13.053853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:13.053853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:13.053853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:13.053853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:13.053853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:13.053853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:13.053853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:13.053853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:13.053853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:13.053853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:13.054790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:13.054790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 23 01:52:13.054790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 23 01:52:13.054790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:13.054790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:13.054790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 23 01:52:13.054790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 23 01:52:13.054790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6a3c709b2730465eb8463c764499b966. Jun 23 01:52:13.054790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:13.054790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 470/938] 10.222.0.13 () {60 vars in 1140 bytes} [Thu Jun 23 01:52:12 2022] POST /identity/v3/projects => generated 262 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:13.054790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a01686-fcec-47b6-8c83-8c038b2487bc None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:13.054790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a01686-fcec-47b6-8c83-8c038b2487bc None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:13.056004 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a01686-fcec-47b6-8c83-8c038b2487bc None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:13.056004 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 471/939] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:13.056516 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a01686-fcec-47b6-8c83-8c038b2487bc None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:13.106256 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad7381-f5cb-4d44-82a0-3595b7f49e58 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:13.126762 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:13.140489 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4691c3-7730-4fa3-85e9-08ab70b99ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:13.141171 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4691c3-7730-4fa3-85e9-08ab70b99ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:13.141449 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4691c3-7730-4fa3-85e9-08ab70b99ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:13.141726 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4691c3-7730-4fa3-85e9-08ab70b99ac7 None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:13.142571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4691c3-7730-4fa3-85e9-08ab70b99ac7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:13.142902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4691c3-7730-4fa3-85e9-08ab70b99ac7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:13.144526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4691c3-7730-4fa3-85e9-08ab70b99ac7 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:13.161183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 469/940] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Jun 23 01:52:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:13.161969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4691c3-7730-4fa3-85e9-08ab70b99ac7 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:13.163572 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a01686-fcec-47b6-8c83-8c038b2487bc None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:13.198181 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba9984-03fc-4f82-9c1d-631527e777aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:13.198771 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba9984-03fc-4f82-9c1d-631527e777aa None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:13.199049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba9984-03fc-4f82-9c1d-631527e777aa None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:13.199318 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba9984-03fc-4f82-9c1d-631527e777aa None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:13.200051 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba9984-03fc-4f82-9c1d-631527e777aa None admin] RBAC: Adding query filter params (type=compute) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:13.200354 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba9984-03fc-4f82-9c1d-631527e777aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:13.201872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba9984-03fc-4f82-9c1d-631527e777aa None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:13.206484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 472/941] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 01:52:13 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:13.207662 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b022f-b850-4340-a2a9-9acfe7c95f21 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:13.207943 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b022f-b850-4340-a2a9-9acfe7c95f21 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:13.208212 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b022f-b850-4340-a2a9-9acfe7c95f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:13.234259 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-8a9b022f-b850-4340-a2a9-9acfe7c95f21 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:13.235913 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-8a9b022f-b850-4340-a2a9-9acfe7c95f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:13.236125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:13.274412 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4691c3-7730-4fa3-85e9-08ab70b99ac7 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:13.313792 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e38a17-5360-45bf-9206-73d863acf340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:13.315119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e38a17-5360-45bf-9206-73d863acf340 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:13.315403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e38a17-5360-45bf-9206-73d863acf340 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:13.315702 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e38a17-5360-45bf-9206-73d863acf340 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:13.323061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 473/942] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:13.323485 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e38a17-5360-45bf-9206-73d863acf340 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:13.323860 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b022f-b850-4340-a2a9-9acfe7c95f21 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:13.325044 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e38a17-5360-45bf-9206-73d863acf340 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:13.340036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-81e38a17-5360-45bf-9206-73d863acf340 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:52:13.340036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:13.340036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:13.340036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:13.340036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:13.340036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:13.340036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:13.340036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:13.340036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:13.340036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:13.340036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:13.340036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:13.340036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:52:13.340036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:52:13.340036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:52:13.341898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:52:13.341898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:13.341898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:13.341898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:13.341898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:13.341898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:13.341898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:13.341898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:13.341898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:13.341898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:13.341898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:13.341898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:13.341898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:13.341898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:13.341898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:13.341898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:13.341898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:13.344357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:52:13.344357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:52:13.344357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:52:13.344357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:52:13.344357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:52:13.344357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:52:13.344357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:52:13.344357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:13.344357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 470/943] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:52:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:13.348051 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e38a17-5360-45bf-9206-73d863acf340 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:13.401354 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:13.450049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b022f-b850-4340-a2a9-9acfe7c95f21 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:13.465013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e38a17-5360-45bf-9206-73d863acf340 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:13.487762 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff644b-c900-4911-b3fd-ab6519459177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:13.488573 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff644b-c900-4911-b3fd-ab6519459177 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:13.488850 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff644b-c900-4911-b3fd-ab6519459177 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:13.489126 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff644b-c900-4911-b3fd-ab6519459177 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:13.492225 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:13.500743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d713ac-be76-4775-8429-ed515cb2c213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:13.501670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff644b-c900-4911-b3fd-ab6519459177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:13.501821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d713ac-be76-4775-8429-ed515cb2c213 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:13.502088 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d713ac-be76-4775-8429-ed515cb2c213 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:13.502406 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d713ac-be76-4775-8429-ed515cb2c213 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:13.503085 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d713ac-be76-4775-8429-ed515cb2c213 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:13.503301 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff644b-c900-4911-b3fd-ab6519459177 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:13.504489 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d713ac-be76-4775-8429-ed515cb2c213 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:13.518341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-f6d713ac-be76-4775-8429-ed515cb2c213 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 01:52:13.518341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:13.518341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:52:13.518341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:52:13.518341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:52:13.518341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:52:13.518341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:52:13.518341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:13.518341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 01:52:13.518341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:13.518341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:52:13.518341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:13.518341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:13.518341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:13.518341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:13.518341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:13.518341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:13.519470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:13.519470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:13.519470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:13.519470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:13.519470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:13.519470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:13.519470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:52:13.519470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:52:13.519470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:52:13.519470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:52:13.519470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:13.519470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:13.519470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:13.519470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:13.519470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:13.519470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:13.528415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:13.528415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:13.528415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:13.528415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:13.528415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:13.528415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:13.528415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:13.528415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:13.528415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:13.528415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:13.528415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:52:13.528415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:13.528415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 01:52:13.528415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:13.528415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 471/944] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 23 01:52:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:13.529216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d713ac-be76-4775-8429-ed515cb2c213 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:13.529296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-36ff644b-c900-4911-b3fd-ab6519459177 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:13.529296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:13.529296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:13.529296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:13.529296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:13.529296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:13.529296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:13.529296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:13.529296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:13.529296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:13.529296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:13.529296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:13.529296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:52:13.529296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:52:13.529296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:52:13.530088 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:52:13.530088 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:13.530088 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:13.530088 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:13.530088 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:13.530088 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:13.530088 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:13.530088 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:13.530088 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:13.530088 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:13.530088 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:13.530088 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:13.530088 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:13.530088 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:13.530088 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:13.530088 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:13.530088 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:13.530956 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:52:13.530956 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:52:13.530956 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:13.530956 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:13.530956 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 474/945] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:13.530956 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff644b-c900-4911-b3fd-ab6519459177 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:13.632752 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff644b-c900-4911-b3fd-ab6519459177 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:13.636724 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d713ac-be76-4775-8429-ed515cb2c213 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:13.647589 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:13.671435 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f5f3a-1f97-4a14-aa52-49aa9976b7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:13.672582 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f5f3a-1f97-4a14-aa52-49aa9976b7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:13.673056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f5f3a-1f97-4a14-aa52-49aa9976b7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:13.673343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb0c0e-2188-40b2-a217-7f27641b9100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:13.673714 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f5f3a-1f97-4a14-aa52-49aa9976b7a5 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:13.674021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb0c0e-2188-40b2-a217-7f27641b9100 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:13.674427 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb0c0e-2188-40b2-a217-7f27641b9100 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:13.674709 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb0c0e-2188-40b2-a217-7f27641b9100 None admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:13.675076 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f5f3a-1f97-4a14-aa52-49aa9976b7a5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:13.675389 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f5f3a-1f97-4a14-aa52-49aa9976b7a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:13.675525 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb0c0e-2188-40b2-a217-7f27641b9100 None admin] RBAC: Adding query filter params (name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:13.675843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb0c0e-2188-40b2-a217-7f27641b9100 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:13.676812 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f5f3a-1f97-4a14-aa52-49aa9976b7a5 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:13.677273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb0c0e-2188-40b2-a217-7f27641b9100 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:13.689096 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 475/946] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 23 01:52:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:13.690032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f5f3a-1f97-4a14-aa52-49aa9976b7a5 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:13.698125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 472/947] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 01:52:13 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:13.698954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb0c0e-2188-40b2-a217-7f27641b9100 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:13.780642 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:13.809831 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f5f3a-1f97-4a14-aa52-49aa9976b7a5 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:13.837407 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb0c0e-2188-40b2-a217-7f27641b9100 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:13.847098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b05d76-1c46-43da-851d-b7ce3538582a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:13.847844 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b05d76-1c46-43da-851d-b7ce3538582a None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:13.848108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b05d76-1c46-43da-851d-b7ce3538582a None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:13.848395 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b05d76-1c46-43da-851d-b7ce3538582a None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:13.849107 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b05d76-1c46-43da-851d-b7ce3538582a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:13.849404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b05d76-1c46-43da-851d-b7ce3538582a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:13.850811 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b05d76-1c46-43da-851d-b7ce3538582a None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:13.863140 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 476/948] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:13.868931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b05d76-1c46-43da-851d-b7ce3538582a None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:13.881102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb4b3a-46be-4fc1-829b-8670cceb05bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:13.882093 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb4b3a-46be-4fc1-829b-8670cceb05bb None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:13.882571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb4b3a-46be-4fc1-829b-8670cceb05bb None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:13.883037 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb4b3a-46be-4fc1-829b-8670cceb05bb None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:13.883794 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb4b3a-46be-4fc1-829b-8670cceb05bb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:13.884103 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb4b3a-46be-4fc1-829b-8670cceb05bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:13.885484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb4b3a-46be-4fc1-829b-8670cceb05bb None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:13.891307 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 473/949] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 23 01:52:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:13.897985 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb4b3a-46be-4fc1-829b-8670cceb05bb None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:13.913486 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:13.997672 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b05d76-1c46-43da-851d-b7ce3538582a None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:14.017241 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb4b3a-46be-4fc1-829b-8670cceb05bb None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:14.034604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:14.041771 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba7cb5-0bf2-4b47-bb00-ccd7591b8155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:14.042869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba7cb5-0bf2-4b47-bb00-ccd7591b8155 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:14.043353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba7cb5-0bf2-4b47-bb00-ccd7591b8155 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:14.043845 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba7cb5-0bf2-4b47-bb00-ccd7591b8155 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:14.051308 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba7cb5-0bf2-4b47-bb00-ccd7591b8155 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:14.053140 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba7cb5-0bf2-4b47-bb00-ccd7591b8155 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:14.054214 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fa068-4430-4c67-8c4f-1c433153cc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:14.054924 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fa068-4430-4c67-8c4f-1c433153cc92 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:14.055206 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fa068-4430-4c67-8c4f-1c433153cc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:14.055506 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fa068-4430-4c67-8c4f-1c433153cc92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:14.056302 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fa068-4430-4c67-8c4f-1c433153cc92 None admin] RBAC: Adding query filter params (interface=public, service_id=281583e0f62e406d8ac2ba8472ac2181, region_id=RegionOne) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:14.056611 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fa068-4430-4c67-8c4f-1c433153cc92 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:14.057968 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fa068-4430-4c67-8c4f-1c433153cc92 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:14.064009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 474/950] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Jun 23 01:52:13 2022] GET /identity/v3/endpoints?service_id=281583e0f62e406d8ac2ba8472ac2181&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:14.069400 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fa068-4430-4c67-8c4f-1c433153cc92 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:14.070849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-deba7cb5-0bf2-4b47-bb00-ccd7591b8155 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:52:14.070849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:14.070849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:14.070849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:14.070849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:14.070849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:14.070849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:14.070849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:14.070849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:14.070849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:14.070849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:14.070849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:14.070849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:52:14.070849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:52:14.070849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:52:14.071931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:52:14.071931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:14.071931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:14.071931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:14.071931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:14.071931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:14.071931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:14.071931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:14.071931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:14.071931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:14.071931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:14.071931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:14.071931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:14.071931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:14.071931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:14.071931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:14.071931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:14.072843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:52:14.072843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:52:14.072843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:52:14.072843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:52:14.072843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:52:14.072843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:52:14.072843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:52:14.072843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:14.075145 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 477/951] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:52:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:14.080951 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba7cb5-0bf2-4b47-bb00-ccd7591b8155 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:14.173634 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fa068-4430-4c67-8c4f-1c433153cc92 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:14.183671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:14.191971 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba7cb5-0bf2-4b47-bb00-ccd7591b8155 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:14.210222 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9955534-cacd-43e5-9963-ae0a375c5e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:14.210980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9955534-cacd-43e5-9963-ae0a375c5e21 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:14.211161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9955534-cacd-43e5-9963-ae0a375c5e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:14.211467 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9955534-cacd-43e5-9963-ae0a375c5e21 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:14.212161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9955534-cacd-43e5-9963-ae0a375c5e21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:14.213595 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9955534-cacd-43e5-9963-ae0a375c5e21 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:14.227757 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 475/952] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 23 01:52:14 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 01:52:14.231787 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a7ab0-6d14-45b2-87c9-5def25a0f63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:14.232828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a7ab0-6d14-45b2-87c9-5def25a0f63a None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:14.233310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a7ab0-6d14-45b2-87c9-5def25a0f63a None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:14.233795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a7ab0-6d14-45b2-87c9-5def25a0f63a None admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:14.234845 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a7ab0-6d14-45b2-87c9-5def25a0f63a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:14.235387 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a7ab0-6d14-45b2-87c9-5def25a0f63a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:14.237213 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a7ab0-6d14-45b2-87c9-5def25a0f63a None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:14.256605 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 478/953] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:52:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:14.257614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9955534-cacd-43e5-9963-ae0a375c5e21 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:14.315801 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:14.385596 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9955534-cacd-43e5-9963-ae0a375c5e21 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:14.423666 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bb47d-d758-4d26-83f5-7e0f7c54f2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:14.424750 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bb47d-d758-4d26-83f5-7e0f7c54f2c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:14.425157 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bb47d-d758-4d26-83f5-7e0f7c54f2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:14.425440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bb47d-d758-4d26-83f5-7e0f7c54f2c3 None admin] PATH_INFO: `/v3/projects/3f3b06be1b5a4b3a8235ebf22da2a018/users/0dbf596d8f964d4695944a23dd8e4cef/roles/9c41853f063c46f988b072a76610c245` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:14.427891 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6bb47d-d758-4d26-83f5-7e0f7c54f2c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f3b06be1b5a4b3a8235ebf22da2a018, user_id=0dbf596d8f964d4695944a23dd8e4cef, role_id=9c41853f063c46f988b072a76610c245)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:14.429391 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6bb47d-d758-4d26-83f5-7e0f7c54f2c3 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:14.446606 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 476/954] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:52:14 2022] PUT /identity/v3/projects/3f3b06be1b5a4b3a8235ebf22da2a018/users/0dbf596d8f964d4695944a23dd8e4cef/roles/9c41853f063c46f988b072a76610c245 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 01:52:15.254412 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cefe8b-dc39-4cac-a245-7c86e189d25e None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:15.254956 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cefe8b-dc39-4cac-a245-7c86e189d25e None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:15.254956 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cefe8b-dc39-4cac-a245-7c86e189d25e None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:15.256512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 479/955] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:15.262008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5d703-590f-4a5d-a212-fabb5a058972 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:15.262811 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5d703-590f-4a5d-a212-fabb5a058972 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:15.263291 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5d703-590f-4a5d-a212-fabb5a058972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:15.280760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-02e5d703-590f-4a5d-a212-fabb5a058972 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:15.282219 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-02e5d703-590f-4a5d-a212-fabb5a058972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:15.359557 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 477/956] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 01:52:15.375584 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cefe8b-dc39-4cac-a245-7c86e189d25e None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:15.491280 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cefe8b-dc39-4cac-a245-7c86e189d25e None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:15.526745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4098b-1363-4b5a-a75b-a0e3e5c11a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:15.527350 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4098b-1363-4b5a-a75b-a0e3e5c11a8b None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:15.527664 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4098b-1363-4b5a-a75b-a0e3e5c11a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:15.527935 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4098b-1363-4b5a-a75b-a0e3e5c11a8b None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:15.528674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4098b-1363-4b5a-a75b-a0e3e5c11a8b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:15.530078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4098b-1363-4b5a-a75b-a0e3e5c11a8b None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:15.548182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 480/957] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 01:52:15 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:52:15.917168 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aefa9a-12e9-4106-b544-84ba00669e81 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:15.917371 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aefa9a-12e9-4106-b544-84ba00669e81 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:15.917643 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aefa9a-12e9-4106-b544-84ba00669e81 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:15.919303 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 478/958] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:15.925463 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555092b4-ce67-4141-837e-d701ba0dbc48 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:15.925767 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555092b4-ce67-4141-837e-d701ba0dbc48 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:15.926023 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555092b4-ce67-4141-837e-d701ba0dbc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:15.946591 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-555092b4-ce67-4141-837e-d701ba0dbc48 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:15.947804 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-555092b4-ce67-4141-837e-d701ba0dbc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:15.959097 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:16.026556 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 481/959] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:16.052207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aefa9a-12e9-4106-b544-84ba00669e81 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:16.090390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:16.161464 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aefa9a-12e9-4106-b544-84ba00669e81 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:16.196732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a6805-b8ac-4dbc-9b31-1bda98664156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:16.197333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a6805-b8ac-4dbc-9b31-1bda98664156 None admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:16.197610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a6805-b8ac-4dbc-9b31-1bda98664156 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:16.197886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a6805-b8ac-4dbc-9b31-1bda98664156 None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:16.198588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a6805-b8ac-4dbc-9b31-1bda98664156 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:16.200056 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a6805-b8ac-4dbc-9b31-1bda98664156 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:16.201379 dv-cinder-815582-9-smb devstack@keystone.service[80431]: WARNING keystone.server.flask.common [None req-462a6805-b8ac-4dbc-9b31-1bda98664156 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 23 01:52:16.215146 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.sql.core [None req-462a6805-b8ac-4dbc-9b31-1bda98664156 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 01:52:16.215146 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 01:52:16.215146 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [parameters: {'user_id': '12178d430e8e497096f71b55376e50fb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 01:52:16.215146 dv-cinder-815582-9-smb devstack@keystone.service[80431]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80431) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 01:52:16.223226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-462a6805-b8ac-4dbc-9b31-1bda98664156 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 01:52:16.223226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:16.223226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 01:52:16.223226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 01:52:16.223226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 01:52:16.223226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 01:52:16.223226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 01:52:16.223226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 01:52:16.223226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 01:52:16.223226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application conn.query(q) Jun 23 01:52:16.223226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 01:52:16.223226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 01:52:16.223226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 01:52:16.223226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application result.read() Jun 23 01:52:16.223226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 01:52:16.224234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 01:52:16.224234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 01:52:16.224234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 01:52:16.224234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 01:52:16.224234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 01:52:16.224234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 01:52:16.224234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 01:52:16.224234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 01:52:16.224234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:16.224234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 01:52:16.224234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:16.224234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:16.224234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 01:52:16.224234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 01:52:16.224234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 23 01:52:16.224234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 23 01:52:16.224234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 01:52:16.224234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application next(self.gen) Jun 23 01:52:16.225353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 01:52:16.225353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application yield resource Jun 23 01:52:16.225353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 01:52:16.225353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application next(self.gen) Jun 23 01:52:16.225353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 01:52:16.225353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 01:52:16.225353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 01:52:16.225353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 01:52:16.225353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 01:52:16.225353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise self.value Jun 23 01:52:16.225353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 01:52:16.225353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 01:52:16.225353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 01:52:16.225353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application session.commit() Jun 23 01:52:16.225353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 01:52:16.225353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 01:52:16.225353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 01:52:16.226295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 01:52:16.226295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 01:52:16.226295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self.session.flush() Jun 23 01:52:16.226295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 01:52:16.226295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 01:52:16.226295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 01:52:16.226295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 01:52:16.226295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 01:52:16.226295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application compat.raise_( Jun 23 01:52:16.226295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 01:52:16.226295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception Jun 23 01:52:16.226295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 01:52:16.226295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 01:52:16.226295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 01:52:16.226295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 01:52:16.226295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 01:52:16.226295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 01:52:16.227245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 01:52:16.227245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 01:52:16.227245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 23 01:52:16.227245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 23 01:52:16.227245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 01:52:16.227245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 01:52:16.227245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 01:52:16.227245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 01:52:16.227245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 01:52:16.227245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 01:52:16.227245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 01:52:16.227245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 01:52:16.227245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 01:52:16.227245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 01:52:16.227245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 01:52:16.227245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception Jun 23 01:52:16.229861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 01:52:16.229861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 01:52:16.229861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 01:52:16.229861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 01:52:16.229861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 01:52:16.229861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 01:52:16.229861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 01:52:16.229861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application conn.query(q) Jun 23 01:52:16.229861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 01:52:16.229861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 01:52:16.229861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 01:52:16.229861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application result.read() Jun 23 01:52:16.229861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 01:52:16.229861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 01:52:16.229861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 01:52:16.229861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 01:52:16.231917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 01:52:16.231917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 01:52:16.231917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 01:52:16.231917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 01:52:16.231917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 01:52:16.231917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 01:52:16.231917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [parameters: {'user_id': '12178d430e8e497096f71b55376e50fb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 01:52:16.231917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 01:52:16.231917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:16.231917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:52:16.231917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:16.231917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:16.231917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:16.231917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:16.231917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:16.233827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:16.233827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:16.233827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:16.233827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:16.233827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:16.233827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:16.233827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:16.233827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 23 01:52:16.233827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 23 01:52:16.233827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:16.233827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:16.233827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:52:16.233827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:52:16.233827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:52:16.233827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:52:16.233827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 23 01:52:16.233827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 23 01:52:16.240082 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 23 01:52:16.240082 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 23 01:52:16.240082 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 01:52:16.240082 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 01:52:16.240082 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 01:52:16.240082 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:16.240082 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 479/960] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Jun 23 01:52:16 2022] POST /identity/v3/users => generated 160 bytes in 173 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:16.243489 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555092b4-ce67-4141-837e-d701ba0dbc48 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:16.350715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555092b4-ce67-4141-837e-d701ba0dbc48 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:16.355316 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bed769-0a1d-4e71-9910-e0fea860bfb1 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:16.355745 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bed769-0a1d-4e71-9910-e0fea860bfb1 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:16.355925 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bed769-0a1d-4e71-9910-e0fea860bfb1 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:16.360470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 480/961] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:52:16.365621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345a4db-98ec-429d-943b-370b5700d7bc None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:16.365904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345a4db-98ec-429d-943b-370b5700d7bc None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:16.366178 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345a4db-98ec-429d-943b-370b5700d7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:16.383914 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-4345a4db-98ec-429d-943b-370b5700d7bc None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:16.385470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-4345a4db-98ec-429d-943b-370b5700d7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:16.387155 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a4464-c469-432c-ae7a-6973172455a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:16.388111 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a4464-c469-432c-ae7a-6973172455a2 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:16.388489 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a4464-c469-432c-ae7a-6973172455a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:16.388765 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a4464-c469-432c-ae7a-6973172455a2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:16.397209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a4464-c469-432c-ae7a-6973172455a2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:16.398695 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a4464-c469-432c-ae7a-6973172455a2 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:16.414397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-912a4464-c469-432c-ae7a-6973172455a2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 01:52:16.414397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:16.414397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:16.414397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:16.414397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:16.414397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:16.414397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:16.414397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:16.414397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:16.414397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:16.414397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:16.414397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:16.414397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:52:16.414397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:52:16.414397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:52:16.414397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:52:16.415540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:16.415540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:16.415540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:52:16.415540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:52:16.415540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:52:16.415540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:52:16.415540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:16.415540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:16.415540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:16.415540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:16.415540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:16.415540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:16.415540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:16.415540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:16.415540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:16.415540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:16.415540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:16.415540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:16.416560 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:16.416560 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:16.416560 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:52:16.416560 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:52:16.416560 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:52:16.416560 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:52:16.416560 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:52:16.416560 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:52:16.416560 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 01:52:16.416560 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:16.419953 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 482/962] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:52:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:16.426175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a4464-c469-432c-ae7a-6973172455a2 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:16.429400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:16.461107 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 481/963] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:16.479374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345a4db-98ec-429d-943b-370b5700d7bc None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:16.512333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:16.560994 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a4464-c469-432c-ae7a-6973172455a2 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:16.599188 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345a4db-98ec-429d-943b-370b5700d7bc None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:16.602382 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e0178-4bb9-4045-8546-ab72854a9dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:16.603065 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e0178-4bb9-4045-8546-ab72854a9dbf None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:16.603348 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e0178-4bb9-4045-8546-ab72854a9dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:16.603680 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e0178-4bb9-4045-8546-ab72854a9dbf None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:16.604500 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e0178-4bb9-4045-8546-ab72854a9dbf None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:16.604806 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e0178-4bb9-4045-8546-ab72854a9dbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:16.606250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e0178-4bb9-4045-8546-ab72854a9dbf None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:16.635079 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee64882-6e0a-4dd2-bde1-12fe1201b605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:16.635939 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee64882-6e0a-4dd2-bde1-12fe1201b605 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:16.636220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee64882-6e0a-4dd2-bde1-12fe1201b605 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:16.636493 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee64882-6e0a-4dd2-bde1-12fe1201b605 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:16.637148 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee64882-6e0a-4dd2-bde1-12fe1201b605 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:16.638639 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee64882-6e0a-4dd2-bde1-12fe1201b605 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:16.647488 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 483/964] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 23 01:52:16 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:16.647488 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb1a82-687c-4e92-9085-d4958f6d2cb7 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:16.647488 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb1a82-687c-4e92-9085-d4958f6d2cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:16.647488 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb1a82-687c-4e92-9085-d4958f6d2cb7 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:16.647488 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 484/965] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:16.651013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-cee64882-6e0a-4dd2-bde1-12fe1201b605 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 01:52:16.651013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:16.651013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:52:16.651013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:52:16.651013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:52:16.651013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:52:16.651013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:52:16.651013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:16.651013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 01:52:16.651013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:16.651013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:52:16.651013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:16.651013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:16.651013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:16.651013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:16.651013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:16.651013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:16.652128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:16.652128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:16.652128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:16.652128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:16.652128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:16.652128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:16.652128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:52:16.652128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:52:16.652128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:52:16.652128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:52:16.652128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:16.652128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:16.652128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:16.652128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:16.652128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:16.652128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:16.652983 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:16.652983 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:16.652983 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:16.652983 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:16.652983 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:16.652983 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:16.652983 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:16.652983 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:16.652983 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:16.652983 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:16.652983 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:52:16.652983 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:16.652983 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 01:52:16.652983 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:16.657636 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 482/966] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 23 01:52:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:16.659050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a811e4-9fbd-498a-bb4f-3975b1dc39a4 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:16.659335 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a811e4-9fbd-498a-bb4f-3975b1dc39a4 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:16.659516 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb1a82-687c-4e92-9085-d4958f6d2cb7 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:16.659635 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a811e4-9fbd-498a-bb4f-3975b1dc39a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:16.677698 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-c0a811e4-9fbd-498a-bb4f-3975b1dc39a4 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:16.678901 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-c0a811e4-9fbd-498a-bb4f-3975b1dc39a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:16.731295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:16.764500 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 483/967] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:16.783062 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb1a82-687c-4e92-9085-d4958f6d2cb7 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:16.788538 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a811e4-9fbd-498a-bb4f-3975b1dc39a4 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:16.811426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:16.825990 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483690f4-8d06-45b8-8256-dbdab947f599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:16.826770 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483690f4-8d06-45b8-8256-dbdab947f599 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:16.827055 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483690f4-8d06-45b8-8256-dbdab947f599 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:16.827330 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483690f4-8d06-45b8-8256-dbdab947f599 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:16.828075 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483690f4-8d06-45b8-8256-dbdab947f599 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:16.828385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483690f4-8d06-45b8-8256-dbdab947f599 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:16.829775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483690f4-8d06-45b8-8256-dbdab947f599 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:16.836325 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 485/968] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 23 01:52:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:16.843878 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483690f4-8d06-45b8-8256-dbdab947f599 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:16.914820 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a811e4-9fbd-498a-bb4f-3975b1dc39a4 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:16.967458 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d7c76-78ed-4b10-afbf-1c51f61a69f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:16.968297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d7c76-78ed-4b10-afbf-1c51f61a69f9 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:16.968579 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d7c76-78ed-4b10-afbf-1c51f61a69f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:16.968849 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d7c76-78ed-4b10-afbf-1c51f61a69f9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:16.976398 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483690f4-8d06-45b8-8256-dbdab947f599 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:16.981282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d7c76-78ed-4b10-afbf-1c51f61a69f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:52:16.992029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-959d7c76-78ed-4b10-afbf-1c51f61a69f9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 01:52:16.992029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:16.992029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:16.992029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:16.992029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:16.992029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:16.992029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:16.992029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:16.992029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:16.992029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:16.992029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:16.992029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:16.992029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:52:16.992029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:52:16.992029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:52:16.992029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:52:16.993012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:52:16.993012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:52:16.993012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:52:16.993012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:52:16.993012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:16.993012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:16.993012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:16.993012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:16.993012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:16.993012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:16.993012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:16.993012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:16.993012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:16.993012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:16.993012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:16.993012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:16.993962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:16.993962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:16.993962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:16.993962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:16.993962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:52:16.993962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:52:16.993962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:52:16.993962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:52:16.993962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:52:16.993962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:52:16.993962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 01:52:16.993962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:16.994652 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 484/969] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Jun 23 01:52:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:52:16.999930 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d7c76-78ed-4b10-afbf-1c51f61a69f9 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:17.006164 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:17.020791 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9f0f9-a1db-4728-b318-367d5a6abe28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:17.021942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9f0f9-a1db-4728-b318-367d5a6abe28 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:17.022621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9f0f9-a1db-4728-b318-367d5a6abe28 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:17.023099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9f0f9-a1db-4728-b318-367d5a6abe28 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:17.024074 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9f0f9-a1db-4728-b318-367d5a6abe28 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:17.024671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9f0f9-a1db-4728-b318-367d5a6abe28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:17.026413 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9f0f9-a1db-4728-b318-367d5a6abe28 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:17.032201 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 486/970] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 23 01:52:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:17.038750 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9f0f9-a1db-4728-b318-367d5a6abe28 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:17.094881 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:17.117114 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d7c76-78ed-4b10-afbf-1c51f61a69f9 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:17.150750 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9f0f9-a1db-4728-b318-367d5a6abe28 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:17.151922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beca7cb-0b39-4e6a-a747-f58ce1922cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:17.152603 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beca7cb-0b39-4e6a-a747-f58ce1922cee None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:17.152901 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beca7cb-0b39-4e6a-a747-f58ce1922cee None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:17.153164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beca7cb-0b39-4e6a-a747-f58ce1922cee None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:17.153918 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beca7cb-0b39-4e6a-a747-f58ce1922cee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:17.154231 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beca7cb-0b39-4e6a-a747-f58ce1922cee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:17.155676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beca7cb-0b39-4e6a-a747-f58ce1922cee None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:17.164731 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 485/971] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Jun 23 01:52:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:17.170401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beca7cb-0b39-4e6a-a747-f58ce1922cee None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:17.190123 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214fa91-e31b-43bb-8100-6d9cf85eab92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:17.191096 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214fa91-e31b-43bb-8100-6d9cf85eab92 None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:17.191600 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214fa91-e31b-43bb-8100-6d9cf85eab92 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:17.192071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214fa91-e31b-43bb-8100-6d9cf85eab92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:17.193251 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214fa91-e31b-43bb-8100-6d9cf85eab92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:17.194729 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214fa91-e31b-43bb-8100-6d9cf85eab92 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:17.219456 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 487/972] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 23 01:52:17 2022] POST /identity/v3/endpoints => generated 349 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 01:52:17.287839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beca7cb-0b39-4e6a-a747-f58ce1922cee None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:17.336317 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6981ee-7eab-4f8a-a5e7-f335dc738269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:17.337266 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6981ee-7eab-4f8a-a5e7-f335dc738269 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:17.337565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6981ee-7eab-4f8a-a5e7-f335dc738269 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:17.337843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6981ee-7eab-4f8a-a5e7-f335dc738269 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:17.346662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:17.352343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6981ee-7eab-4f8a-a5e7-f335dc738269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:17.353838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6981ee-7eab-4f8a-a5e7-f335dc738269 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:17.374142 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-ea6981ee-7eab-4f8a-a5e7-f335dc738269 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:17.374142 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:17.374142 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:17.374142 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:17.374142 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:17.374142 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:17.374142 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:17.374142 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:17.374142 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:17.374142 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:17.374142 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:17.374142 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:17.374142 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:52:17.374142 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:52:17.374142 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:52:17.375781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:52:17.375781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:17.375781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:17.375781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:17.375781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:17.375781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:17.375781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:17.375781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:17.375781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:17.375781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:17.375781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:17.375781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:17.375781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:17.375781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:17.375781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:17.375781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:17.375781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:17.376848 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:52:17.376848 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:52:17.376848 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:17.376848 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:17.376848 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 486/973] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:52:17.383705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214fa91-e31b-43bb-8100-6d9cf85eab92 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:17.437619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:17.496850 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214fa91-e31b-43bb-8100-6d9cf85eab92 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:17.531376 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b6a41-4226-43a5-bcb7-abf138be3501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:17.532085 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b6a41-4226-43a5-bcb7-abf138be3501 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:17.532366 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b6a41-4226-43a5-bcb7-abf138be3501 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:17.532643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b6a41-4226-43a5-bcb7-abf138be3501 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:17.533488 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b6a41-4226-43a5-bcb7-abf138be3501 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:17.533815 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b6a41-4226-43a5-bcb7-abf138be3501 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:17.535205 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b6a41-4226-43a5-bcb7-abf138be3501 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:17.551570 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 488/974] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:17.553478 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6981ee-7eab-4f8a-a5e7-f335dc738269 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:17.658420 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6981ee-7eab-4f8a-a5e7-f335dc738269 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:17.665372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af6ddc-4739-4fbe-a31b-1fbcbe5ce4f0 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:17.665625 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af6ddc-4739-4fbe-a31b-1fbcbe5ce4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:17.665909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af6ddc-4739-4fbe-a31b-1fbcbe5ce4f0 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:17.667450 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 489/975] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:52:17.672262 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5434a-ab44-4221-be24-4eb2e7c30bc8 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:17.672688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5434a-ab44-4221-be24-4eb2e7c30bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:17.672968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5434a-ab44-4221-be24-4eb2e7c30bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:17.692017 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-52b5434a-ab44-4221-be24-4eb2e7c30bc8 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:17.693497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-52b5434a-ab44-4221-be24-4eb2e7c30bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:17.701170 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70caf1c2-6507-4c7d-b63a-4e7d1333287e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:17.702528 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70caf1c2-6507-4c7d-b63a-4e7d1333287e None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:17.702814 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70caf1c2-6507-4c7d-b63a-4e7d1333287e None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:17.703091 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70caf1c2-6507-4c7d-b63a-4e7d1333287e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:17.712396 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70caf1c2-6507-4c7d-b63a-4e7d1333287e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:17.713857 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70caf1c2-6507-4c7d-b63a-4e7d1333287e None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:17.730620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-70caf1c2-6507-4c7d-b63a-4e7d1333287e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 01:52:17.730620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:17.730620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:17.730620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:17.730620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:17.730620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:17.730620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:17.730620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:17.730620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:17.730620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:17.730620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:17.730620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:17.730620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:52:17.730620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:52:17.730620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:52:17.730620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:52:17.731640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:17.731640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:17.731640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:52:17.731640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:52:17.731640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:52:17.731640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:52:17.731640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:17.731640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:17.731640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:17.731640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:17.731640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:17.731640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:17.731640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:17.731640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:17.731640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:17.731640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:17.731640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:17.731640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:17.732597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:17.732597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:17.732597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:52:17.732597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:52:17.732597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:52:17.732597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:52:17.732597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:52:17.732597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:52:17.732597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 01:52:17.732597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:17.732597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 487/976] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 23 01:52:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:17.738146 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70caf1c2-6507-4c7d-b63a-4e7d1333287e None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:17.767062 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 490/977] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 01:52:17.790881 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5434a-ab44-4221-be24-4eb2e7c30bc8 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:17.800805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:17.831600 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:17.857103 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70caf1c2-6507-4c7d-b63a-4e7d1333287e None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:17.898776 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be49630-266c-4c9b-bb06-7c71b5bed445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:17.899456 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be49630-266c-4c9b-bb06-7c71b5bed445 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:17.899753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be49630-266c-4c9b-bb06-7c71b5bed445 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:17.900175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be49630-266c-4c9b-bb06-7c71b5bed445 None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:17.900843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be49630-266c-4c9b-bb06-7c71b5bed445 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:17.901147 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be49630-266c-4c9b-bb06-7c71b5bed445 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:17.902582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be49630-266c-4c9b-bb06-7c71b5bed445 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:17.902943 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5434a-ab44-4221-be24-4eb2e7c30bc8 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:17.921363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 488/978] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Jun 23 01:52:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:17.927227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be49630-266c-4c9b-bb06-7c71b5bed445 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:17.949963 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a9a55-0cd0-4d5f-90cf-8be16193dbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:17.950864 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a9a55-0cd0-4d5f-90cf-8be16193dbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:17.951213 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a9a55-0cd0-4d5f-90cf-8be16193dbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:17.951586 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a9a55-0cd0-4d5f-90cf-8be16193dbf2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:17.952317 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a9a55-0cd0-4d5f-90cf-8be16193dbf2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:17.953779 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a9a55-0cd0-4d5f-90cf-8be16193dbf2 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:17.966443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-2f0a9a55-0cd0-4d5f-90cf-8be16193dbf2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 01:52:17.966443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:17.966443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:52:17.966443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:52:17.966443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:52:17.966443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:52:17.966443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:52:17.966443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:17.966443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 01:52:17.966443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:17.966443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:52:17.966443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:17.966443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:17.966443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:17.966443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:17.966443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:17.966443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:17.967512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:17.967512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:17.967512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:17.967512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:17.967512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:17.967512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:17.967512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:52:17.967512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:52:17.967512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:52:17.967512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:52:17.967512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:17.967512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:17.967512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:17.967512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:17.967512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:17.967512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:17.968409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:17.968409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:17.968409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:17.968409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:17.968409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:17.968409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:17.968409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:17.968409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:17.968409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:17.968409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:17.968409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:52:17.968409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:17.968409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 01:52:17.968409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:17.968409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 491/979] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:52:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:17.973468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a9a55-0cd0-4d5f-90cf-8be16193dbf2 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:18.032865 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be49630-266c-4c9b-bb06-7c71b5bed445 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:18.042079 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:18.068343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d72b3e-0406-4c5b-849e-3f7b2788d935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:18.069007 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d72b3e-0406-4c5b-849e-3f7b2788d935 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:18.069290 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d72b3e-0406-4c5b-849e-3f7b2788d935 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:18.069569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d72b3e-0406-4c5b-849e-3f7b2788d935 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:18.077822 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:18.082681 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a9a55-0cd0-4d5f-90cf-8be16193dbf2 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:18.118876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6319f62-0b44-4fd8-b219-0935c3273cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:18.119722 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6319f62-0b44-4fd8-b219-0935c3273cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:18.120046 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6319f62-0b44-4fd8-b219-0935c3273cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:18.120421 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6319f62-0b44-4fd8-b219-0935c3273cc0 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:18.121129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6319f62-0b44-4fd8-b219-0935c3273cc0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:18.121434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6319f62-0b44-4fd8-b219-0935c3273cc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:18.122933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6319f62-0b44-4fd8-b219-0935c3273cc0 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:18.134842 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 492/980] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 01:52:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:18.136057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6319f62-0b44-4fd8-b219-0935c3273cc0 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:18.149844 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d72b3e-0406-4c5b-849e-3f7b2788d935 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:18.151378 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d72b3e-0406-4c5b-849e-3f7b2788d935 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:18.238996 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6319f62-0b44-4fd8-b219-0935c3273cc0 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:18.254407 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 489/981] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:52:17 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 01:52:18.260083 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d72b3e-0406-4c5b-849e-3f7b2788d935 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:18.269643 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:18.279488 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88379c2f-caee-46b1-983f-67e915c4ab97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:18.280168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88379c2f-caee-46b1-983f-67e915c4ab97 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:18.280450 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88379c2f-caee-46b1-983f-67e915c4ab97 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:18.280721 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88379c2f-caee-46b1-983f-67e915c4ab97 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:18.281425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88379c2f-caee-46b1-983f-67e915c4ab97 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:18.281729 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88379c2f-caee-46b1-983f-67e915c4ab97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:18.283106 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88379c2f-caee-46b1-983f-67e915c4ab97 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:18.288208 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 493/982] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 01:52:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:18.293800 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88379c2f-caee-46b1-983f-67e915c4ab97 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:18.324133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:18.374519 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d72b3e-0406-4c5b-849e-3f7b2788d935 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:18.405935 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88379c2f-caee-46b1-983f-67e915c4ab97 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:18.410922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c86a5-d68a-4241-b5f2-2af39a58d1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:18.411760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c86a5-d68a-4241-b5f2-2af39a58d1fd None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:18.412043 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c86a5-d68a-4241-b5f2-2af39a58d1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:18.412318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c86a5-d68a-4241-b5f2-2af39a58d1fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:18.423729 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c86a5-d68a-4241-b5f2-2af39a58d1fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:18.425355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c86a5-d68a-4241-b5f2-2af39a58d1fd None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:18.442213 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3fc0c-7171-4ded-8a3b-7885fc004bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:18.442884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3fc0c-7171-4ded-8a3b-7885fc004bab None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:18.443142 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3fc0c-7171-4ded-8a3b-7885fc004bab None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:18.443446 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3fc0c-7171-4ded-8a3b-7885fc004bab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:18.444054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-8a0c86a5-d68a-4241-b5f2-2af39a58d1fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:18.444054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:18.444054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:18.444054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:18.444054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:18.444054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:18.444054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:18.444054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:18.444054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:18.444054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:18.444054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:18.444054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:18.444054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:52:18.444054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:52:18.444054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:52:18.444944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:52:18.444944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:18.444944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:18.444944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:18.444944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:18.444944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:18.444944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:18.444944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:18.444944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:18.444944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:18.444944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:18.444944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:18.444944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:18.444944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:18.444944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:18.444944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:18.444944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:18.446127 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:52:18.446127 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:52:18.446127 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:18.446127 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:18.446661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3fc0c-7171-4ded-8a3b-7885fc004bab None admin] RBAC: Adding query filter params (interface=public, service_id=612bcb35142d4915b2f022023fa58eec, region_id=RegionOne) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:18.446661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3fc0c-7171-4ded-8a3b-7885fc004bab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:18.446824 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 490/983] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:52:18.448160 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3fc0c-7171-4ded-8a3b-7885fc004bab None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:18.450690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c86a5-d68a-4241-b5f2-2af39a58d1fd None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:18.453828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 494/984] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Jun 23 01:52:18 2022] GET /identity/v3/endpoints?service_id=612bcb35142d4915b2f022023fa58eec&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:18.461066 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3fc0c-7171-4ded-8a3b-7885fc004bab None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:18.522039 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:18.564213 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:18.574595 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c86a5-d68a-4241-b5f2-2af39a58d1fd None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:18.579019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3fc0c-7171-4ded-8a3b-7885fc004bab None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:18.614932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d026dac-3d1b-4e89-90d7-70ec35c601d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:18.615762 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d026dac-3d1b-4e89-90d7-70ec35c601d2 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:18.616042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d026dac-3d1b-4e89-90d7-70ec35c601d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:18.616325 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d026dac-3d1b-4e89-90d7-70ec35c601d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:18.617221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d026dac-3d1b-4e89-90d7-70ec35c601d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:18.617548 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c792d-56f3-4fa0-a4a3-1a425f2bdfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:18.617663 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d026dac-3d1b-4e89-90d7-70ec35c601d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:18.618224 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c792d-56f3-4fa0-a4a3-1a425f2bdfb4 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:18.618533 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c792d-56f3-4fa0-a4a3-1a425f2bdfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:18.618811 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c792d-56f3-4fa0-a4a3-1a425f2bdfb4 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:18.618962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d026dac-3d1b-4e89-90d7-70ec35c601d2 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:18.619522 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c792d-56f3-4fa0-a4a3-1a425f2bdfb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:18.620902 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c792d-56f3-4fa0-a4a3-1a425f2bdfb4 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:18.628102 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 495/985] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 23 01:52:18 2022] GET /identity/v3/services => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 01:52:18.636614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 491/986] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:18.638002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c792d-56f3-4fa0-a4a3-1a425f2bdfb4 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:18.759181 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c792d-56f3-4fa0-a4a3-1a425f2bdfb4 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:18.799005 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055de16-c50e-4d0c-ae76-dc1d9e49b45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:18.799883 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055de16-c50e-4d0c-ae76-dc1d9e49b45b None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:18.800146 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055de16-c50e-4d0c-ae76-dc1d9e49b45b None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:18.800419 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055de16-c50e-4d0c-ae76-dc1d9e49b45b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:18.807920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055de16-c50e-4d0c-ae76-dc1d9e49b45b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:18.809367 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055de16-c50e-4d0c-ae76-dc1d9e49b45b None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:18.824923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-9055de16-c50e-4d0c-ae76-dc1d9e49b45b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:52:18.824923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:18.824923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:18.824923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:18.824923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:18.824923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:18.824923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:18.824923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:18.824923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:18.824923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:18.824923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:18.824923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:18.824923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:52:18.824923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:52:18.824923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:52:18.825863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:52:18.825863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:18.825863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:18.825863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:18.825863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:18.825863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:18.825863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:18.825863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:18.825863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:18.825863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:18.825863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:18.825863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:18.825863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:18.825863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:18.825863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:18.825863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:18.825863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:18.826808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:52:18.826808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:52:18.826808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:52:18.826808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:52:18.826808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:52:18.826808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:52:18.826808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:52:18.826808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:18.826808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 496/987] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:52:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:18.836604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d026dac-3d1b-4e89-90d7-70ec35c601d2 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:18.952597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d026dac-3d1b-4e89-90d7-70ec35c601d2 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:18.973203 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:18.989369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23acd2-1862-43d9-a608-adf5843479d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:18.990039 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23acd2-1862-43d9-a608-adf5843479d1 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:18.990322 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23acd2-1862-43d9-a608-adf5843479d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:18.990599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23acd2-1862-43d9-a608-adf5843479d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:18.991395 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23acd2-1862-43d9-a608-adf5843479d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:18.991732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23acd2-1862-43d9-a608-adf5843479d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:18.993177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23acd2-1862-43d9-a608-adf5843479d1 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:19.006335 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 492/988] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:52:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:19.012220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055de16-c50e-4d0c-ae76-dc1d9e49b45b None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:19.030163 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:19.131898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055de16-c50e-4d0c-ae76-dc1d9e49b45b None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:19.167311 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6103e7-1480-4c21-b4c6-6ffcd0742fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:19.167991 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6103e7-1480-4c21-b4c6-6ffcd0742fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:19.168281 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6103e7-1480-4c21-b4c6-6ffcd0742fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:19.168553 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6103e7-1480-4c21-b4c6-6ffcd0742fa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:19.169379 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6103e7-1480-4c21-b4c6-6ffcd0742fa2 None admin] RBAC: Adding query filter params (role.id=9c41853f063c46f988b072a76610c245, scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018, user.id=0dbf596d8f964d4695944a23dd8e4cef) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:19.169698 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6103e7-1480-4c21-b4c6-6ffcd0742fa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:19.171127 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6103e7-1480-4c21-b4c6-6ffcd0742fa2 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:19.177957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 497/989] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:52:19 2022] GET /identity/v3/role_assignments?user.id=0dbf596d8f964d4695944a23dd8e4cef&scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018&role.id=9c41853f063c46f988b072a76610c245 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:19.281480 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7546f-c7d6-4666-b528-9a314152b109 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:19.281843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7546f-c7d6-4666-b528-9a314152b109 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:19.282062 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7546f-c7d6-4666-b528-9a314152b109 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:19.284050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 493/990] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:19.290315 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662e35a-ab85-4ae7-9c42-367dbb4467d8 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:19.290620 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662e35a-ab85-4ae7-9c42-367dbb4467d8 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:19.290915 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662e35a-ab85-4ae7-9c42-367dbb4467d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:19.310594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-2662e35a-ab85-4ae7-9c42-367dbb4467d8 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:19.311883 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-2662e35a-ab85-4ae7-9c42-367dbb4467d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:19.396926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 498/991] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:19.420170 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7546f-c7d6-4666-b528-9a314152b109 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:19.530263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7546f-c7d6-4666-b528-9a314152b109 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:19.567721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fb1bd-d904-4acb-ac71-4afb2f24c48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:19.568546 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fb1bd-d904-4acb-ac71-4afb2f24c48d None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:19.568821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fb1bd-d904-4acb-ac71-4afb2f24c48d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:19.569090 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fb1bd-d904-4acb-ac71-4afb2f24c48d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:19.569743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fb1bd-d904-4acb-ac71-4afb2f24c48d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:19.571108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fb1bd-d904-4acb-ac71-4afb2f24c48d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:19.583296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-4b9fb1bd-d904-4acb-ac71-4afb2f24c48d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 01:52:19.583296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:19.583296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:52:19.583296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:52:19.583296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:52:19.583296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:52:19.583296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:52:19.583296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:19.583296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 01:52:19.583296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:19.583296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:52:19.583296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:19.583296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:19.583296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:19.583296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:19.583296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:19.583296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:19.584340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:19.584340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:19.584340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:19.584340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:19.584340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:19.584340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:19.584340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:52:19.584340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:52:19.584340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:52:19.584340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:52:19.584340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:19.584340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:19.584340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:19.584340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:19.584340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:19.584340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:19.585589 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:19.585589 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:19.585589 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:19.585589 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:19.585589 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:19.585589 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:19.585589 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:19.585589 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:19.585589 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:19.585589 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:19.585589 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:52:19.585589 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:19.585589 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 01:52:19.585589 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:19.586827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 494/992] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 23 01:52:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:19.590677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662e35a-ab85-4ae7-9c42-367dbb4467d8 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:19.601749 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:19.697355 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662e35a-ab85-4ae7-9c42-367dbb4467d8 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:19.732046 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fff72-5259-435a-8065-ccc9369b01f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:19.732723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fff72-5259-435a-8065-ccc9369b01f9 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:19.733000 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fff72-5259-435a-8065-ccc9369b01f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:19.733269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fff72-5259-435a-8065-ccc9369b01f9 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:19.734008 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560fff72-5259-435a-8065-ccc9369b01f9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:19.734299 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560fff72-5259-435a-8065-ccc9369b01f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:19.735704 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560fff72-5259-435a-8065-ccc9369b01f9 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:19.741391 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 499/993] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 23 01:52:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:19.746994 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fb1bd-d904-4acb-ac71-4afb2f24c48d None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:19.794821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:19.852976 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fb1bd-d904-4acb-ac71-4afb2f24c48d None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:19.888315 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c50d4f-76ae-4bf1-96e6-7998ff9986cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:19.888979 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c50d4f-76ae-4bf1-96e6-7998ff9986cb None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:19.889259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c50d4f-76ae-4bf1-96e6-7998ff9986cb None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:19.889533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c50d4f-76ae-4bf1-96e6-7998ff9986cb None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:19.890234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c50d4f-76ae-4bf1-96e6-7998ff9986cb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:19.890538 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c50d4f-76ae-4bf1-96e6-7998ff9986cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:19.891936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c50d4f-76ae-4bf1-96e6-7998ff9986cb None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:19.897065 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 495/994] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 23 01:52:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:19.902867 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fff72-5259-435a-8065-ccc9369b01f9 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:19.979568 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:20.010182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fff72-5259-435a-8065-ccc9369b01f9 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:20.045418 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba061bf-5ffb-4428-9959-c785baff7ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:20.046015 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba061bf-5ffb-4428-9959-c785baff7ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:20.046295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba061bf-5ffb-4428-9959-c785baff7ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:20.046564 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba061bf-5ffb-4428-9959-c785baff7ec9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:20.047360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba061bf-5ffb-4428-9959-c785baff7ec9 None admin] RBAC: Adding query filter params (interface=admin, service_id=281583e0f62e406d8ac2ba8472ac2181, region_id=RegionOne) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:20.047697 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba061bf-5ffb-4428-9959-c785baff7ec9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:20.049122 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba061bf-5ffb-4428-9959-c785baff7ec9 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:20.054619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 500/995] 10.222.0.13 () {56 vars in 1249 bytes} [Thu Jun 23 01:52:19 2022] GET /identity/v3/endpoints?service_id=281583e0f62e406d8ac2ba8472ac2181&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:20.060532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c50d4f-76ae-4bf1-96e6-7998ff9986cb None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:20.164477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c50d4f-76ae-4bf1-96e6-7998ff9986cb None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:20.173823 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:20.201455 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da451d-704e-41ce-b6c3-ff1868ebeba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:20.202122 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da451d-704e-41ce-b6c3-ff1868ebeba3 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:20.202397 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da451d-704e-41ce-b6c3-ff1868ebeba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:20.202668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da451d-704e-41ce-b6c3-ff1868ebeba3 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:20.203353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da451d-704e-41ce-b6c3-ff1868ebeba3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:20.204750 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da451d-704e-41ce-b6c3-ff1868ebeba3 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:20.216365 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 496/996] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 23 01:52:20 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 01:52:20.738471 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b82c7f-1d24-43db-9d61-6776f2631641 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:20.739024 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b82c7f-1d24-43db-9d61-6776f2631641 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:20.739139 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b82c7f-1d24-43db-9d61-6776f2631641 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:20.740516 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 501/997] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:20.746110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87168a-e0de-469c-9c2e-bad6a07679ed None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:20.746540 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87168a-e0de-469c-9c2e-bad6a07679ed None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:20.746641 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87168a-e0de-469c-9c2e-bad6a07679ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:20.764048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-2d87168a-e0de-469c-9c2e-bad6a07679ed None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:20.765239 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-2d87168a-e0de-469c-9c2e-bad6a07679ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:20.836682 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 497/998] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:20 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:20.859750 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b82c7f-1d24-43db-9d61-6776f2631641 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:20.977714 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b82c7f-1d24-43db-9d61-6776f2631641 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:21.014079 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45924e-91aa-438d-aa83-4d06d6e46ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:21.014833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45924e-91aa-438d-aa83-4d06d6e46ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:21.015114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45924e-91aa-438d-aa83-4d06d6e46ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:21.015385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45924e-91aa-438d-aa83-4d06d6e46ad2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:21.016077 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45924e-91aa-438d-aa83-4d06d6e46ad2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:21.017462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45924e-91aa-438d-aa83-4d06d6e46ad2 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:21.020751 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:21.031282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-9e45924e-91aa-438d-aa83-4d06d6e46ad2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 01:52:21.031282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:21.031282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:52:21.031282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:52:21.031282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:52:21.031282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:52:21.031282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:52:21.031282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:21.031282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 01:52:21.031282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:21.031282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:52:21.031282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:21.031282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:21.031282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:21.031282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:21.031282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:21.031282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:21.032439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:21.032439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:21.032439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:21.032439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:21.032439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:21.032439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:21.032439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:52:21.032439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:52:21.032439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:52:21.032439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:52:21.032439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:21.032439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:21.032439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:21.032439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:21.032439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:21.032439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:21.038378 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:21.038378 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:21.038378 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:21.038378 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:21.038378 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:21.038378 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:21.038378 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:21.038378 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:21.038378 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:21.038378 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:21.038378 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:52:21.038378 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:21.038378 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 01:52:21.038378 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:21.038378 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 502/999] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:52:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:21.039195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87168a-e0de-469c-9c2e-bad6a07679ed None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:21.144042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87168a-e0de-469c-9c2e-bad6a07679ed None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:21.145732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:21.181001 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a15f22-6eab-4625-aa75-f703990c8183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:21.181687 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a15f22-6eab-4625-aa75-f703990c8183 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:21.181971 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a15f22-6eab-4625-aa75-f703990c8183 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:21.182252 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a15f22-6eab-4625-aa75-f703990c8183 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:21.182972 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a15f22-6eab-4625-aa75-f703990c8183 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:21.183282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a15f22-6eab-4625-aa75-f703990c8183 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:21.184702 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a15f22-6eab-4625-aa75-f703990c8183 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:21.190453 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 498/1000] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 01:52:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:21.196070 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45924e-91aa-438d-aa83-4d06d6e46ad2 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:21.245626 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a382ae-899c-4aae-8dc6-bc1cef7d7d58 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:21.245902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a382ae-899c-4aae-8dc6-bc1cef7d7d58 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:21.246180 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a382ae-899c-4aae-8dc6-bc1cef7d7d58 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:21.247707 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 499/1001] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:52:21.252521 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf103892-4819-4306-b1e6-e6e49ee30a25 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:21.252778 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf103892-4819-4306-b1e6-e6e49ee30a25 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:21.253049 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf103892-4819-4306-b1e6-e6e49ee30a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:21.269760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-cf103892-4819-4306-b1e6-e6e49ee30a25 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:21.270869 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-cf103892-4819-4306-b1e6-e6e49ee30a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:21.302417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45924e-91aa-438d-aa83-4d06d6e46ad2 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:21.339876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8b5b8-4bd6-41d6-a408-d67878b2bf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:21.340552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8b5b8-4bd6-41d6-a408-d67878b2bf7f None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:21.340844 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8b5b8-4bd6-41d6-a408-d67878b2bf7f None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:21.341109 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8b5b8-4bd6-41d6-a408-d67878b2bf7f None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:21.341856 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8b5b8-4bd6-41d6-a408-d67878b2bf7f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:21.342128 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8b5b8-4bd6-41d6-a408-d67878b2bf7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:21.343549 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8b5b8-4bd6-41d6-a408-d67878b2bf7f None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:21.347031 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 500/1002] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 01:52:21.349436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 503/1003] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 23 01:52:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:21.356544 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf103892-4819-4306-b1e6-e6e49ee30a25 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:21.369095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8b5b8-4bd6-41d6-a408-d67878b2bf7f None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:21.439698 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:21.457618 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:21.464233 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf103892-4819-4306-b1e6-e6e49ee30a25 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:21.481650 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8b5b8-4bd6-41d6-a408-d67878b2bf7f None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:21.501005 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013a374-b30d-491b-9004-019dbcd68c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:21.502487 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013a374-b30d-491b-9004-019dbcd68c41 None admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:21.502923 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013a374-b30d-491b-9004-019dbcd68c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:21.503650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013a374-b30d-491b-9004-019dbcd68c41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:21.504681 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013a374-b30d-491b-9004-019dbcd68c41 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:21.506796 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013a374-b30d-491b-9004-019dbcd68c41 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:21.515652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c681c-f48e-401e-a043-ce59531d2d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:21.516457 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c681c-f48e-401e-a043-ce59531d2d7a None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:21.516741 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c681c-f48e-401e-a043-ce59531d2d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:21.517016 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c681c-f48e-401e-a043-ce59531d2d7a None admin] PATH_INFO: `/v3/services/image` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:21.517722 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c681c-f48e-401e-a043-ce59531d2d7a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:21.519150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c681c-f48e-401e-a043-ce59531d2d7a None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:21.531351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 501/1004] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 23 01:52:21 2022] POST /identity/v3/endpoints => generated 334 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:52:21.532593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-b98c681c-f48e-401e-a043-ce59531d2d7a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 01:52:21.532593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:21.532593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:52:21.532593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:52:21.532593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:52:21.532593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:52:21.532593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:52:21.532593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:21.532593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 01:52:21.532593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:21.532593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:52:21.532593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:21.532593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:21.532593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:21.532593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:21.532593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:21.532593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:21.533671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:21.533671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:21.533671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:21.533671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:21.533671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:21.533671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:21.533671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:52:21.533671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:52:21.533671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:52:21.533671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:52:21.533671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:21.533671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:21.533671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:21.533671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:21.533671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:21.533671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:21.534553 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:21.534553 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:21.534553 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:21.534553 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:21.534553 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:21.534553 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:21.534553 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:21.534553 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:21.534553 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:21.534553 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:21.534553 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:52:21.534553 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:21.534553 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 01:52:21.534553 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:21.538989 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 504/1005] 10.222.0.13 () {56 vars in 1105 bytes} [Thu Jun 23 01:52:21 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:52:21.540281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013a374-b30d-491b-9004-019dbcd68c41 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:21.668520 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013a374-b30d-491b-9004-019dbcd68c41 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:21.708114 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dc60c-30ff-4b9f-8a0d-3d03a8c559a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:21.708822 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dc60c-30ff-4b9f-8a0d-3d03a8c559a9 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:21.709109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dc60c-30ff-4b9f-8a0d-3d03a8c559a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:21.709376 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dc60c-30ff-4b9f-8a0d-3d03a8c559a9 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:21.710099 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dc60c-30ff-4b9f-8a0d-3d03a8c559a9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:21.710412 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dc60c-30ff-4b9f-8a0d-3d03a8c559a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:21.711917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dc60c-30ff-4b9f-8a0d-3d03a8c559a9 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:21.717393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 502/1006] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:21.724008 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c681c-f48e-401e-a043-ce59531d2d7a None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:21.833686 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c681c-f48e-401e-a043-ce59531d2d7a None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:21.860504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:21.869611 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c176d-fe28-4c61-a698-5a5b81a70930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:21.870278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c176d-fe28-4c61-a698-5a5b81a70930 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:21.870558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c176d-fe28-4c61-a698-5a5b81a70930 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:21.870830 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c176d-fe28-4c61-a698-5a5b81a70930 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:21.871561 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c176d-fe28-4c61-a698-5a5b81a70930 None admin] RBAC: Adding query filter params (type=image) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:21.871866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c176d-fe28-4c61-a698-5a5b81a70930 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:21.873236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c176d-fe28-4c61-a698-5a5b81a70930 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:21.878349 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 505/1007] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:21 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:22.238884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa112f-91f8-4d50-9664-3c03a999e4ee None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:22.239403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa112f-91f8-4d50-9664-3c03a999e4ee None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:22.239403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa112f-91f8-4d50-9664-3c03a999e4ee None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:22.240860 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 503/1008] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:22.246175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2db075-a13a-48a5-931a-8ee22dacc179 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:22.246430 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2db075-a13a-48a5-931a-8ee22dacc179 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:22.246738 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2db075-a13a-48a5-931a-8ee22dacc179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:22.264518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-ed2db075-a13a-48a5-931a-8ee22dacc179 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:22.265706 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-ed2db075-a13a-48a5-931a-8ee22dacc179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:22.338078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 506/1009] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:22 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:22.360915 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa112f-91f8-4d50-9664-3c03a999e4ee None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:22.376700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:22.480677 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa112f-91f8-4d50-9664-3c03a999e4ee None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:22.517309 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc29cf3-23bb-45c1-b48d-b447b901ab8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:22.518197 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc29cf3-23bb-45c1-b48d-b447b901ab8b None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:22.518388 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc29cf3-23bb-45c1-b48d-b447b901ab8b None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:22.518641 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc29cf3-23bb-45c1-b48d-b447b901ab8b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:22.519322 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc29cf3-23bb-45c1-b48d-b447b901ab8b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:22.520731 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc29cf3-23bb-45c1-b48d-b447b901ab8b None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:22.533008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-3cc29cf3-23bb-45c1-b48d-b447b901ab8b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 01:52:22.533008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:22.533008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:52:22.533008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:52:22.533008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:52:22.533008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:52:22.533008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:52:22.533008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:22.533008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 01:52:22.533008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:22.533008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:52:22.533008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:22.533008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:22.533008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:22.533008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:22.533008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:22.533008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:22.534048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:22.534048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:22.534048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:22.534048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:22.534048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:22.534048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:22.534048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:52:22.534048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:52:22.534048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:52:22.534048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:52:22.534048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:22.534048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:22.534048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:22.534048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:22.534048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:22.534048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:22.539834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:22.539834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:22.539834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:22.539834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:22.539834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:22.539834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:22.539834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:22.539834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:22.539834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:22.539834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:22.539834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:52:22.539834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:22.539834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 01:52:22.539834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:22.539834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 504/1010] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 23 01:52:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:22.542363 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2db075-a13a-48a5-931a-8ee22dacc179 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:22.646531 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2db075-a13a-48a5-931a-8ee22dacc179 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:22.669072 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:22.681945 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4215db-1621-4c7a-9fab-3f9bb903d36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:22.682614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4215db-1621-4c7a-9fab-3f9bb903d36e None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:22.682891 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4215db-1621-4c7a-9fab-3f9bb903d36e None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:22.683166 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4215db-1621-4c7a-9fab-3f9bb903d36e None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:22.683912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4215db-1621-4c7a-9fab-3f9bb903d36e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:22.684217 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4215db-1621-4c7a-9fab-3f9bb903d36e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:22.685926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4215db-1621-4c7a-9fab-3f9bb903d36e None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:22.690948 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 507/1011] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 23 01:52:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:22.699482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc29cf3-23bb-45c1-b48d-b447b901ab8b None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:22.777969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:22.804817 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc29cf3-23bb-45c1-b48d-b447b901ab8b None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:22.839723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e222022-00ac-4987-98aa-16c57a852592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:22.840398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e222022-00ac-4987-98aa-16c57a852592 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:22.840678 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e222022-00ac-4987-98aa-16c57a852592 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:22.841054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e222022-00ac-4987-98aa-16c57a852592 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:22.841777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e222022-00ac-4987-98aa-16c57a852592 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:22.842090 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e222022-00ac-4987-98aa-16c57a852592 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:22.843483 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e222022-00ac-4987-98aa-16c57a852592 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:22.848763 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 505/1012] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 23 01:52:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:22.854246 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4215db-1621-4c7a-9fab-3f9bb903d36e None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:22.963436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4215db-1621-4c7a-9fab-3f9bb903d36e None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:23.000906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b50454-90db-4ae2-8a31-2254e3ca09b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:23.001577 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b50454-90db-4ae2-8a31-2254e3ca09b5 None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:23.001858 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b50454-90db-4ae2-8a31-2254e3ca09b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:23.002393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b50454-90db-4ae2-8a31-2254e3ca09b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:23.003157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b50454-90db-4ae2-8a31-2254e3ca09b5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:23.004580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b50454-90db-4ae2-8a31-2254e3ca09b5 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:23.020038 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 508/1013] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 23 01:52:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:52:23.659783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468ebdc-36bb-4ee5-9b1e-08a986cde2b8 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:23.660333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468ebdc-36bb-4ee5-9b1e-08a986cde2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:23.660333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468ebdc-36bb-4ee5-9b1e-08a986cde2b8 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:23.661876 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 506/1014] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:23.667134 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3db98-063d-4088-99a1-1455e9116f73 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:23.667379 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3db98-063d-4088-99a1-1455e9116f73 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:23.667706 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3db98-063d-4088-99a1-1455e9116f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:23.684777 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-9ce3db98-063d-4088-99a1-1455e9116f73 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:23.686276 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-9ce3db98-063d-4088-99a1-1455e9116f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:23.732844 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:23.774809 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 509/1015] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:23 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:23.798459 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468ebdc-36bb-4ee5-9b1e-08a986cde2b8 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:23.892785 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f397c04-df08-446b-bba3-0a4750fddf19 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:23.893353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f397c04-df08-446b-bba3-0a4750fddf19 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:23.893353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f397c04-df08-446b-bba3-0a4750fddf19 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:23.895446 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 510/1016] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:23.900483 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892a3e7-ff82-4c67-86e2-bc6007bddb80 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:23.900922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892a3e7-ff82-4c67-86e2-bc6007bddb80 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:23.901200 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892a3e7-ff82-4c67-86e2-bc6007bddb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:23.920663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-d892a3e7-ff82-4c67-86e2-bc6007bddb80 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:23.921622 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468ebdc-36bb-4ee5-9b1e-08a986cde2b8 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:23.921752 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-d892a3e7-ff82-4c67-86e2-bc6007bddb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:23.957061 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15321a78-b2b7-431c-a393-cc29979dd170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:23.957881 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15321a78-b2b7-431c-a393-cc29979dd170 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:23.958161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15321a78-b2b7-431c-a393-cc29979dd170 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:23.958441 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15321a78-b2b7-431c-a393-cc29979dd170 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:23.966428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:23.969596 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15321a78-b2b7-431c-a393-cc29979dd170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:52:23.979327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-15321a78-b2b7-431c-a393-cc29979dd170 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 01:52:23.979327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:23.979327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:23.979327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:23.979327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:23.979327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:23.979327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:23.979327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:23.979327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:23.979327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:23.979327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:23.979327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:23.979327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:52:23.979327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:52:23.979327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:52:23.979327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:52:23.980304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:52:23.980304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:52:23.980304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:52:23.980304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:52:23.980304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:23.980304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:23.980304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:23.980304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:23.980304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:23.980304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:23.980304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:23.980304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:23.980304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:23.980304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:23.980304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:23.980304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:23.981221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:23.981221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:23.981221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:23.981221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:23.981221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:52:23.981221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:52:23.981221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:52:23.981221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:52:23.981221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:52:23.981221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:52:23.981221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 01:52:23.981221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:23.981221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 507/1017] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Jun 23 01:52:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:23.988236 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15321a78-b2b7-431c-a393-cc29979dd170 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:23.999438 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 511/1018] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:23 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:24.019301 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892a3e7-ff82-4c67-86e2-bc6007bddb80 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:24.094396 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15321a78-b2b7-431c-a393-cc29979dd170 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:24.133091 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0805b89-e7b8-4229-ae1c-44bd5ab5b867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:24.134208 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0805b89-e7b8-4229-ae1c-44bd5ab5b867 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:24.134517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0805b89-e7b8-4229-ae1c-44bd5ab5b867 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:24.134930 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0805b89-e7b8-4229-ae1c-44bd5ab5b867 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:24.136658 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0805b89-e7b8-4229-ae1c-44bd5ab5b867 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:24.136975 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0805b89-e7b8-4229-ae1c-44bd5ab5b867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:24.139135 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0805b89-e7b8-4229-ae1c-44bd5ab5b867 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:24.144805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892a3e7-ff82-4c67-86e2-bc6007bddb80 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:24.147246 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:24.152316 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 508/1019] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Jun 23 01:52:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:24.157858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0805b89-e7b8-4229-ae1c-44bd5ab5b867 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:24.198609 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bd980-8f79-42f0-8a18-408e06b53653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:24.199202 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bd980-8f79-42f0-8a18-408e06b53653 None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:24.199512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bd980-8f79-42f0-8a18-408e06b53653 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:24.199791 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bd980-8f79-42f0-8a18-408e06b53653 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:24.200540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bd980-8f79-42f0-8a18-408e06b53653 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:24.201967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bd980-8f79-42f0-8a18-408e06b53653 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:24.217172 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 512/1020] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 01:52:24 2022] POST /identity/v3/services => generated 242 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 01:52:24.228395 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:24.273266 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0805b89-e7b8-4229-ae1c-44bd5ab5b867 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:24.318859 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe24228-3f3e-47c0-92f0-ad2c77ecfdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:24.319765 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe24228-3f3e-47c0-92f0-ad2c77ecfdcc None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:24.320123 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe24228-3f3e-47c0-92f0-ad2c77ecfdcc None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:24.320457 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe24228-3f3e-47c0-92f0-ad2c77ecfdcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:24.332935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe24228-3f3e-47c0-92f0-ad2c77ecfdcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:24.334511 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe24228-3f3e-47c0-92f0-ad2c77ecfdcc None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:24.353124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-dbe24228-3f3e-47c0-92f0-ad2c77ecfdcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:24.353124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:24.353124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:24.353124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:24.353124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:24.353124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:24.353124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:24.353124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:24.353124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:24.353124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:24.353124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:24.353124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:24.353124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:52:24.353124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:52:24.353124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:52:24.354281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:52:24.354281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:24.354281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:24.354281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:24.354281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:24.354281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:24.354281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:24.354281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:24.354281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:24.354281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:24.354281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:24.354281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:24.354281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:24.354281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:24.354281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:24.354281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:24.354281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:24.355437 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:52:24.355437 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:52:24.355437 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:24.355437 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:24.356162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 509/1021] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:52:24.361772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bd980-8f79-42f0-8a18-408e06b53653 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:24.479722 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bd980-8f79-42f0-8a18-408e06b53653 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:24.513557 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea1b95-d140-449d-8b6e-a5c237eba666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:24.514237 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea1b95-d140-449d-8b6e-a5c237eba666 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:24.514558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea1b95-d140-449d-8b6e-a5c237eba666 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:24.514835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea1b95-d140-449d-8b6e-a5c237eba666 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:24.515589 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea1b95-d140-449d-8b6e-a5c237eba666 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:24.515899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea1b95-d140-449d-8b6e-a5c237eba666 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:24.517274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea1b95-d140-449d-8b6e-a5c237eba666 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:24.533887 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 513/1022] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:24.535098 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe24228-3f3e-47c0-92f0-ad2c77ecfdcc None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:24.638554 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe24228-3f3e-47c0-92f0-ad2c77ecfdcc None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:24.649702 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:24.675319 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c7c4c-d823-4180-97b6-94fe473e681f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:24.676171 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c7c4c-d823-4180-97b6-94fe473e681f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:24.676438 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c7c4c-d823-4180-97b6-94fe473e681f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:24.676708 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c7c4c-d823-4180-97b6-94fe473e681f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:24.684741 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c7c4c-d823-4180-97b6-94fe473e681f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:24.686515 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c7c4c-d823-4180-97b6-94fe473e681f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:24.700721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-ee2c7c4c-d823-4180-97b6-94fe473e681f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 01:52:24.700721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:24.700721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:24.700721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:24.700721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:24.700721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:24.700721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:24.700721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:24.700721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:24.700721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:24.700721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:24.700721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:24.700721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:52:24.700721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:52:24.700721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:52:24.700721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:52:24.701783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:24.701783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:24.701783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:52:24.701783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:52:24.701783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:52:24.701783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:52:24.701783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:24.701783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:24.701783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:24.701783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:24.701783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:24.701783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:24.701783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:24.701783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:24.701783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:24.701783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:24.701783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:24.701783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:24.702791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:24.702791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:24.702791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:52:24.702791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:52:24.702791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:52:24.702791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:52:24.702791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:52:24.702791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:52:24.702791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 01:52:24.702791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:24.702791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 510/1023] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 23 01:52:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:52:24.708162 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea1b95-d140-449d-8b6e-a5c237eba666 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:24.733626 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:24.826953 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea1b95-d140-449d-8b6e-a5c237eba666 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:24.862031 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a471a-ec45-4452-8f09-13fd51b77ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:24.862613 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a471a-ec45-4452-8f09-13fd51b77ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:24.862890 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a471a-ec45-4452-8f09-13fd51b77ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:24.863164 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a471a-ec45-4452-8f09-13fd51b77ca0 None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:24.864027 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a471a-ec45-4452-8f09-13fd51b77ca0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:24.864336 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a471a-ec45-4452-8f09-13fd51b77ca0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:24.865773 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a471a-ec45-4452-8f09-13fd51b77ca0 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:24.890827 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 514/1024] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 23 01:52:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:24.892359 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c7c4c-d823-4180-97b6-94fe473e681f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:25.007013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c7c4c-d823-4180-97b6-94fe473e681f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:25.041862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104646e-4736-4a2d-bac1-5c7f86775f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:25.042524 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104646e-4736-4a2d-bac1-5c7f86775f25 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:25.042810 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104646e-4736-4a2d-bac1-5c7f86775f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:25.043086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104646e-4736-4a2d-bac1-5c7f86775f25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:25.084933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:25.085137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3959ae-2b8b-43c2-a80f-52183969e715 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:25.085137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3959ae-2b8b-43c2-a80f-52183969e715 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:25.085881 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3959ae-2b8b-43c2-a80f-52183969e715 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:25.087335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 515/1025] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:25.092839 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd9b6f-e59f-4f66-b756-5940987b72e3 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:25.093125 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd9b6f-e59f-4f66-b756-5940987b72e3 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:25.093400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd9b6f-e59f-4f66-b756-5940987b72e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:25.110557 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-70cd9b6f-e59f-4f66-b756-5940987b72e3 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:25.112438 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-70cd9b6f-e59f-4f66-b756-5940987b72e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:25.114440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104646e-4736-4a2d-bac1-5c7f86775f25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:25.116207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104646e-4736-4a2d-bac1-5c7f86775f25 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:25.181903 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 516/1026] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:25.205952 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd9b6f-e59f-4f66-b756-5940987b72e3 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:25.217505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:25.227585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 511/1027] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:52:24 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 01:52:25.233232 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104646e-4736-4a2d-bac1-5c7f86775f25 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:25.307945 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:25.313708 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd9b6f-e59f-4f66-b756-5940987b72e3 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:25.345339 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104646e-4736-4a2d-bac1-5c7f86775f25 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:25.354586 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05a1fc-d4c2-4d7d-ad27-8b81ff961ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:25.355940 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05a1fc-d4c2-4d7d-ad27-8b81ff961ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:25.356675 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05a1fc-d4c2-4d7d-ad27-8b81ff961ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:25.357345 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05a1fc-d4c2-4d7d-ad27-8b81ff961ec8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:25.358873 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05a1fc-d4c2-4d7d-ad27-8b81ff961ec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:25.361150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05a1fc-d4c2-4d7d-ad27-8b81ff961ec8 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:25.363770 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 517/1028] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:25.369998 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05a1fc-d4c2-4d7d-ad27-8b81ff961ec8 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:25.379715 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3666883-ab90-44ab-adad-bab4f7c37135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:25.380523 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3666883-ab90-44ab-adad-bab4f7c37135 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:25.380798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3666883-ab90-44ab-adad-bab4f7c37135 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:25.381066 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3666883-ab90-44ab-adad-bab4f7c37135 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:25.392524 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3666883-ab90-44ab-adad-bab4f7c37135 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:25.393984 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3666883-ab90-44ab-adad-bab4f7c37135 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:25.411351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-d3666883-ab90-44ab-adad-bab4f7c37135 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:25.411351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:25.411351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:25.411351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:25.411351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:25.411351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:25.411351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:25.411351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:25.411351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:25.411351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:25.411351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:25.411351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:25.411351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:52:25.411351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:52:25.411351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:52:25.412323 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:52:25.412323 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:25.412323 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:25.412323 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:25.412323 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:25.412323 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:25.412323 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:25.412323 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:25.412323 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:25.412323 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:25.412323 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:25.412323 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:25.412323 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:25.412323 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:25.412323 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:25.412323 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:25.412323 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:25.413336 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:52:25.413336 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:52:25.413336 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:25.413336 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:25.413336 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 512/1029] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:52:25.418152 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3666883-ab90-44ab-adad-bab4f7c37135 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:25.455951 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:25.479515 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05a1fc-d4c2-4d7d-ad27-8b81ff961ec8 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:25.516763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f80c1-d39c-4934-abd7-53fc6c593fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:25.517332 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3666883-ab90-44ab-adad-bab4f7c37135 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:25.517444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f80c1-d39c-4934-abd7-53fc6c593fa6 None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:25.517777 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f80c1-d39c-4934-abd7-53fc6c593fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:25.518143 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f80c1-d39c-4934-abd7-53fc6c593fa6 None admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:25.519003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f80c1-d39c-4934-abd7-53fc6c593fa6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:25.520649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f80c1-d39c-4934-abd7-53fc6c593fa6 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:25.539854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:25.558242 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 518/1030] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 01:52:25 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 01:52:25.558461 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cbcf1-08d5-49cb-be28-c1ab5da894cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:25.558461 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cbcf1-08d5-49cb-be28-c1ab5da894cf None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:25.558461 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cbcf1-08d5-49cb-be28-c1ab5da894cf None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:25.558461 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cbcf1-08d5-49cb-be28-c1ab5da894cf None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:25.558805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21cbcf1-08d5-49cb-be28-c1ab5da894cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:25.558805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21cbcf1-08d5-49cb-be28-c1ab5da894cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:25.558805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21cbcf1-08d5-49cb-be28-c1ab5da894cf None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:25.571157 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 513/1031] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:25.577022 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f80c1-d39c-4934-abd7-53fc6c593fa6 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:25.686091 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f80c1-d39c-4934-abd7-53fc6c593fa6 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:25.716704 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:25.723667 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88135070-870d-4fd7-b798-f2a7842a15ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:25.725451 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88135070-870d-4fd7-b798-f2a7842a15ad None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:25.725451 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88135070-870d-4fd7-b798-f2a7842a15ad None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:25.725451 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88135070-870d-4fd7-b798-f2a7842a15ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:25.732909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88135070-870d-4fd7-b798-f2a7842a15ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:25.734379 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88135070-870d-4fd7-b798-f2a7842a15ad None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:25.749043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-88135070-870d-4fd7-b798-f2a7842a15ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:52:25.749043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:25.749043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:25.749043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:25.749043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:25.749043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:25.749043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:25.749043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:25.749043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:25.749043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:25.749043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:25.749043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:25.749043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:52:25.749043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:52:25.749043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:52:25.749949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:52:25.749949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:25.749949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:25.749949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:25.749949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:25.749949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:25.749949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:25.749949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:25.749949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:25.749949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:25.749949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:25.749949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:25.749949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:25.749949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:25.749949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:25.749949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:25.749949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:25.750941 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:52:25.750941 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:52:25.750941 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:52:25.750941 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:52:25.750941 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:52:25.750941 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:52:25.750941 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:52:25.750941 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:25.750941 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 519/1032] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:52:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:25.756444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cbcf1-08d5-49cb-be28-c1ab5da894cf None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:25.861311 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cbcf1-08d5-49cb-be28-c1ab5da894cf None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:25.896604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13b2d0-f2cf-4ee4-97fd-917e0dc2d7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:25.897269 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13b2d0-f2cf-4ee4-97fd-917e0dc2d7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:25.897548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13b2d0-f2cf-4ee4-97fd-917e0dc2d7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:25.897817 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13b2d0-f2cf-4ee4-97fd-917e0dc2d7a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:25.898604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13b2d0-f2cf-4ee4-97fd-917e0dc2d7a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:25.898906 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13b2d0-f2cf-4ee4-97fd-917e0dc2d7a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:25.900365 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13b2d0-f2cf-4ee4-97fd-917e0dc2d7a2 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:25.913377 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 514/1033] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:52:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:25.919658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88135070-870d-4fd7-b798-f2a7842a15ad None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:26.027707 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88135070-870d-4fd7-b798-f2a7842a15ad None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:26.062493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90968414-0a90-48e6-91fb-d17b110cade5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:26.063152 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90968414-0a90-48e6-91fb-d17b110cade5 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:26.063438 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90968414-0a90-48e6-91fb-d17b110cade5 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:26.063730 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90968414-0a90-48e6-91fb-d17b110cade5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:26.064704 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90968414-0a90-48e6-91fb-d17b110cade5 None admin] RBAC: Adding query filter params (role.id=9c41853f063c46f988b072a76610c245, scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018, user.id=9d3b5180fb7144c394c39d4db28713b9) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:26.065100 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90968414-0a90-48e6-91fb-d17b110cade5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:26.074914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90968414-0a90-48e6-91fb-d17b110cade5 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:26.083338 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 520/1034] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:52:25 2022] GET /identity/v3/role_assignments?user.id=9d3b5180fb7144c394c39d4db28713b9&scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018&role.id=9c41853f063c46f988b072a76610c245 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:26.297799 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c08ce-e949-49b2-b764-0d8a2757019e None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:26.298052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c08ce-e949-49b2-b764-0d8a2757019e None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:26.298350 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c08ce-e949-49b2-b764-0d8a2757019e None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:26.300073 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 515/1035] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:26.305206 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d6944-2e16-4074-968d-b13921cf5bd4 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:26.305688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d6944-2e16-4074-968d-b13921cf5bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:26.305806 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d6944-2e16-4074-968d-b13921cf5bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:26.324039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-845d6944-2e16-4074-968d-b13921cf5bd4 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:26.325199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-845d6944-2e16-4074-968d-b13921cf5bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:26.377276 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:26.396857 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 521/1036] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:26.419233 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c08ce-e949-49b2-b764-0d8a2757019e None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:26.467093 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:26.529316 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c08ce-e949-49b2-b764-0d8a2757019e None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:26.565880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd7b01-bde8-4363-b203-91368c14903d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:26.566604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd7b01-bde8-4363-b203-91368c14903d None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:26.566888 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd7b01-bde8-4363-b203-91368c14903d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:26.567166 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd7b01-bde8-4363-b203-91368c14903d None admin] PATH_INFO: `/v3/services/image` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:26.567866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd7b01-bde8-4363-b203-91368c14903d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:26.569246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd7b01-bde8-4363-b203-91368c14903d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:26.581327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-0cfd7b01-bde8-4363-b203-91368c14903d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 01:52:26.581327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:26.581327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:52:26.581327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:52:26.581327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:52:26.581327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:52:26.581327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:52:26.581327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:26.581327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 01:52:26.581327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:26.581327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:52:26.581327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:26.581327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:26.581327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:26.581327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:26.581327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:26.581327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:26.582346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:26.582346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:26.582346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:26.582346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:26.582346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:26.582346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:26.582346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:52:26.582346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:52:26.582346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:52:26.582346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:52:26.582346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:26.582346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:26.582346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:26.582346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:26.582346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:26.582346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:26.588599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:26.588599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:26.588599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:26.588599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:26.588599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:26.588599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:26.588599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:26.588599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:26.588599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:26.588599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:26.588599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:52:26.588599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:26.588599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 01:52:26.588599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:26.588599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 516/1037] 10.222.0.13 () {56 vars in 1105 bytes} [Thu Jun 23 01:52:26 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:26.589422 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d6944-2e16-4074-968d-b13921cf5bd4 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:26.692526 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d6944-2e16-4074-968d-b13921cf5bd4 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:26.729999 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705acd54-4906-42ec-8bcf-6ac24b3d2c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:26.730678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705acd54-4906-42ec-8bcf-6ac24b3d2c71 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:26.730963 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705acd54-4906-42ec-8bcf-6ac24b3d2c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:26.731222 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705acd54-4906-42ec-8bcf-6ac24b3d2c71 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:26.731956 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705acd54-4906-42ec-8bcf-6ac24b3d2c71 None admin] RBAC: Adding query filter params (name=image) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:26.732264 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705acd54-4906-42ec-8bcf-6ac24b3d2c71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:26.733645 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705acd54-4906-42ec-8bcf-6ac24b3d2c71 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:26.739247 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 522/1038] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:26.745074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd7b01-bde8-4363-b203-91368c14903d None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:26.847908 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd7b01-bde8-4363-b203-91368c14903d None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:26.855478 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:26.883752 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c1838-82bb-42e7-9325-0bd7fd73a3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:26.884424 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c1838-82bb-42e7-9325-0bd7fd73a3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:26.884704 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c1838-82bb-42e7-9325-0bd7fd73a3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:26.884980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c1838-82bb-42e7-9325-0bd7fd73a3d3 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:26.885692 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c1838-82bb-42e7-9325-0bd7fd73a3d3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:26.886005 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c1838-82bb-42e7-9325-0bd7fd73a3d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:26.887403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c1838-82bb-42e7-9325-0bd7fd73a3d3 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:26.893282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 517/1039] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:26.899290 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705acd54-4906-42ec-8bcf-6ac24b3d2c71 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:26.962700 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:27.016895 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705acd54-4906-42ec-8bcf-6ac24b3d2c71 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:27.054253 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bd701-4b52-4f57-83bd-094529bf4adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:27.054937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bd701-4b52-4f57-83bd-094529bf4adc None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:27.055219 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bd701-4b52-4f57-83bd-094529bf4adc None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:27.055518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bd701-4b52-4f57-83bd-094529bf4adc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:27.056319 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bd701-4b52-4f57-83bd-094529bf4adc None admin] RBAC: Adding query filter params (interface=public, service_id=b2d0e13dd3c84d16b72ddf28f7aa3b8f, region_id=RegionOne) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:27.056632 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bd701-4b52-4f57-83bd-094529bf4adc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:27.058015 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bd701-4b52-4f57-83bd-094529bf4adc None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:27.063975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 523/1040] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Jun 23 01:52:26 2022] GET /identity/v3/endpoints?service_id=b2d0e13dd3c84d16b72ddf28f7aa3b8f&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:27.069970 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c1838-82bb-42e7-9325-0bd7fd73a3d3 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:27.177351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c1838-82bb-42e7-9325-0bd7fd73a3d3 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:27.213447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b59cf9-f9b7-494a-98cf-4336ff03d9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:27.214133 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b59cf9-f9b7-494a-98cf-4336ff03d9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:27.214412 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b59cf9-f9b7-494a-98cf-4336ff03d9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:27.214686 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b59cf9-f9b7-494a-98cf-4336ff03d9f0 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:27.215378 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b59cf9-f9b7-494a-98cf-4336ff03d9f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:27.216780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b59cf9-f9b7-494a-98cf-4336ff03d9f0 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:27.224403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 518/1041] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 23 01:52:27 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 01:52:27.617783 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfcc70-9112-4b24-a418-207c9497a2ee None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:27.618361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfcc70-9112-4b24-a418-207c9497a2ee None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:27.618361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfcc70-9112-4b24-a418-207c9497a2ee None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:27.619916 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 524/1042] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:27.625090 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcdc55-8e42-4cba-b032-7025b2ad7f9c None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:27.625341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcdc55-8e42-4cba-b032-7025b2ad7f9c None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:27.625648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcdc55-8e42-4cba-b032-7025b2ad7f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:27.642538 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-0dbcdc55-8e42-4cba-b032-7025b2ad7f9c None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:27.644148 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-0dbcdc55-8e42-4cba-b032-7025b2ad7f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:27.672803 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:27.717747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 519/1043] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 01:52:27.742965 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bfcc70-9112-4b24-a418-207c9497a2ee None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:27.846823 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bfcc70-9112-4b24-a418-207c9497a2ee None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:27.860324 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:27.883183 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13951929-1c55-4e16-b684-833519f0e346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:27.883967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13951929-1c55-4e16-b684-833519f0e346 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:27.884241 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13951929-1c55-4e16-b684-833519f0e346 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:27.884535 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13951929-1c55-4e16-b684-833519f0e346 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:27.885705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13951929-1c55-4e16-b684-833519f0e346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:27.887148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13951929-1c55-4e16-b684-833519f0e346 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:27.888994 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 525/1044] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:27.894582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcdc55-8e42-4cba-b032-7025b2ad7f9c None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:28.003567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcdc55-8e42-4cba-b032-7025b2ad7f9c None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:28.037177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e255bea-7abe-4d6f-890a-8cea2c487bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:28.037848 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e255bea-7abe-4d6f-890a-8cea2c487bdc None admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:28.038127 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e255bea-7abe-4d6f-890a-8cea2c487bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:28.038394 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e255bea-7abe-4d6f-890a-8cea2c487bdc None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:28.039108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e255bea-7abe-4d6f-890a-8cea2c487bdc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:28.040566 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e255bea-7abe-4d6f-890a-8cea2c487bdc None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:28.053029 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f8cff-cc22-40a7-82fc-66c8124a867f None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:28.053377 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f8cff-cc22-40a7-82fc-66c8124a867f None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:28.053689 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f8cff-cc22-40a7-82fc-66c8124a867f None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:28.055064 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 526/1045] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:52:28.060832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5c2ae-14ad-42a9-9380-42609190c9a8 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:28.061122 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5c2ae-14ad-42a9-9380-42609190c9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:28.061390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5c2ae-14ad-42a9-9380-42609190c9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:28.065975 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 520/1046] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 01:52:27 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:52:28.080404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-28d5c2ae-14ad-42a9-9380-42609190c9a8 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:28.081733 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-28d5c2ae-14ad-42a9-9380-42609190c9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:28.158186 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 527/1047] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:28.181244 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e255bea-7abe-4d6f-890a-8cea2c487bdc None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:28.212051 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:28.296517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e255bea-7abe-4d6f-890a-8cea2c487bdc None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:28.330689 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c5719-23f1-4b32-88aa-9f6b28af02b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:28.331582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c5719-23f1-4b32-88aa-9f6b28af02b7 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:28.331865 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c5719-23f1-4b32-88aa-9f6b28af02b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:28.332139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c5719-23f1-4b32-88aa-9f6b28af02b7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:28.343607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c5719-23f1-4b32-88aa-9f6b28af02b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:52:28.352180 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-092c5719-23f1-4b32-88aa-9f6b28af02b7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 01:52:28.352180 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:28.352180 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:28.352180 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:28.352180 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:28.352180 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:28.352180 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:28.352180 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:28.352180 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:28.352180 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:28.352180 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:28.352180 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:28.352180 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:52:28.352180 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:52:28.352180 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:52:28.352180 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:52:28.353193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:52:28.353193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:52:28.353193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:52:28.353193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:52:28.353193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:28.353193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:28.353193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:28.353193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:28.353193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:28.353193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:28.353193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:28.353193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:28.353193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:28.353193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:28.353193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:28.353193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:28.354676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:28.354676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:28.354676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:28.354676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:28.354676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:52:28.354676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:52:28.354676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:52:28.354676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:52:28.354676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:52:28.354676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:52:28.354676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 01:52:28.354676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:28.354676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 521/1048] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Jun 23 01:52:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:28.359602 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5c2ae-14ad-42a9-9380-42609190c9a8 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:28.465646 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5c2ae-14ad-42a9-9380-42609190c9a8 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:28.476976 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:28.504191 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2de63d-e571-43ce-a56e-1e84eb841df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:28.504874 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2de63d-e571-43ce-a56e-1e84eb841df5 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:28.505153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2de63d-e571-43ce-a56e-1e84eb841df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:28.505425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2de63d-e571-43ce-a56e-1e84eb841df5 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:28.506174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2de63d-e571-43ce-a56e-1e84eb841df5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:28.506477 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2de63d-e571-43ce-a56e-1e84eb841df5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:28.507892 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2de63d-e571-43ce-a56e-1e84eb841df5 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:28.520759 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 528/1049] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Jun 23 01:52:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:28.522239 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c5719-23f1-4b32-88aa-9f6b28af02b7 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:28.613858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:28.635042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c5719-23f1-4b32-88aa-9f6b28af02b7 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:28.668639 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b0e9a-c28a-4330-a69e-0815090a03af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:28.669441 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b0e9a-c28a-4330-a69e-0815090a03af None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:28.669726 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b0e9a-c28a-4330-a69e-0815090a03af None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:28.670001 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b0e9a-c28a-4330-a69e-0815090a03af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:28.682127 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b0e9a-c28a-4330-a69e-0815090a03af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:28.683622 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b0e9a-c28a-4330-a69e-0815090a03af None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:28.701299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-b37b0e9a-c28a-4330-a69e-0815090a03af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:28.701299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:28.701299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:28.701299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:28.701299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:28.701299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:28.701299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:28.701299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:28.701299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:28.701299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:28.701299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:28.701299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:28.701299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:52:28.701299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:52:28.701299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:52:28.702213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:52:28.702213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:28.702213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:28.702213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:28.702213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:28.702213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:28.702213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:28.702213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:28.702213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:28.702213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:28.702213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:28.702213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:28.702213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:28.702213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:28.702213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:28.702213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:28.702213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:28.703124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:52:28.703124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:52:28.703124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:28.703124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:28.703124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 522/1050] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:28.708618 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2de63d-e571-43ce-a56e-1e84eb841df5 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:28.813780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2de63d-e571-43ce-a56e-1e84eb841df5 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:28.849042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e2f16-bfb0-4bb9-8153-deb71dfa6641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:28.850044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e2f16-bfb0-4bb9-8153-deb71dfa6641 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:28.850504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e2f16-bfb0-4bb9-8153-deb71dfa6641 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:28.850955 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e2f16-bfb0-4bb9-8153-deb71dfa6641 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:28.851911 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e2f16-bfb0-4bb9-8153-deb71dfa6641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:28.852400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e2f16-bfb0-4bb9-8153-deb71dfa6641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:28.854018 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e2f16-bfb0-4bb9-8153-deb71dfa6641 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:28.870917 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 529/1051] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:28.872780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b0e9a-c28a-4330-a69e-0815090a03af None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:28.985142 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b0e9a-c28a-4330-a69e-0815090a03af None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:29.016264 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:29.021835 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0962e8-6169-4046-8445-2a1a049bb095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:29.022661 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0962e8-6169-4046-8445-2a1a049bb095 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:29.023015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0962e8-6169-4046-8445-2a1a049bb095 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:29.023345 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0962e8-6169-4046-8445-2a1a049bb095 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:29.031712 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0962e8-6169-4046-8445-2a1a049bb095 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:29.033227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0962e8-6169-4046-8445-2a1a049bb095 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:29.047599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-3d0962e8-6169-4046-8445-2a1a049bb095 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 01:52:29.047599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:29.047599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:29.047599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:29.047599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:29.047599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:29.047599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:29.047599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:29.047599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:29.047599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:29.047599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:29.047599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:29.047599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:52:29.047599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:52:29.047599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:52:29.047599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:52:29.048533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:29.048533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:29.048533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:52:29.048533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:52:29.048533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:52:29.048533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:52:29.048533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:29.048533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:29.048533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:29.048533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:29.048533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:29.048533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:29.048533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:29.048533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:29.048533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:29.048533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:29.048533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:29.048533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:29.054675 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:29.054675 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:29.054675 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:52:29.054675 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:52:29.054675 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:52:29.054675 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:52:29.054675 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:52:29.054675 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:52:29.054675 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 01:52:29.054675 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:29.054675 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 523/1052] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 23 01:52:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:29.057195 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e2f16-bfb0-4bb9-8153-deb71dfa6641 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:29.090931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:29.161940 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e2f16-bfb0-4bb9-8153-deb71dfa6641 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:29.196659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75447531-67a7-4f4d-9cf2-55f0f16de411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:29.197335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75447531-67a7-4f4d-9cf2-55f0f16de411 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:29.197614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75447531-67a7-4f4d-9cf2-55f0f16de411 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:29.197884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75447531-67a7-4f4d-9cf2-55f0f16de411 None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:29.198720 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75447531-67a7-4f4d-9cf2-55f0f16de411 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:29.199026 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75447531-67a7-4f4d-9cf2-55f0f16de411 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:29.200499 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75447531-67a7-4f4d-9cf2-55f0f16de411 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:29.224281 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 530/1053] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 23 01:52:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:29.226064 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0962e8-6169-4046-8445-2a1a049bb095 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:29.271770 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18066dc9-b9bb-4a0a-a4bf-01b24433498c None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:29.272141 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18066dc9-b9bb-4a0a-a4bf-01b24433498c None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:29.272309 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18066dc9-b9bb-4a0a-a4bf-01b24433498c None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:29.273732 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 531/1054] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:52:29.279098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e951f0-bde5-45a3-b470-3e73cdafa489 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:29.279379 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e951f0-bde5-45a3-b470-3e73cdafa489 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:29.279716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e951f0-bde5-45a3-b470-3e73cdafa489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:29.297579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-f7e951f0-bde5-45a3-b470-3e73cdafa489 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:29.298828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-f7e951f0-bde5-45a3-b470-3e73cdafa489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:29.333570 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0962e8-6169-4046-8445-2a1a049bb095 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:29.370916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf36d7-74c7-4fde-8b18-ec9534960c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:29.371672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf36d7-74c7-4fde-8b18-ec9534960c19 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:29.371956 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf36d7-74c7-4fde-8b18-ec9534960c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:29.372234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf36d7-74c7-4fde-8b18-ec9534960c19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:29.375591 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 532/1055] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 01:52:29.385440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf36d7-74c7-4fde-8b18-ec9534960c19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:29.386917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf36d7-74c7-4fde-8b18-ec9534960c19 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:29.396985 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e951f0-bde5-45a3-b470-3e73cdafa489 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:29.404838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-0adf36d7-74c7-4fde-8b18-ec9534960c19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:29.404838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:29.404838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:29.404838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:29.404838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:29.404838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:29.404838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:29.404838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:29.404838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:29.404838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:29.404838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:29.404838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:29.404838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:52:29.404838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:52:29.404838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:52:29.405916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:52:29.405916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:29.405916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:29.405916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:29.405916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:29.405916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:29.405916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:29.405916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:29.405916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:29.405916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:29.405916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:29.405916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:29.405916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:29.405916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:29.405916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:29.405916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:29.405916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:29.407198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:52:29.407198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:52:29.407198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:29.407198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:29.407198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 524/1056] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:52:29.413957 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf36d7-74c7-4fde-8b18-ec9534960c19 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:29.424550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:29.462741 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:29.512855 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e951f0-bde5-45a3-b470-3e73cdafa489 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:29.518831 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf36d7-74c7-4fde-8b18-ec9534960c19 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:29.549380 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b975579-5a93-498a-89f6-304a66428309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:29.550616 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b975579-5a93-498a-89f6-304a66428309 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:29.550862 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b975579-5a93-498a-89f6-304a66428309 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:29.551130 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b975579-5a93-498a-89f6-304a66428309 None admin] PATH_INFO: `/v3/services/image` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:29.551827 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b975579-5a93-498a-89f6-304a66428309 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:29.553576 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b975579-5a93-498a-89f6-304a66428309 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:29.555734 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098963b-b6b7-4f14-a4db-868377679bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:29.556414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098963b-b6b7-4f14-a4db-868377679bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:29.556702 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098963b-b6b7-4f14-a4db-868377679bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:29.556977 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098963b-b6b7-4f14-a4db-868377679bd8 None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:29.557700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098963b-b6b7-4f14-a4db-868377679bd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:29.558010 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098963b-b6b7-4f14-a4db-868377679bd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:29.559370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098963b-b6b7-4f14-a4db-868377679bd8 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:29.567175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-2b975579-5a93-498a-89f6-304a66428309 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 01:52:29.567175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:29.567175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:52:29.567175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:52:29.567175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:52:29.567175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:52:29.567175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:52:29.567175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:29.567175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 01:52:29.567175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:29.567175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:52:29.567175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:29.567175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:29.567175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:29.567175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:29.567175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:29.567175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:29.568236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:29.568236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:29.568236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:29.568236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:29.568236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:29.568236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:29.568236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:52:29.568236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:52:29.568236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:52:29.568236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:52:29.568236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:29.568236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:29.568236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:29.568236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:29.568236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:29.568236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:29.569089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:29.569089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:29.569089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:29.569089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:29.569089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:29.569089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:29.569089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:29.569089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:29.569089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:29.569089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:29.569089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:52:29.569089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:52:29.569089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 01:52:29.569089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:29.571573 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 533/1057] 10.222.0.13 () {56 vars in 1105 bytes} [Thu Jun 23 01:52:29 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:52:29.572756 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 525/1058] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:29.578236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b975579-5a93-498a-89f6-304a66428309 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:29.578663 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098963b-b6b7-4f14-a4db-868377679bd8 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:29.670697 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:29.682018 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098963b-b6b7-4f14-a4db-868377679bd8 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:29.684446 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:29.689633 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b975579-5a93-498a-89f6-304a66428309 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:29.721863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34a838-f6d6-4303-bbbd-deb2757aaeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:29.722528 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34a838-f6d6-4303-bbbd-deb2757aaeed None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:29.722810 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34a838-f6d6-4303-bbbd-deb2757aaeed None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:29.723086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34a838-f6d6-4303-bbbd-deb2757aaeed None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:29.723848 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c34a838-f6d6-4303-bbbd-deb2757aaeed None admin] RBAC: Adding query filter params (name=image) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:29.724151 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c34a838-f6d6-4303-bbbd-deb2757aaeed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:29.725522 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c34a838-f6d6-4303-bbbd-deb2757aaeed None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:29.725883 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802fb3a-b732-4780-971b-efe37d7b8777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:29.726845 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802fb3a-b732-4780-971b-efe37d7b8777 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:29.727127 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802fb3a-b732-4780-971b-efe37d7b8777 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:29.727716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802fb3a-b732-4780-971b-efe37d7b8777 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:29.730666 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 526/1059] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:29.736035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802fb3a-b732-4780-971b-efe37d7b8777 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:29.736255 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34a838-f6d6-4303-bbbd-deb2757aaeed None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:29.737725 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802fb3a-b732-4780-971b-efe37d7b8777 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:29.753472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-3802fb3a-b732-4780-971b-efe37d7b8777 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:52:29.753472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:29.753472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:29.753472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:29.753472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:29.753472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:29.753472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:29.753472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:29.753472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:29.753472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:29.753472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:29.753472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:29.753472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:52:29.753472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:52:29.753472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:52:29.754412 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:52:29.754412 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:29.754412 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:29.754412 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:29.754412 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:29.754412 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:29.754412 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:29.754412 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:29.754412 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:29.754412 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:29.754412 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:29.754412 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:29.754412 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:29.754412 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:29.754412 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:29.754412 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:29.754412 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:29.756163 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:52:29.756163 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:52:29.756163 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:52:29.756163 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:52:29.756163 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:52:29.756163 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:52:29.756163 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:52:29.756163 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:29.756163 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 534/1060] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:52:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:29.760426 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802fb3a-b732-4780-971b-efe37d7b8777 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:29.845718 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34a838-f6d6-4303-bbbd-deb2757aaeed None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:29.867283 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802fb3a-b732-4780-971b-efe37d7b8777 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:29.881293 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90453b62-0052-4826-9912-b9cd64aca052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:29.881972 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90453b62-0052-4826-9912-b9cd64aca052 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:29.882255 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90453b62-0052-4826-9912-b9cd64aca052 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:29.882530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90453b62-0052-4826-9912-b9cd64aca052 None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:29.883240 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90453b62-0052-4826-9912-b9cd64aca052 None admin] RBAC: Adding query filter params (type=image) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:29.883586 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90453b62-0052-4826-9912-b9cd64aca052 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:29.884976 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90453b62-0052-4826-9912-b9cd64aca052 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:29.894807 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 527/1061] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:29.895890 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90453b62-0052-4826-9912-b9cd64aca052 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:29.910903 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b334849-72d0-4ed9-9380-fbd0596487b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:29.911903 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b334849-72d0-4ed9-9380-fbd0596487b6 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:29.912444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b334849-72d0-4ed9-9380-fbd0596487b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:29.912720 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b334849-72d0-4ed9-9380-fbd0596487b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:29.913518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b334849-72d0-4ed9-9380-fbd0596487b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:29.913823 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b334849-72d0-4ed9-9380-fbd0596487b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:29.915268 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b334849-72d0-4ed9-9380-fbd0596487b6 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:29.927982 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 535/1062] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:52:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:29.932609 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:29.933272 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b334849-72d0-4ed9-9380-fbd0596487b6 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:29.939020 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:30.009245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90453b62-0052-4826-9912-b9cd64aca052 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:30.042258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b334849-72d0-4ed9-9380-fbd0596487b6 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:30.045952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82078b08-2e12-4c73-bd3b-fc147854b5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:30.046626 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82078b08-2e12-4c73-bd3b-fc147854b5ee None admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:30.046910 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82078b08-2e12-4c73-bd3b-fc147854b5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:30.047163 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82078b08-2e12-4c73-bd3b-fc147854b5ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:30.047969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82078b08-2e12-4c73-bd3b-fc147854b5ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:30.049369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82078b08-2e12-4c73-bd3b-fc147854b5ee None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:30.079444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 528/1063] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 23 01:52:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:52:30.093606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672dc6ba-e0d2-4067-8ce2-4df5fa4bbc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:30.094517 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672dc6ba-e0d2-4067-8ce2-4df5fa4bbc8c None admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:30.094794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672dc6ba-e0d2-4067-8ce2-4df5fa4bbc8c None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:30.095066 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672dc6ba-e0d2-4067-8ce2-4df5fa4bbc8c None admin] PATH_INFO: `/v3/projects/3f3b06be1b5a4b3a8235ebf22da2a018/users/9d3b5180fb7144c394c39d4db28713b9/roles/9c41853f063c46f988b072a76610c245` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:30.097509 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672dc6ba-e0d2-4067-8ce2-4df5fa4bbc8c None admin] RBAC: Authorizing `identity:create_grant(project_id=3f3b06be1b5a4b3a8235ebf22da2a018, user_id=9d3b5180fb7144c394c39d4db28713b9, role_id=9c41853f063c46f988b072a76610c245)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:30.098995 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672dc6ba-e0d2-4067-8ce2-4df5fa4bbc8c None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:30.114291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 536/1064] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:52:29 2022] PUT /identity/v3/projects/3f3b06be1b5a4b3a8235ebf22da2a018/users/9d3b5180fb7144c394c39d4db28713b9/roles/9c41853f063c46f988b072a76610c245 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:52:30.139784 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495b83b-7ccc-48a6-bab8-e4f69c4485ef None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:30.140077 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495b83b-7ccc-48a6-bab8-e4f69c4485ef None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:30.140354 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495b83b-7ccc-48a6-bab8-e4f69c4485ef None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:30.142019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 529/1065] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:30.148026 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ae719-1e28-4b8c-85bc-f8dc401c2567 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:30.148333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ae719-1e28-4b8c-85bc-f8dc401c2567 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:30.148590 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ae719-1e28-4b8c-85bc-f8dc401c2567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:30.167086 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-899ae719-1e28-4b8c-85bc-f8dc401c2567 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:30.168356 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-899ae719-1e28-4b8c-85bc-f8dc401c2567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:30.236714 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:30.251678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 537/1066] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:30.275420 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495b83b-7ccc-48a6-bab8-e4f69c4485ef None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:30.377615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:30.392880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495b83b-7ccc-48a6-bab8-e4f69c4485ef None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:30.428708 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b5449-aeb9-4579-80f6-61e7a9f0849b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:30.429517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b5449-aeb9-4579-80f6-61e7a9f0849b None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:30.429796 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b5449-aeb9-4579-80f6-61e7a9f0849b None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:30.430070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b5449-aeb9-4579-80f6-61e7a9f0849b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:30.441243 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b5449-aeb9-4579-80f6-61e7a9f0849b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:52:30.448989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-995b5449-aeb9-4579-80f6-61e7a9f0849b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:52:30.448989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:30.448989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:30.448989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:30.448989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:30.448989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:30.448989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:30.448989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:30.448989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:30.448989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:30.448989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:30.448989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:30.448989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:52:30.448989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:52:30.448989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:52:30.448989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:52:30.449938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:52:30.449938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:52:30.449938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:52:30.449938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:52:30.449938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:30.449938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:30.449938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:30.449938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:30.449938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:30.449938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:30.449938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:30.449938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:30.449938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:30.449938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:30.449938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:30.449938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:30.450814 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:30.450814 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:30.450814 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:30.450814 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:30.450814 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:52:30.450814 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:52:30.450814 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:52:30.450814 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:52:30.450814 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:52:30.450814 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:52:30.450814 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:52:30.450814 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:30.450814 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 530/1067] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:52:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:30.458191 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ae719-1e28-4b8c-85bc-f8dc401c2567 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:30.563350 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ae719-1e28-4b8c-85bc-f8dc401c2567 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:30.602689 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b306b3-6003-4002-96b6-a3c3219a7183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:30.603793 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b306b3-6003-4002-96b6-a3c3219a7183 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:30.604277 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b306b3-6003-4002-96b6-a3c3219a7183 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:30.604757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b306b3-6003-4002-96b6-a3c3219a7183 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:30.605727 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b306b3-6003-4002-96b6-a3c3219a7183 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:30.606234 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b306b3-6003-4002-96b6-a3c3219a7183 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:30.607846 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b306b3-6003-4002-96b6-a3c3219a7183 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:30.618085 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 538/1068] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:52:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:30.623521 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b5449-aeb9-4579-80f6-61e7a9f0849b None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:30.729644 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b5449-aeb9-4579-80f6-61e7a9f0849b None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:30.765002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da6835-36af-475d-93d0-aef973659601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:30.765882 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da6835-36af-475d-93d0-aef973659601 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:30.766159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da6835-36af-475d-93d0-aef973659601 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:30.766430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da6835-36af-475d-93d0-aef973659601 None admin] PATH_INFO: `/v3/users/de75b7c0844a4a9ca623072a899ecb7a` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:30.780457 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da6835-36af-475d-93d0-aef973659601 None admin] RBAC: Authorizing `identity:get_user(user_id=de75b7c0844a4a9ca623072a899ecb7a)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:30.781893 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da6835-36af-475d-93d0-aef973659601 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:30.783993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 531/1069] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:52:30 2022] GET /identity/v3/users/de75b7c0844a4a9ca623072a899ecb7a => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:30.789546 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b306b3-6003-4002-96b6-a3c3219a7183 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:30.844362 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:30.894052 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b306b3-6003-4002-96b6-a3c3219a7183 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:30.935498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a93a4-962f-4cff-8e96-c17da50e040d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:30.936155 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a93a4-962f-4cff-8e96-c17da50e040d None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:30.936432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a93a4-962f-4cff-8e96-c17da50e040d None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:30.936703 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a93a4-962f-4cff-8e96-c17da50e040d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:31.003024 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a93a4-962f-4cff-8e96-c17da50e040d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:31.004513 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a93a4-962f-4cff-8e96-c17da50e040d None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:31.054340 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:31.103173 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 539/1070] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:52:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 01:52:31.108761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da6835-36af-475d-93d0-aef973659601 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:31.118668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:31.213736 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da6835-36af-475d-93d0-aef973659601 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:31.252355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675b9a3-a14e-4639-905b-26966ca83b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:31.253244 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675b9a3-a14e-4639-905b-26966ca83b59 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:31.253520 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675b9a3-a14e-4639-905b-26966ca83b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:31.253792 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675b9a3-a14e-4639-905b-26966ca83b59 None admin] PATH_INFO: `/v3/projects/1af29be806124b87acadb07ca325b07d` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:31.255020 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675b9a3-a14e-4639-905b-26966ca83b59 None admin] RBAC: Authorizing `identity:get_project(project_id=1af29be806124b87acadb07ca325b07d)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:31.256583 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675b9a3-a14e-4639-905b-26966ca83b59 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:31.258529 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 532/1071] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:52:31 2022] GET /identity/v3/projects/1af29be806124b87acadb07ca325b07d => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:31.264365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a93a4-962f-4cff-8e96-c17da50e040d None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:31.365875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a93a4-962f-4cff-8e96-c17da50e040d None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:31.399653 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99c850-7342-43d1-927d-edfcfb1ca704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:31.400308 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99c850-7342-43d1-927d-edfcfb1ca704 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:31.400590 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99c850-7342-43d1-927d-edfcfb1ca704 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:31.400861 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99c850-7342-43d1-927d-edfcfb1ca704 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:31.401696 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99c850-7342-43d1-927d-edfcfb1ca704 None admin] RBAC: Adding query filter params (role.id=58e04437159e4eb39aa4a43c213ea34c, scope.project.id=1af29be806124b87acadb07ca325b07d, user.id=de75b7c0844a4a9ca623072a899ecb7a) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:31.402005 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99c850-7342-43d1-927d-edfcfb1ca704 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:31.403457 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99c850-7342-43d1-927d-edfcfb1ca704 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:31.409337 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 540/1072] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:52:31 2022] GET /identity/v3/role_assignments?user.id=de75b7c0844a4a9ca623072a899ecb7a&scope.project.id=1af29be806124b87acadb07ca325b07d&role.id=58e04437159e4eb39aa4a43c213ea34c => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:32.129112 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5810b42-4a80-40eb-a166-f4794e662b7c None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:32.129676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5810b42-4a80-40eb-a166-f4794e662b7c None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:32.129676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5810b42-4a80-40eb-a166-f4794e662b7c None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:32.131198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 533/1073] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:32.136313 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9190a-e1a3-4307-af83-5d8592fe0f4e None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:32.136734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9190a-e1a3-4307-af83-5d8592fe0f4e None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:32.136925 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9190a-e1a3-4307-af83-5d8592fe0f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:32.153692 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-f8f9190a-e1a3-4307-af83-5d8592fe0f4e None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:32.154866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-f8f9190a-e1a3-4307-af83-5d8592fe0f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:32.160561 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdcf06-f053-41e8-873e-052f0e418d4e None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:32.160855 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdcf06-f053-41e8-873e-052f0e418d4e None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:32.161136 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdcf06-f053-41e8-873e-052f0e418d4e None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:32.162780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 534/1074] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:32.167489 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddadf47-c132-4d7a-b0af-86a5bad4b6b0 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:32.167770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddadf47-c132-4d7a-b0af-86a5bad4b6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:32.168051 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddadf47-c132-4d7a-b0af-86a5bad4b6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:32.170101 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:32.186392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-cddadf47-c132-4d7a-b0af-86a5bad4b6b0 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:32.187546 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-cddadf47-c132-4d7a-b0af-86a5bad4b6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:32.226580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 541/1075] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:32.249976 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9190a-e1a3-4307-af83-5d8592fe0f4e None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:32.264266 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 535/1076] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 01:52:32.287661 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddadf47-c132-4d7a-b0af-86a5bad4b6b0 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:32.291124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:32.357421 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9190a-e1a3-4307-af83-5d8592fe0f4e None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:32.393678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ea074-2215-4319-9172-2bb94f1d603c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:32.394355 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ea074-2215-4319-9172-2bb94f1d603c None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:32.394634 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ea074-2215-4319-9172-2bb94f1d603c None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:32.394920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ea074-2215-4319-9172-2bb94f1d603c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:32.397793 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddadf47-c132-4d7a-b0af-86a5bad4b6b0 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:32.413282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:32.432089 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ee157-9c62-4fb7-9940-ea8f4a6e8626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:32.432913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ee157-9c62-4fb7-9940-ea8f4a6e8626 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:32.433191 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ee157-9c62-4fb7-9940-ea8f4a6e8626 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:32.433460 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ee157-9c62-4fb7-9940-ea8f4a6e8626 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:32.444243 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ee157-9c62-4fb7-9940-ea8f4a6e8626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:52:32.452431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-4c3ee157-9c62-4fb7-9940-ea8f4a6e8626 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 01:52:32.452431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:32.452431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:32.452431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:32.452431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:32.452431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:32.452431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:32.452431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:32.452431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:32.452431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:32.452431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:32.452431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:32.452431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:52:32.452431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:52:32.452431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:52:32.452431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:52:32.453549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:52:32.453549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:52:32.453549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:52:32.453549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:52:32.453549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:32.453549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:32.453549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:32.453549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:32.453549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:32.453549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:32.453549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:32.453549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:32.453549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:32.453549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:32.453549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:32.453549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:32.456415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:32.456415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:32.456415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:32.456415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:32.456415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:52:32.456415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:52:32.456415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:52:32.456415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:52:32.456415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:52:32.456415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:52:32.456415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 01:52:32.456415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:32.456415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 536/1077] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Jun 23 01:52:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:32.459405 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ee157-9c62-4fb7-9940-ea8f4a6e8626 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:32.481089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ea074-2215-4319-9172-2bb94f1d603c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:32.482570 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ea074-2215-4319-9172-2bb94f1d603c None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:32.525495 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:32.565881 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ee157-9c62-4fb7-9940-ea8f4a6e8626 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:32.585081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 542/1078] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:52:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 01:52:32.590767 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ea074-2215-4319-9172-2bb94f1d603c None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:32.601713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f08b6-d262-4f11-861f-a3bfe2adfb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:32.602413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f08b6-d262-4f11-861f-a3bfe2adfb91 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:32.602691 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f08b6-d262-4f11-861f-a3bfe2adfb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:32.602968 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f08b6-d262-4f11-861f-a3bfe2adfb91 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:32.603752 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f08b6-d262-4f11-861f-a3bfe2adfb91 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:32.604056 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f08b6-d262-4f11-861f-a3bfe2adfb91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:32.605468 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f08b6-d262-4f11-861f-a3bfe2adfb91 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:32.619225 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 537/1079] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Jun 23 01:52:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:32.620226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f08b6-d262-4f11-861f-a3bfe2adfb91 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:32.641528 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:32.696677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ea074-2215-4319-9172-2bb94f1d603c None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:32.725939 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f08b6-d262-4f11-861f-a3bfe2adfb91 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:32.730978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ab588-954d-4f04-8418-c3b903ec78a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:32.731809 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ab588-954d-4f04-8418-c3b903ec78a1 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:32.732090 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ab588-954d-4f04-8418-c3b903ec78a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:32.732363 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ab588-954d-4f04-8418-c3b903ec78a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:32.744209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ab588-954d-4f04-8418-c3b903ec78a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:32.745659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ab588-954d-4f04-8418-c3b903ec78a1 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:32.752274 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:32.761892 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c851266-fc43-4687-95c8-72164b871734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:32.762690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c851266-fc43-4687-95c8-72164b871734 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:32.762969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c851266-fc43-4687-95c8-72164b871734 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:32.763239 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c851266-fc43-4687-95c8-72164b871734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:32.763619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-879ab588-954d-4f04-8418-c3b903ec78a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:32.763619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:32.763619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:32.763619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:32.763619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:32.763619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:32.763619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:32.763619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:32.763619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:32.763619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:32.763619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:32.763619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:32.763619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:52:32.763619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:52:32.763619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:52:32.764478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:52:32.764478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:32.764478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:32.764478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:32.764478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:32.764478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:32.764478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:32.764478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:32.764478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:32.764478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:32.764478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:32.764478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:32.764478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:32.764478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:32.764478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:32.764478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:32.764478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:32.770789 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:52:32.770789 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:52:32.770789 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:32.770789 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:32.770789 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 543/1080] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:52:32.771508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ab588-954d-4f04-8418-c3b903ec78a1 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:32.780546 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c851266-fc43-4687-95c8-72164b871734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:32.781994 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c851266-fc43-4687-95c8-72164b871734 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:32.799002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-9c851266-fc43-4687-95c8-72164b871734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:32.799002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:32.799002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:32.799002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:32.799002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:32.799002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:32.799002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:32.799002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:32.799002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:32.799002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:32.799002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:32.799002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:32.799002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:52:32.799002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:52:32.799002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:52:32.799950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:52:32.799950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:32.799950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:32.799950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:32.799950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:32.799950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:32.799950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:32.799950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:32.799950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:32.799950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:32.799950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:32.799950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:32.799950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:32.799950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:32.799950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:32.799950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:32.799950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:32.805908 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:52:32.805908 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:52:32.805908 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:32.805908 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:32.805908 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 538/1081] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:52:32.805908 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c851266-fc43-4687-95c8-72164b871734 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:32.877082 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:32.881914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ab588-954d-4f04-8418-c3b903ec78a1 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:32.916245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c851266-fc43-4687-95c8-72164b871734 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:32.916682 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ff277-cd1a-4389-87d7-b1a0697211a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:32.917359 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ff277-cd1a-4389-87d7-b1a0697211a6 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:32.917647 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ff277-cd1a-4389-87d7-b1a0697211a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:32.917920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ff277-cd1a-4389-87d7-b1a0697211a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:32.918649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ff277-cd1a-4389-87d7-b1a0697211a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:32.918957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ff277-cd1a-4389-87d7-b1a0697211a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:32.920371 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ff277-cd1a-4389-87d7-b1a0697211a6 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:32.939788 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 544/1082] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:32.953866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d05e4-553b-4119-be50-57f5724f2715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:32.954559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d05e4-553b-4119-be50-57f5724f2715 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:32.954966 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d05e4-553b-4119-be50-57f5724f2715 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:32.955303 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d05e4-553b-4119-be50-57f5724f2715 None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:32.956201 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d05e4-553b-4119-be50-57f5724f2715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:32.956572 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d05e4-553b-4119-be50-57f5724f2715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:32.958066 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d05e4-553b-4119-be50-57f5724f2715 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:32.972445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 539/1083] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:32.977947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ff277-cd1a-4389-87d7-b1a0697211a6 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:33.091062 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ff277-cd1a-4389-87d7-b1a0697211a6 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:33.128008 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc85ad-42f2-401e-9b76-f22181a43091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:33.128856 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc85ad-42f2-401e-9b76-f22181a43091 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:33.129097 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc85ad-42f2-401e-9b76-f22181a43091 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:33.129368 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc85ad-42f2-401e-9b76-f22181a43091 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:33.138181 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc85ad-42f2-401e-9b76-f22181a43091 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:33.139779 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc85ad-42f2-401e-9b76-f22181a43091 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:33.154061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-4bdc85ad-42f2-401e-9b76-f22181a43091 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 01:52:33.154061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:33.154061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:33.154061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:33.154061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:33.154061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:33.154061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:33.154061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:33.154061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:33.154061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:33.154061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:33.154061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:33.154061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:52:33.154061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:52:33.154061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:52:33.154061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:52:33.155037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:33.155037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:33.155037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:52:33.155037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:52:33.155037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:52:33.155037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:52:33.155037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:33.155037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:33.155037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:33.155037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:33.155037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:33.155037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:33.155037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:33.155037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:33.155037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:33.155037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:33.155037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:33.155037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:33.156071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:33.156071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:33.156071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:52:33.156071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:52:33.156071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:52:33.156071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:52:33.156071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:52:33.156071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:52:33.156071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 01:52:33.156071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:33.156071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 545/1084] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 23 01:52:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:33.161630 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d05e4-553b-4119-be50-57f5724f2715 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:33.208707 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:33.270239 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d05e4-553b-4119-be50-57f5724f2715 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:33.304955 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25486419-c959-4cf3-a7e9-6a8e08246097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:33.305625 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25486419-c959-4cf3-a7e9-6a8e08246097 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:33.305916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25486419-c959-4cf3-a7e9-6a8e08246097 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:33.306183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25486419-c959-4cf3-a7e9-6a8e08246097 None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:33.307021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25486419-c959-4cf3-a7e9-6a8e08246097 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:33.307328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25486419-c959-4cf3-a7e9-6a8e08246097 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:33.308793 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25486419-c959-4cf3-a7e9-6a8e08246097 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:33.327058 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 540/1085] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 23 01:52:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:33.333279 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc85ad-42f2-401e-9b76-f22181a43091 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:33.354037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:33.409777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de87a5-ca61-4b50-8548-f56426125a37 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:33.410105 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de87a5-ca61-4b50-8548-f56426125a37 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:33.410380 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de87a5-ca61-4b50-8548-f56426125a37 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:33.411765 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 541/1086] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:33.416863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f3220-0cd1-4420-b936-1ebfe4dea556 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:33.417149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f3220-0cd1-4420-b936-1ebfe4dea556 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:33.417423 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f3220-0cd1-4420-b936-1ebfe4dea556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:33.434253 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-092f3220-0cd1-4420-b936-1ebfe4dea556 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:33.435801 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-092f3220-0cd1-4420-b936-1ebfe4dea556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:33.435924 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc85ad-42f2-401e-9b76-f22181a43091 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:33.470916 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952eee3-9dfc-4d55-ae9e-b050cdaa77a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:33.471528 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952eee3-9dfc-4d55-ae9e-b050cdaa77a0 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:33.471818 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952eee3-9dfc-4d55-ae9e-b050cdaa77a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:33.472093 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952eee3-9dfc-4d55-ae9e-b050cdaa77a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:33.503884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 542/1087] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:33.526444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f3220-0cd1-4420-b936-1ebfe4dea556 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:33.539470 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952eee3-9dfc-4d55-ae9e-b050cdaa77a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:33.540946 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952eee3-9dfc-4d55-ae9e-b050cdaa77a0 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:33.552027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:33.558761 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:33.625040 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f3220-0cd1-4420-b936-1ebfe4dea556 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:33.641119 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 546/1088] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:52:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 01:52:33.647216 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952eee3-9dfc-4d55-ae9e-b050cdaa77a0 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:33.658957 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc5d95-529f-46ae-b2dd-fa3595e47526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:33.659790 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc5d95-529f-46ae-b2dd-fa3595e47526 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:33.660070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc5d95-529f-46ae-b2dd-fa3595e47526 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:33.660344 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc5d95-529f-46ae-b2dd-fa3595e47526 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:33.671360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc5d95-529f-46ae-b2dd-fa3595e47526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:52:33.679141 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-8bbc5d95-529f-46ae-b2dd-fa3595e47526 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:52:33.679141 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:33.679141 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:33.679141 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:33.679141 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:33.679141 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:33.679141 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:33.679141 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:33.679141 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:33.679141 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:33.679141 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:33.679141 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:33.679141 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:52:33.679141 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:52:33.679141 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:52:33.679141 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:52:33.680182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:52:33.680182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:52:33.680182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:52:33.680182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:52:33.680182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:33.680182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:33.680182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:33.680182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:33.680182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:33.680182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:33.680182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:33.680182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:33.680182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:33.680182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:33.680182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:33.680182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:33.681224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:33.681224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:33.681224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:33.681224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:33.681224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:52:33.681224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:52:33.681224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:52:33.681224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:52:33.681224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:52:33.681224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:52:33.681224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:52:33.681224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:52:33.681224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 543/1089] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:52:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:52:33.686923 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc5d95-529f-46ae-b2dd-fa3595e47526 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:33.748044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952eee3-9dfc-4d55-ae9e-b050cdaa77a0 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:33.765071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:33.770138 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:33.784219 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c67408-2961-42cf-9618-b9e94f45e4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:33.785020 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c67408-2961-42cf-9618-b9e94f45e4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:33.785292 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c67408-2961-42cf-9618-b9e94f45e4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:33.785386 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc5d95-529f-46ae-b2dd-fa3595e47526 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:33.785555 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c67408-2961-42cf-9618-b9e94f45e4b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:33.795628 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c67408-2961-42cf-9618-b9e94f45e4b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:33.797101 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c67408-2961-42cf-9618-b9e94f45e4b6 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:33.815198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-b1c67408-2961-42cf-9618-b9e94f45e4b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:33.815198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:33.815198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:33.815198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:33.815198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:33.815198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:33.815198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:33.815198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:33.815198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:33.815198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:33.815198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:33.815198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:33.815198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:52:33.815198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:52:33.815198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:52:33.816182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:52:33.816182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:33.816182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:33.816182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:33.816182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:33.816182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:33.816182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:33.816182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:33.816182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:33.816182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:33.816182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:33.816182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:33.816182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:33.816182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:33.816182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:33.816182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:33.816182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:33.817095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:52:33.817095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:52:33.817095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:52:33.817095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:33.817095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 547/1090] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:52:33.818294 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa0768-1a53-456f-92da-0fa2d09c2b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:33.818967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa0768-1a53-456f-92da-0fa2d09c2b7c None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:33.819248 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa0768-1a53-456f-92da-0fa2d09c2b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:33.819559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa0768-1a53-456f-92da-0fa2d09c2b7c None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:33.820309 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa0768-1a53-456f-92da-0fa2d09c2b7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:33.820616 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa0768-1a53-456f-92da-0fa2d09c2b7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:33.822032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c67408-2961-42cf-9618-b9e94f45e4b6 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:33.822134 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa0768-1a53-456f-92da-0fa2d09c2b7c None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:33.830500 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 544/1091] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:52:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:33.836036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa0768-1a53-456f-92da-0fa2d09c2b7c None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:33.921262 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c67408-2961-42cf-9618-b9e94f45e4b6 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:33.937149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa0768-1a53-456f-92da-0fa2d09c2b7c None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:33.955997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132493ae-8b6e-43e6-a6f8-fd8b991d5e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:33.956678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132493ae-8b6e-43e6-a6f8-fd8b991d5e16 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:33.956961 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132493ae-8b6e-43e6-a6f8-fd8b991d5e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:33.957237 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132493ae-8b6e-43e6-a6f8-fd8b991d5e16 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:33.957965 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132493ae-8b6e-43e6-a6f8-fd8b991d5e16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:33.958271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132493ae-8b6e-43e6-a6f8-fd8b991d5e16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:33.959680 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132493ae-8b6e-43e6-a6f8-fd8b991d5e16 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:33.971133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 548/1092] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:33.971516 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41544d6-0625-43a9-a718-a9647a9de153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:33.972523 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41544d6-0625-43a9-a718-a9647a9de153 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:33.972806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41544d6-0625-43a9-a718-a9647a9de153 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:33.973080 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41544d6-0625-43a9-a718-a9647a9de153 None admin] PATH_INFO: `/v3/users/de75b7c0844a4a9ca623072a899ecb7a` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:33.974293 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41544d6-0625-43a9-a718-a9647a9de153 None admin] RBAC: Authorizing `identity:get_user(user_id=de75b7c0844a4a9ca623072a899ecb7a)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:33.975833 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41544d6-0625-43a9-a718-a9647a9de153 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:33.976889 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132493ae-8b6e-43e6-a6f8-fd8b991d5e16 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:33.977560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 545/1093] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:52:33 2022] GET /identity/v3/users/de75b7c0844a4a9ca623072a899ecb7a => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:33.983066 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41544d6-0625-43a9-a718-a9647a9de153 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:34.002244 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:34.010907 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:34.079315 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132493ae-8b6e-43e6-a6f8-fd8b991d5e16 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:34.084518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41544d6-0625-43a9-a718-a9647a9de153 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:34.112447 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ea5a5-3a3c-4853-8dbe-887f59d7694e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:34.113271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ea5a5-3a3c-4853-8dbe-887f59d7694e None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:34.113554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ea5a5-3a3c-4853-8dbe-887f59d7694e None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:34.113828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ea5a5-3a3c-4853-8dbe-887f59d7694e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:34.117524 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac89366-1a0b-44e2-8b99-64567a4fd499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:34.118390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac89366-1a0b-44e2-8b99-64567a4fd499 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:34.118667 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac89366-1a0b-44e2-8b99-64567a4fd499 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:34.118939 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac89366-1a0b-44e2-8b99-64567a4fd499 None admin] PATH_INFO: `/v3/projects/1af29be806124b87acadb07ca325b07d` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:34.120108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac89366-1a0b-44e2-8b99-64567a4fd499 None admin] RBAC: Authorizing `identity:get_project(project_id=1af29be806124b87acadb07ca325b07d)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:34.120474 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ea5a5-3a3c-4853-8dbe-887f59d7694e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:34.121569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac89366-1a0b-44e2-8b99-64567a4fd499 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:34.121912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ea5a5-3a3c-4853-8dbe-887f59d7694e None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:34.123523 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 546/1094] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:52:33 2022] GET /identity/v3/projects/1af29be806124b87acadb07ca325b07d => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:34.129432 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac89366-1a0b-44e2-8b99-64567a4fd499 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:34.136352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-a70ea5a5-3a3c-4853-8dbe-887f59d7694e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:52:34.136352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:34.136352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:34.136352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:34.136352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:34.136352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:34.136352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:34.136352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:34.136352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:34.136352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:34.136352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:34.136352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:34.136352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:52:34.136352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:52:34.136352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:52:34.137295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:52:34.137295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:34.137295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:34.137295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:34.137295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:34.137295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:34.137295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:34.137295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:34.137295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:34.137295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:34.137295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:34.137295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:34.137295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:34.137295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:34.137295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:34.137295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:34.137295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:34.139151 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:52:34.139151 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:52:34.139151 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:52:34.139151 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:52:34.139151 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:52:34.139151 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:52:34.139151 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:52:34.139151 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:34.139151 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 549/1095] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:52:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:34.143203 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ea5a5-3a3c-4853-8dbe-887f59d7694e None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:34.213278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:34.229937 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac89366-1a0b-44e2-8b99-64567a4fd499 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:34.234401 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:34.244882 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ea5a5-3a3c-4853-8dbe-887f59d7694e None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:34.265419 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d2729-6c7c-4f34-8235-08dd081394f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:34.266251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d2729-6c7c-4f34-8235-08dd081394f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:34.266532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d2729-6c7c-4f34-8235-08dd081394f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:34.266807 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d2729-6c7c-4f34-8235-08dd081394f4 None admin] PATH_INFO: `/v3/projects/1af29be806124b87acadb07ca325b07d/users/de75b7c0844a4a9ca623072a899ecb7a/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:34.269533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d2729-6c7c-4f34-8235-08dd081394f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=1af29be806124b87acadb07ca325b07d, user_id=de75b7c0844a4a9ca623072a899ecb7a, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:34.270979 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d2729-6c7c-4f34-8235-08dd081394f4 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:34.281164 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dd3a4-2c3f-4565-8c91-37a84ef573e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:34.281937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dd3a4-2c3f-4565-8c91-37a84ef573e1 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:34.282224 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dd3a4-2c3f-4565-8c91-37a84ef573e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:34.282504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dd3a4-2c3f-4565-8c91-37a84ef573e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:34.283401 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0dd3a4-2c3f-4565-8c91-37a84ef573e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:34.283742 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0dd3a4-2c3f-4565-8c91-37a84ef573e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:34.285150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 547/1096] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:52:34 2022] PUT /identity/v3/projects/1af29be806124b87acadb07ca325b07d/users/de75b7c0844a4a9ca623072a899ecb7a/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 01:52:34.285288 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0dd3a4-2c3f-4565-8c91-37a84ef573e1 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:34.299456 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 550/1097] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:52:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:52:34.305726 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d2729-6c7c-4f34-8235-08dd081394f4 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:34.415646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d2729-6c7c-4f34-8235-08dd081394f4 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:34.452518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd0304-9cae-4242-b429-94b42a6b8db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:34.453183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd0304-9cae-4242-b429-94b42a6b8db2 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:34.453467 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd0304-9cae-4242-b429-94b42a6b8db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:34.453741 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd0304-9cae-4242-b429-94b42a6b8db2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:34.454574 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd0304-9cae-4242-b429-94b42a6b8db2 None admin] RBAC: Adding query filter params (role.id=9c41853f063c46f988b072a76610c245, scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018, user.id=9d3b5180fb7144c394c39d4db28713b9) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:34.454927 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd0304-9cae-4242-b429-94b42a6b8db2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:34.456465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd0304-9cae-4242-b429-94b42a6b8db2 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:34.462569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 548/1098] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:52:34 2022] GET /identity/v3/role_assignments?user.id=9d3b5180fb7144c394c39d4db28713b9&scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018&role.id=9c41853f063c46f988b072a76610c245 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:36.258048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be3fd1-cdc5-4b19-9d13-9d67e744fc17 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:36.258593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be3fd1-cdc5-4b19-9d13-9d67e744fc17 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:36.258900 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be3fd1-cdc5-4b19-9d13-9d67e744fc17 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:36.262213 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 551/1099] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:36.267746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b992f-ce29-43c0-94d1-d53584a60643 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:36.268220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b992f-ce29-43c0-94d1-d53584a60643 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:36.268645 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b992f-ce29-43c0-94d1-d53584a60643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:36.287239 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-ee3b992f-ce29-43c0-94d1-d53584a60643 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:36.288463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-ee3b992f-ce29-43c0-94d1-d53584a60643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:36.290452 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:36.358772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 549/1100] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:36.382981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be3fd1-cdc5-4b19-9d13-9d67e744fc17 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:36.504449 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be3fd1-cdc5-4b19-9d13-9d67e744fc17 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:36.549104 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fd049-4f96-491e-bae9-c1b993af0cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:36.549960 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fd049-4f96-491e-bae9-c1b993af0cdf None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:36.550327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fd049-4f96-491e-bae9-c1b993af0cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:36.550692 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fd049-4f96-491e-bae9-c1b993af0cdf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:36.566841 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478fd049-4f96-491e-bae9-c1b993af0cdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:52:36.574615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-478fd049-4f96-491e-bae9-c1b993af0cdf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:52:36.574615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:36.574615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:36.574615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:36.574615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:36.574615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:36.574615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:36.574615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:36.574615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:36.574615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:36.574615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:36.574615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:36.574615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:52:36.574615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:52:36.574615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:52:36.574615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:52:36.575731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:52:36.575731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:52:36.575731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:52:36.575731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:52:36.575731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:36.575731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:36.575731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:36.575731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:36.575731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:36.575731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:36.575731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:36.575731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:36.575731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:36.575731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:36.575731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:36.575731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:36.576734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:36.576734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:36.576734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:36.576734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:36.576734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:52:36.576734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:52:36.576734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:52:36.576734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:52:36.576734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:52:36.576734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:52:36.576734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:52:36.576734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:36.576734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 552/1101] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:52:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:36.582408 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b992f-ce29-43c0-94d1-d53584a60643 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:36.694380 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b992f-ce29-43c0-94d1-d53584a60643 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:36.734309 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a037876-4aca-4fc4-8109-411edd971339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:36.734980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a037876-4aca-4fc4-8109-411edd971339 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:36.735263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a037876-4aca-4fc4-8109-411edd971339 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:36.735566 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a037876-4aca-4fc4-8109-411edd971339 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:36.736433 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a037876-4aca-4fc4-8109-411edd971339 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:36.736827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a037876-4aca-4fc4-8109-411edd971339 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:36.738246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a037876-4aca-4fc4-8109-411edd971339 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:36.743199 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:36.746975 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 550/1102] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:52:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:36.753109 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fd049-4f96-491e-bae9-c1b993af0cdf None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:36.766630 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:36.866527 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fd049-4f96-491e-bae9-c1b993af0cdf None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:36.900981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbef9a9-66a6-4133-a08e-8945a4f9f0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:36.901850 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbef9a9-66a6-4133-a08e-8945a4f9f0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:36.902132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbef9a9-66a6-4133-a08e-8945a4f9f0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:36.902409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbef9a9-66a6-4133-a08e-8945a4f9f0d3 None admin] PATH_INFO: `/v3/users/de75b7c0844a4a9ca623072a899ecb7a` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:36.903676 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbef9a9-66a6-4133-a08e-8945a4f9f0d3 None admin] RBAC: Authorizing `identity:get_user(user_id=de75b7c0844a4a9ca623072a899ecb7a)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:36.905132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbef9a9-66a6-4133-a08e-8945a4f9f0d3 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:36.906779 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 553/1103] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:52:36 2022] GET /identity/v3/users/de75b7c0844a4a9ca623072a899ecb7a => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:36.913340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a037876-4aca-4fc4-8109-411edd971339 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:37.020147 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a037876-4aca-4fc4-8109-411edd971339 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:37.056155 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1f73f-c0a2-4e1f-a8c7-179c2ca3e4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:37.056806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1f73f-c0a2-4e1f-a8c7-179c2ca3e4aa None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:37.057088 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1f73f-c0a2-4e1f-a8c7-179c2ca3e4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:37.057373 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1f73f-c0a2-4e1f-a8c7-179c2ca3e4aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:37.141177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:37.143810 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1f73f-c0a2-4e1f-a8c7-179c2ca3e4aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:37.145985 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1f73f-c0a2-4e1f-a8c7-179c2ca3e4aa None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:37.261384 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 551/1104] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:52:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 01:52:37.270079 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbef9a9-66a6-4133-a08e-8945a4f9f0d3 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:37.356233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:37.378635 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbef9a9-66a6-4133-a08e-8945a4f9f0d3 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:37.415752 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0431e-4297-4a92-bbef-6a054a769406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:37.416532 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0431e-4297-4a92-bbef-6a054a769406 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:37.416807 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0431e-4297-4a92-bbef-6a054a769406 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:37.417075 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0431e-4297-4a92-bbef-6a054a769406 None admin] PATH_INFO: `/v3/projects/1af29be806124b87acadb07ca325b07d` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:37.418374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0431e-4297-4a92-bbef-6a054a769406 None admin] RBAC: Authorizing `identity:get_project(project_id=1af29be806124b87acadb07ca325b07d)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:37.419846 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0431e-4297-4a92-bbef-6a054a769406 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:37.421555 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 554/1105] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:52:37 2022] GET /identity/v3/projects/1af29be806124b87acadb07ca325b07d => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:37.430641 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1f73f-c0a2-4e1f-a8c7-179c2ca3e4aa None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:37.545724 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:37.549668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1f73f-c0a2-4e1f-a8c7-179c2ca3e4aa None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:37.589687 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8391939-6866-4378-ae33-5f50546b61a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:37.590335 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8391939-6866-4378-ae33-5f50546b61a6 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:37.590611 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8391939-6866-4378-ae33-5f50546b61a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:37.590881 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8391939-6866-4378-ae33-5f50546b61a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:37.591753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8391939-6866-4378-ae33-5f50546b61a6 None admin] RBAC: Adding query filter params (role.id=58e04437159e4eb39aa4a43c213ea34c, scope.project.id=1af29be806124b87acadb07ca325b07d, user.id=de75b7c0844a4a9ca623072a899ecb7a) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:37.592062 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8391939-6866-4378-ae33-5f50546b61a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:37.593492 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8391939-6866-4378-ae33-5f50546b61a6 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:37.599623 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 552/1106] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:52:37 2022] GET /identity/v3/role_assignments?user.id=de75b7c0844a4a9ca623072a899ecb7a&scope.project.id=1af29be806124b87acadb07ca325b07d&role.id=58e04437159e4eb39aa4a43c213ea34c => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:39.808547 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330bb50-0485-40d6-81f0-7f2cd1306bfe None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:39.809140 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330bb50-0485-40d6-81f0-7f2cd1306bfe None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:39.809461 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330bb50-0485-40d6-81f0-7f2cd1306bfe None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:39.811150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 555/1107] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:39.816989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58de695-6020-499d-8291-d335691e88a9 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:39.817446 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58de695-6020-499d-8291-d335691e88a9 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:39.817557 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58de695-6020-499d-8291-d335691e88a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:39.843930 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-c58de695-6020-499d-8291-d335691e88a9 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:39.845176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-c58de695-6020-499d-8291-d335691e88a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:39.953799 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 553/1108] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:39.981029 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330bb50-0485-40d6-81f0-7f2cd1306bfe None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:40.092643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330bb50-0485-40d6-81f0-7f2cd1306bfe None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:40.128265 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d77ad-7471-4b9a-b4c3-401b96e9c374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:40.129050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d77ad-7471-4b9a-b4c3-401b96e9c374 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:40.129328 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d77ad-7471-4b9a-b4c3-401b96e9c374 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:40.129598 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d77ad-7471-4b9a-b4c3-401b96e9c374 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:40.130892 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d77ad-7471-4b9a-b4c3-401b96e9c374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:40.132380 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d77ad-7471-4b9a-b4c3-401b96e9c374 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:40.133999 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 556/1109] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:40.143566 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58de695-6020-499d-8291-d335691e88a9 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:40.245950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:40.253038 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58de695-6020-499d-8291-d335691e88a9 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:40.288861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b6e12-84ad-432f-9750-0fd3ec47bd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:40.289540 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b6e12-84ad-432f-9750-0fd3ec47bd5d None admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:40.289818 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b6e12-84ad-432f-9750-0fd3ec47bd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:40.290093 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b6e12-84ad-432f-9750-0fd3ec47bd5d None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:40.290795 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b6e12-84ad-432f-9750-0fd3ec47bd5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:40.292264 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b6e12-84ad-432f-9750-0fd3ec47bd5d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:40.316166 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 554/1110] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 01:52:40 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:52:42.361479 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dc057-3667-4d8b-95a7-5503e683a4a1 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:42.362356 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dc057-3667-4d8b-95a7-5503e683a4a1 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:42.362356 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dc057-3667-4d8b-95a7-5503e683a4a1 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:42.364653 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 557/1111] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:42.373877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49b610-8cd2-41ed-82ab-b635864699bc None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:42.374627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49b610-8cd2-41ed-82ab-b635864699bc None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:42.374779 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49b610-8cd2-41ed-82ab-b635864699bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:42.393225 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-5b49b610-8cd2-41ed-82ab-b635864699bc None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:42.394419 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-5b49b610-8cd2-41ed-82ab-b635864699bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:42.465219 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 555/1112] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:42.489966 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114dc057-3667-4d8b-95a7-5503e683a4a1 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:42.507834 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:42.610977 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114dc057-3667-4d8b-95a7-5503e683a4a1 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:42.646455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1f32d-c4c1-4830-a885-38694f0a8568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:42.647237 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1f32d-c4c1-4830-a885-38694f0a8568 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:42.647550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1f32d-c4c1-4830-a885-38694f0a8568 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:42.647816 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1f32d-c4c1-4830-a885-38694f0a8568 None admin] PATH_INFO: `/v3/roles/77aca4b95bbe47cbb528be2615112ac4` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:42.649392 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1f32d-c4c1-4830-a885-38694f0a8568 None admin] RBAC: Authorizing `identity:get_role(role_id=77aca4b95bbe47cbb528be2615112ac4)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:42.650765 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1f32d-c4c1-4830-a885-38694f0a8568 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:42.652235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 558/1113] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:52:42 2022] GET /identity/v3/roles/77aca4b95bbe47cbb528be2615112ac4 => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:42.661262 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49b610-8cd2-41ed-82ab-b635864699bc None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:42.748949 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:42.769924 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49b610-8cd2-41ed-82ab-b635864699bc None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:42.807649 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae33f8a-d4bf-4b1d-ac42-f6b2da904eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:42.808520 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae33f8a-d4bf-4b1d-ac42-f6b2da904eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:42.808794 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae33f8a-d4bf-4b1d-ac42-f6b2da904eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:42.809058 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae33f8a-d4bf-4b1d-ac42-f6b2da904eb1 None admin] PATH_INFO: `/v3/users/391d10bf45754264af442ca088b81bca` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:42.823360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae33f8a-d4bf-4b1d-ac42-f6b2da904eb1 None admin] RBAC: Authorizing `identity:get_user(user_id=391d10bf45754264af442ca088b81bca)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:42.824829 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae33f8a-d4bf-4b1d-ac42-f6b2da904eb1 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:42.826465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 556/1114] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:52:42 2022] GET /identity/v3/users/391d10bf45754264af442ca088b81bca => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:42.833194 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1f32d-c4c1-4830-a885-38694f0a8568 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:42.935808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:42.955047 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1f32d-c4c1-4830-a885-38694f0a8568 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:42.990091 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180665d6-a3b5-422f-8326-273b0aeb7c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:42.990732 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180665d6-a3b5-422f-8326-273b0aeb7c56 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:42.991005 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180665d6-a3b5-422f-8326-273b0aeb7c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:42.991274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180665d6-a3b5-422f-8326-273b0aeb7c56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:43.068044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180665d6-a3b5-422f-8326-273b0aeb7c56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:43.069491 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180665d6-a3b5-422f-8326-273b0aeb7c56 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:43.163382 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:43.183382 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 559/1115] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:52:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 01:52:43.190055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae33f8a-d4bf-4b1d-ac42-f6b2da904eb1 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:43.293215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae33f8a-d4bf-4b1d-ac42-f6b2da904eb1 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:43.329644 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c879b2b-8aaa-4f83-8281-6c541a133e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:43.330489 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c879b2b-8aaa-4f83-8281-6c541a133e03 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:43.330769 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c879b2b-8aaa-4f83-8281-6c541a133e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:43.331037 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c879b2b-8aaa-4f83-8281-6c541a133e03 None admin] PATH_INFO: `/v3/projects/1af29be806124b87acadb07ca325b07d` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:43.332272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c879b2b-8aaa-4f83-8281-6c541a133e03 None admin] RBAC: Authorizing `identity:get_project(project_id=1af29be806124b87acadb07ca325b07d)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:43.333691 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c879b2b-8aaa-4f83-8281-6c541a133e03 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:43.335367 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 557/1116] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:52:43 2022] GET /identity/v3/projects/1af29be806124b87acadb07ca325b07d => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:43.342206 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180665d6-a3b5-422f-8326-273b0aeb7c56 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:43.462166 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180665d6-a3b5-422f-8326-273b0aeb7c56 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:43.499250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15d76c-83a1-4d4f-8a3f-adc9d728957d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:43.499942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15d76c-83a1-4d4f-8a3f-adc9d728957d None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:43.500222 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15d76c-83a1-4d4f-8a3f-adc9d728957d None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:43.500495 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15d76c-83a1-4d4f-8a3f-adc9d728957d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:43.501345 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15d76c-83a1-4d4f-8a3f-adc9d728957d None admin] RBAC: Adding query filter params (role.id=77aca4b95bbe47cbb528be2615112ac4, scope.project.id=1af29be806124b87acadb07ca325b07d, user.id=391d10bf45754264af442ca088b81bca) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:43.501657 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15d76c-83a1-4d4f-8a3f-adc9d728957d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:43.503286 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15d76c-83a1-4d4f-8a3f-adc9d728957d None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:43.509160 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 560/1117] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:52:43 2022] GET /identity/v3/role_assignments?user.id=391d10bf45754264af442ca088b81bca&scope.project.id=1af29be806124b87acadb07ca325b07d&role.id=77aca4b95bbe47cbb528be2615112ac4 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:45.488763 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42ac32-0b38-478c-a55d-811c33b6bfe9 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:45.489386 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42ac32-0b38-478c-a55d-811c33b6bfe9 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:45.489386 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42ac32-0b38-478c-a55d-811c33b6bfe9 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:45.490691 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 558/1118] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:45.497145 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e550c-ea12-4aab-b636-491b724b15ca None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:45.497927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e550c-ea12-4aab-b636-491b724b15ca None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:45.498072 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e550c-ea12-4aab-b636-491b724b15ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:45.518232 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-c50e550c-ea12-4aab-b636-491b724b15ca None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:45.520146 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-c50e550c-ea12-4aab-b636-491b724b15ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:45.572352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:45.599098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 561/1119] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:45.622878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42ac32-0b38-478c-a55d-811c33b6bfe9 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:45.632350 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:45.728935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42ac32-0b38-478c-a55d-811c33b6bfe9 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:45.764242 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd4e6c-504a-4ae2-8d5d-2daf27516c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:45.765038 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd4e6c-504a-4ae2-8d5d-2daf27516c42 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:45.765312 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd4e6c-504a-4ae2-8d5d-2daf27516c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:45.765596 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd4e6c-504a-4ae2-8d5d-2daf27516c42 None admin] PATH_INFO: `/v3/roles/77aca4b95bbe47cbb528be2615112ac4` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:45.767253 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd4e6c-504a-4ae2-8d5d-2daf27516c42 None admin] RBAC: Authorizing `identity:get_role(role_id=77aca4b95bbe47cbb528be2615112ac4)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:45.768661 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd4e6c-504a-4ae2-8d5d-2daf27516c42 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:45.770039 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 559/1120] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:52:45 2022] GET /identity/v3/roles/77aca4b95bbe47cbb528be2615112ac4 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:45.776375 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e550c-ea12-4aab-b636-491b724b15ca None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:45.891337 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e550c-ea12-4aab-b636-491b724b15ca None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:45.932773 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431556a-39d4-429e-b6c6-beb47f12c75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:45.933670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431556a-39d4-429e-b6c6-beb47f12c75b None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:45.933945 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431556a-39d4-429e-b6c6-beb47f12c75b None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:45.934211 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431556a-39d4-429e-b6c6-beb47f12c75b None admin] PATH_INFO: `/v3/users/391d10bf45754264af442ca088b81bca` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:45.935881 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431556a-39d4-429e-b6c6-beb47f12c75b None admin] RBAC: Authorizing `identity:get_user(user_id=391d10bf45754264af442ca088b81bca)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:45.937337 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431556a-39d4-429e-b6c6-beb47f12c75b None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:45.938967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 562/1121] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:52:45 2022] GET /identity/v3/users/391d10bf45754264af442ca088b81bca => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:45.945078 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd4e6c-504a-4ae2-8d5d-2daf27516c42 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:46.028667 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:46.054998 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd4e6c-504a-4ae2-8d5d-2daf27516c42 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:46.090047 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcc842-5522-4c76-9c83-ca9041b5c762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:46.090909 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcc842-5522-4c76-9c83-ca9041b5c762 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:46.091194 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcc842-5522-4c76-9c83-ca9041b5c762 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:46.091561 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcc842-5522-4c76-9c83-ca9041b5c762 None admin] PATH_INFO: `/v3/projects/1af29be806124b87acadb07ca325b07d` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:46.092868 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcc842-5522-4c76-9c83-ca9041b5c762 None admin] RBAC: Authorizing `identity:get_project(project_id=1af29be806124b87acadb07ca325b07d)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:46.094307 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcc842-5522-4c76-9c83-ca9041b5c762 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:46.096095 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 560/1122] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:52:45 2022] GET /identity/v3/projects/1af29be806124b87acadb07ca325b07d => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:46.102240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431556a-39d4-429e-b6c6-beb47f12c75b None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:46.150546 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:46.216324 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431556a-39d4-429e-b6c6-beb47f12c75b None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:46.252431 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b1a41-7283-48e7-9507-9122cc2901b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:46.253318 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b1a41-7283-48e7-9507-9122cc2901b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:46.253597 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b1a41-7283-48e7-9507-9122cc2901b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:46.253867 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b1a41-7283-48e7-9507-9122cc2901b0 None admin] PATH_INFO: `/v3/projects/1af29be806124b87acadb07ca325b07d/users/391d10bf45754264af442ca088b81bca/roles/77aca4b95bbe47cbb528be2615112ac4` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:46.256315 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b1a41-7283-48e7-9507-9122cc2901b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=1af29be806124b87acadb07ca325b07d, user_id=391d10bf45754264af442ca088b81bca, role_id=77aca4b95bbe47cbb528be2615112ac4)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:46.257755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b1a41-7283-48e7-9507-9122cc2901b0 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:46.274033 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 563/1123] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:52:46 2022] PUT /identity/v3/projects/1af29be806124b87acadb07ca325b07d/users/391d10bf45754264af442ca088b81bca/roles/77aca4b95bbe47cbb528be2615112ac4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:52:48.257088 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55406ada-e2ba-4159-b215-54d93b933f35 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:48.257652 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55406ada-e2ba-4159-b215-54d93b933f35 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:48.257652 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55406ada-e2ba-4159-b215-54d93b933f35 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:48.259003 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 561/1124] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:48.265394 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97201243-84c6-4c9e-96cf-962f85077b27 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:48.266141 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97201243-84c6-4c9e-96cf-962f85077b27 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:48.266309 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97201243-84c6-4c9e-96cf-962f85077b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:48.289975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-97201243-84c6-4c9e-96cf-962f85077b27 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:48.291165 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-97201243-84c6-4c9e-96cf-962f85077b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:48.376152 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 564/1125] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:48.400478 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55406ada-e2ba-4159-b215-54d93b933f35 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:48.509980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55406ada-e2ba-4159-b215-54d93b933f35 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:48.556898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d016c-17e1-4986-a10a-d80e408a55e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:48.558162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d016c-17e1-4986-a10a-d80e408a55e0 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:48.558526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d016c-17e1-4986-a10a-d80e408a55e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:48.558897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d016c-17e1-4986-a10a-d80e408a55e0 None admin] PATH_INFO: `/v3/roles/77aca4b95bbe47cbb528be2615112ac4` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:48.561842 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d016c-17e1-4986-a10a-d80e408a55e0 None admin] RBAC: Authorizing `identity:get_role(role_id=77aca4b95bbe47cbb528be2615112ac4)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:48.564052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d016c-17e1-4986-a10a-d80e408a55e0 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:48.565420 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 562/1126] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:52:48 2022] GET /identity/v3/roles/77aca4b95bbe47cbb528be2615112ac4 => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:48.571317 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97201243-84c6-4c9e-96cf-962f85077b27 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:48.607081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:48.691043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97201243-84c6-4c9e-96cf-962f85077b27 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:48.727848 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef76b48-9eea-4c43-b739-7362ad194771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:48.728717 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef76b48-9eea-4c43-b739-7362ad194771 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:48.728988 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef76b48-9eea-4c43-b739-7362ad194771 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:48.729258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef76b48-9eea-4c43-b739-7362ad194771 None admin] PATH_INFO: `/v3/users/391d10bf45754264af442ca088b81bca` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:48.730554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef76b48-9eea-4c43-b739-7362ad194771 None admin] RBAC: Authorizing `identity:get_user(user_id=391d10bf45754264af442ca088b81bca)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:48.732029 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef76b48-9eea-4c43-b739-7362ad194771 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:48.733632 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 565/1127] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:52:48 2022] GET /identity/v3/users/391d10bf45754264af442ca088b81bca => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:48.740376 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d016c-17e1-4986-a10a-d80e408a55e0 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:48.753320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:48.847301 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d016c-17e1-4986-a10a-d80e408a55e0 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:48.882975 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30f9f7-b1d8-46d1-8692-1be387d2f2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:48.883648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30f9f7-b1d8-46d1-8692-1be387d2f2cc None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:48.883927 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30f9f7-b1d8-46d1-8692-1be387d2f2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:48.884209 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30f9f7-b1d8-46d1-8692-1be387d2f2cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:48.953866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30f9f7-b1d8-46d1-8692-1be387d2f2cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:48.955535 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30f9f7-b1d8-46d1-8692-1be387d2f2cc None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:48.966591 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:49.061236 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 563/1128] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:52:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 01:52:49.067831 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef76b48-9eea-4c43-b739-7362ad194771 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:49.184696 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef76b48-9eea-4c43-b739-7362ad194771 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:49.186548 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:49.234484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbbf66-d1a0-4e91-b049-72f6e9bfd6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:49.235354 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbbf66-d1a0-4e91-b049-72f6e9bfd6eb None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:49.235865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbbf66-d1a0-4e91-b049-72f6e9bfd6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:49.236457 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbbf66-d1a0-4e91-b049-72f6e9bfd6eb None admin] PATH_INFO: `/v3/projects/1af29be806124b87acadb07ca325b07d` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:49.237795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbbf66-d1a0-4e91-b049-72f6e9bfd6eb None admin] RBAC: Authorizing `identity:get_project(project_id=1af29be806124b87acadb07ca325b07d)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:49.239256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbbf66-d1a0-4e91-b049-72f6e9bfd6eb None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:49.241002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 566/1129] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:52:49 2022] GET /identity/v3/projects/1af29be806124b87acadb07ca325b07d => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:49.247622 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30f9f7-b1d8-46d1-8692-1be387d2f2cc None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:49.354821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30f9f7-b1d8-46d1-8692-1be387d2f2cc None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:49.365444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:49.391558 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0c65e-daa4-4935-9bed-f8a3cd7ea3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:49.392378 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0c65e-daa4-4935-9bed-f8a3cd7ea3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:49.392662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0c65e-daa4-4935-9bed-f8a3cd7ea3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:49.392938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0c65e-daa4-4935-9bed-f8a3cd7ea3f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:49.393768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0c65e-daa4-4935-9bed-f8a3cd7ea3f3 None admin] RBAC: Adding query filter params (role.id=77aca4b95bbe47cbb528be2615112ac4, scope.project.id=1af29be806124b87acadb07ca325b07d, user.id=391d10bf45754264af442ca088b81bca) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:49.394083 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0c65e-daa4-4935-9bed-f8a3cd7ea3f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:49.395535 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0c65e-daa4-4935-9bed-f8a3cd7ea3f3 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:49.401656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 564/1130] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:52:49 2022] GET /identity/v3/role_assignments?user.id=391d10bf45754264af442ca088b81bca&scope.project.id=1af29be806124b87acadb07ca325b07d&role.id=77aca4b95bbe47cbb528be2615112ac4 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:51.439524 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31927f79-bb97-402f-a5ca-2e6b248f2161 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:51.440117 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31927f79-bb97-402f-a5ca-2e6b248f2161 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:51.440231 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31927f79-bb97-402f-a5ca-2e6b248f2161 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:51.442560 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 567/1131] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:51.451491 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfab12-da35-48ef-a772-1e6ffb83638b None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:51.451868 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfab12-da35-48ef-a772-1e6ffb83638b None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:51.452068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfab12-da35-48ef-a772-1e6ffb83638b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:51.476372 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-a5bfab12-da35-48ef-a772-1e6ffb83638b None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:51.477554 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a5bfab12-da35-48ef-a772-1e6ffb83638b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:51.545811 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 565/1132] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:51.576779 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31927f79-bb97-402f-a5ca-2e6b248f2161 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:51.697068 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31927f79-bb97-402f-a5ca-2e6b248f2161 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:51.732551 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8c7af-e7c6-4e53-81ed-ae58e5fc9acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:51.733356 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8c7af-e7c6-4e53-81ed-ae58e5fc9acc None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:51.733643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8c7af-e7c6-4e53-81ed-ae58e5fc9acc None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:51.733918 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8c7af-e7c6-4e53-81ed-ae58e5fc9acc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:51.735262 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8c7af-e7c6-4e53-81ed-ae58e5fc9acc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:51.736895 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8c7af-e7c6-4e53-81ed-ae58e5fc9acc None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:51.738536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 568/1133] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:51.745498 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfab12-da35-48ef-a772-1e6ffb83638b None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:51.858358 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfab12-da35-48ef-a772-1e6ffb83638b None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:51.860994 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:51.893642 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16302d8-5cf5-4119-887d-54920fcc2300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:51.894293 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16302d8-5cf5-4119-887d-54920fcc2300 None admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:51.894569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16302d8-5cf5-4119-887d-54920fcc2300 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:51.894842 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16302d8-5cf5-4119-887d-54920fcc2300 None admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:51.895579 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16302d8-5cf5-4119-887d-54920fcc2300 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:51.897376 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16302d8-5cf5-4119-887d-54920fcc2300 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:51.925404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 566/1134] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 01:52:51 2022] POST /identity/v3/projects => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:52:53.985373 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd32517-702f-43f9-a3a7-bcf836bf88a7 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:53.986168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd32517-702f-43f9-a3a7-bcf836bf88a7 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:53.986495 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd32517-702f-43f9-a3a7-bcf836bf88a7 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:53.988969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 569/1135] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:53.997887 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84ca82-ebde-4f56-aeaa-189278b0e4e1 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:53.998639 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84ca82-ebde-4f56-aeaa-189278b0e4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:53.998821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84ca82-ebde-4f56-aeaa-189278b0e4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:54.025262 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-df84ca82-ebde-4f56-aeaa-189278b0e4e1 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:54.026980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-df84ca82-ebde-4f56-aeaa-189278b0e4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:54.105333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 567/1136] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:54.130623 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd32517-702f-43f9-a3a7-bcf836bf88a7 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:54.177974 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:54.240855 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd32517-702f-43f9-a3a7-bcf836bf88a7 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:54.278422 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769d951-d21d-469a-a506-c4d97a124b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:54.279219 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769d951-d21d-469a-a506-c4d97a124b0c None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:54.279525 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769d951-d21d-469a-a506-c4d97a124b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:54.279796 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769d951-d21d-469a-a506-c4d97a124b0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:54.281016 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769d951-d21d-469a-a506-c4d97a124b0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:54.282622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769d951-d21d-469a-a506-c4d97a124b0c None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:54.284273 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 570/1137] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:52:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:54.290269 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84ca82-ebde-4f56-aeaa-189278b0e4e1 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:54.384965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:54.403788 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84ca82-ebde-4f56-aeaa-189278b0e4e1 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:54.440408 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdebe9c-1053-4a3f-9dc9-fcad0e90b27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:54.441015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdebe9c-1053-4a3f-9dc9-fcad0e90b27f None admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:54.441293 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdebe9c-1053-4a3f-9dc9-fcad0e90b27f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:54.441568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdebe9c-1053-4a3f-9dc9-fcad0e90b27f None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:54.442275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdebe9c-1053-4a3f-9dc9-fcad0e90b27f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:54.443729 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdebe9c-1053-4a3f-9dc9-fcad0e90b27f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:54.465956 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 568/1138] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 01:52:54 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:52:56.529394 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb51ba-4f0d-4c63-9bcb-e881370c65a8 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:56.529958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb51ba-4f0d-4c63-9bcb-e881370c65a8 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:56.529958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb51ba-4f0d-4c63-9bcb-e881370c65a8 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:56.531302 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 571/1139] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:56.536819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49665e06-2ffb-41a2-a2f1-4e8b897c0385 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:56.537273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49665e06-2ffb-41a2-a2f1-4e8b897c0385 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:56.537367 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49665e06-2ffb-41a2-a2f1-4e8b897c0385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:56.556022 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-49665e06-2ffb-41a2-a2f1-4e8b897c0385 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:56.557189 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-49665e06-2ffb-41a2-a2f1-4e8b897c0385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:56.628176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 569/1140] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:56.652620 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb51ba-4f0d-4c63-9bcb-e881370c65a8 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:56.774460 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb51ba-4f0d-4c63-9bcb-e881370c65a8 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:56.781758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:56.816141 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4faf2-a58e-4c2c-a13e-a4bfda088e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:56.816926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4faf2-a58e-4c2c-a13e-a4bfda088e30 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:56.817199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4faf2-a58e-4c2c-a13e-a4bfda088e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:56.817464 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4faf2-a58e-4c2c-a13e-a4bfda088e30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:56.828173 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4faf2-a58e-4c2c-a13e-a4bfda088e30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:52:56.835906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-68d4faf2-a58e-4c2c-a13e-a4bfda088e30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:52:56.835906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:52:56.835906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:52:56.835906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:52:56.835906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:52:56.835906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:52:56.835906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:52:56.835906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:52:56.835906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:52:56.835906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:52:56.835906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:52:56.835906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:52:56.835906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:52:56.835906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:52:56.835906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:52:56.835906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:52:56.836949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:52:56.836949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:52:56.836949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:52:56.836949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:52:56.836949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:52:56.836949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:52:56.836949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:52:56.836949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:52:56.836949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:52:56.836949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:52:56.836949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:52:56.836949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:52:56.836949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:52:56.836949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:52:56.836949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:52:56.836949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:52:56.837926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:52:56.837926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:52:56.837926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:52:56.837926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:52:56.837926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:52:56.837926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:52:56.837926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:52:56.837926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:52:56.837926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:52:56.837926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:52:56.837926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:52:56.837926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:52:56.837926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 572/1141] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:52:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:52:56.843235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49665e06-2ffb-41a2-a2f1-4e8b897c0385 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:56.919052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:56.951258 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49665e06-2ffb-41a2-a2f1-4e8b897c0385 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:56.998944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d83b10-e07b-4ac3-adec-b82829e19421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:56.999641 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d83b10-e07b-4ac3-adec-b82829e19421 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:56.999928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d83b10-e07b-4ac3-adec-b82829e19421 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:57.000198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d83b10-e07b-4ac3-adec-b82829e19421 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:57.001292 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d83b10-e07b-4ac3-adec-b82829e19421 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:57.001292 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d83b10-e07b-4ac3-adec-b82829e19421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:57.002627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d83b10-e07b-4ac3-adec-b82829e19421 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:57.010794 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 570/1142] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:52:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:57.017366 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4faf2-a58e-4c2c-a13e-a4bfda088e30 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:57.145173 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4faf2-a58e-4c2c-a13e-a4bfda088e30 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:57.183131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e428a-752d-43f6-9e68-9b56963ad69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:57.184037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e428a-752d-43f6-9e68-9b56963ad69e None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:57.184320 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e428a-752d-43f6-9e68-9b56963ad69e None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:57.184597 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e428a-752d-43f6-9e68-9b56963ad69e None admin] PATH_INFO: `/v3/users/93b561f19cce4f61b413e0af676afa29` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:57.200138 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e428a-752d-43f6-9e68-9b56963ad69e None admin] RBAC: Authorizing `identity:get_user(user_id=93b561f19cce4f61b413e0af676afa29)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:57.201605 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e428a-752d-43f6-9e68-9b56963ad69e None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:57.203253 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 573/1143] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:52:57 2022] GET /identity/v3/users/93b561f19cce4f61b413e0af676afa29 => generated 286 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:57.209644 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d83b10-e07b-4ac3-adec-b82829e19421 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:57.316184 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d83b10-e07b-4ac3-adec-b82829e19421 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:57.350944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede5e4f-1c14-4e8a-8b61-75201e276d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:57.351614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede5e4f-1c14-4e8a-8b61-75201e276d9f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:57.351892 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede5e4f-1c14-4e8a-8b61-75201e276d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:57.352136 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede5e4f-1c14-4e8a-8b61-75201e276d9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:57.355061 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:57.422945 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede5e4f-1c14-4e8a-8b61-75201e276d9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:57.424540 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede5e4f-1c14-4e8a-8b61-75201e276d9f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:57.528696 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 571/1144] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:52:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 01:52:57.535114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e428a-752d-43f6-9e68-9b56963ad69e None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:57.570448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:57.648031 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e428a-752d-43f6-9e68-9b56963ad69e None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:57.684413 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c332d2e-9230-47fe-b54f-3103fe25e563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:57.685522 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c332d2e-9230-47fe-b54f-3103fe25e563 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:57.685799 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c332d2e-9230-47fe-b54f-3103fe25e563 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:57.686074 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c332d2e-9230-47fe-b54f-3103fe25e563 None admin] PATH_INFO: `/v3/projects/ca9b12fcf1e54f78a584a3122f3b91e1` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:57.687313 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c332d2e-9230-47fe-b54f-3103fe25e563 None admin] RBAC: Authorizing `identity:get_project(project_id=ca9b12fcf1e54f78a584a3122f3b91e1)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:57.689135 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c332d2e-9230-47fe-b54f-3103fe25e563 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:57.690859 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 574/1145] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:52:57 2022] GET /identity/v3/projects/ca9b12fcf1e54f78a584a3122f3b91e1 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:57.700888 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede5e4f-1c14-4e8a-8b61-75201e276d9f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:52:57.738757 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:52:57.809723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede5e4f-1c14-4e8a-8b61-75201e276d9f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:52:57.853086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0459914-51ca-4c2b-be91-d7f28d73d14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:52:57.853731 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0459914-51ca-4c2b-be91-d7f28d73d14b None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:57.854008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0459914-51ca-4c2b-be91-d7f28d73d14b None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:57.854276 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0459914-51ca-4c2b-be91-d7f28d73d14b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:57.855101 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0459914-51ca-4c2b-be91-d7f28d73d14b None admin] RBAC: Adding query filter params (role.id=58e04437159e4eb39aa4a43c213ea34c, scope.project.id=ca9b12fcf1e54f78a584a3122f3b91e1, user.id=93b561f19cce4f61b413e0af676afa29) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:52:57.855445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0459914-51ca-4c2b-be91-d7f28d73d14b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:52:57.856876 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0459914-51ca-4c2b-be91-d7f28d73d14b None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:52:57.862588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 572/1146] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:52:57 2022] GET /identity/v3/role_assignments?user.id=93b561f19cce4f61b413e0af676afa29&scope.project.id=ca9b12fcf1e54f78a584a3122f3b91e1&role.id=58e04437159e4eb39aa4a43c213ea34c => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:52:59.832430 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aee35-c08a-47fb-a687-1eb0269b7f46 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:59.833309 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aee35-c08a-47fb-a687-1eb0269b7f46 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:59.833309 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aee35-c08a-47fb-a687-1eb0269b7f46 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:59.835507 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 575/1147] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:52:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:52:59.841824 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd185a3-739d-4c12-b6b1-16817e0fc225 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:52:59.842259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd185a3-739d-4c12-b6b1-16817e0fc225 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:52:59.842398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd185a3-739d-4c12-b6b1-16817e0fc225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:52:59.860637 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-5fd185a3-739d-4c12-b6b1-16817e0fc225 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:52:59.861891 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-5fd185a3-739d-4c12-b6b1-16817e0fc225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:52:59.934166 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 573/1148] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:52:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:52:59.957679 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aee35-c08a-47fb-a687-1eb0269b7f46 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:00.055646 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:00.067146 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aee35-c08a-47fb-a687-1eb0269b7f46 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:00.102551 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de05e0-3da8-4896-8d04-f96f40c992c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:00.103275 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de05e0-3da8-4896-8d04-f96f40c992c8 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:00.103590 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de05e0-3da8-4896-8d04-f96f40c992c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:00.103864 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de05e0-3da8-4896-8d04-f96f40c992c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:00.114034 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de05e0-3da8-4896-8d04-f96f40c992c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:53:00.121836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-d9de05e0-3da8-4896-8d04-f96f40c992c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:53:00.121836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:53:00.121836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:53:00.121836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:53:00.121836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:53:00.121836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:53:00.121836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:53:00.121836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:53:00.121836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:53:00.121836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:53:00.121836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:53:00.121836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:53:00.121836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:53:00.121836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:53:00.121836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:53:00.121836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:53:00.122909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:53:00.122909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:53:00.122909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:53:00.122909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:53:00.122909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:53:00.122909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:53:00.122909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:53:00.122909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:53:00.122909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:53:00.122909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:53:00.122909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:53:00.122909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:53:00.122909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:53:00.122909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:53:00.122909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:53:00.122909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:53:00.124644 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:53:00.124644 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:53:00.124644 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:53:00.124644 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:53:00.124644 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:53:00.124644 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:53:00.124644 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:53:00.124644 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:53:00.124644 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:53:00.124644 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:53:00.124644 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:53:00.124644 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:53:00.124644 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 576/1149] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:52:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:53:00.132457 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd185a3-739d-4c12-b6b1-16817e0fc225 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:00.162724 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:00.244580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd185a3-739d-4c12-b6b1-16817e0fc225 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:00.292731 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d29d2-3fad-46f6-a4a2-17e11c64f307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:00.293389 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d29d2-3fad-46f6-a4a2-17e11c64f307 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:00.293670 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d29d2-3fad-46f6-a4a2-17e11c64f307 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:00.293941 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d29d2-3fad-46f6-a4a2-17e11c64f307 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:00.294684 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d29d2-3fad-46f6-a4a2-17e11c64f307 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:53:00.294995 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d29d2-3fad-46f6-a4a2-17e11c64f307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:00.296382 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d29d2-3fad-46f6-a4a2-17e11c64f307 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:00.304579 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 574/1150] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:53:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:53:00.313616 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de05e0-3da8-4896-8d04-f96f40c992c8 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:00.426786 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de05e0-3da8-4896-8d04-f96f40c992c8 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:00.468144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c61192-fe42-48e1-9723-6b20a947aaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:00.469014 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c61192-fe42-48e1-9723-6b20a947aaf8 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:00.469292 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c61192-fe42-48e1-9723-6b20a947aaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:00.469656 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c61192-fe42-48e1-9723-6b20a947aaf8 None admin] PATH_INFO: `/v3/users/93b561f19cce4f61b413e0af676afa29` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:00.470881 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c61192-fe42-48e1-9723-6b20a947aaf8 None admin] RBAC: Authorizing `identity:get_user(user_id=93b561f19cce4f61b413e0af676afa29)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:00.472366 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c61192-fe42-48e1-9723-6b20a947aaf8 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:00.473988 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 577/1151] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:53:00 2022] GET /identity/v3/users/93b561f19cce4f61b413e0af676afa29 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:53:00.479908 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d29d2-3fad-46f6-a4a2-17e11c64f307 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:00.579429 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:00.589689 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d29d2-3fad-46f6-a4a2-17e11c64f307 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:00.624315 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa372e90-fa6c-43c7-aad6-54b1265db865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:00.625184 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa372e90-fa6c-43c7-aad6-54b1265db865 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:00.625458 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa372e90-fa6c-43c7-aad6-54b1265db865 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:00.625888 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa372e90-fa6c-43c7-aad6-54b1265db865 None admin] PATH_INFO: `/v3/projects/ca9b12fcf1e54f78a584a3122f3b91e1` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:00.627094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa372e90-fa6c-43c7-aad6-54b1265db865 None admin] RBAC: Authorizing `identity:get_project(project_id=ca9b12fcf1e54f78a584a3122f3b91e1)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:00.628563 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa372e90-fa6c-43c7-aad6-54b1265db865 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:00.630296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 575/1152] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:53:00 2022] GET /identity/v3/projects/ca9b12fcf1e54f78a584a3122f3b91e1 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:53:00.637012 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c61192-fe42-48e1-9723-6b20a947aaf8 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:00.672000 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:00.749815 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c61192-fe42-48e1-9723-6b20a947aaf8 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:00.794752 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269c225-5edc-444a-9c37-85b91e53b582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:00.796210 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269c225-5edc-444a-9c37-85b91e53b582 None admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:00.796664 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269c225-5edc-444a-9c37-85b91e53b582 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:00.797117 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269c225-5edc-444a-9c37-85b91e53b582 None admin] PATH_INFO: `/v3/projects/ca9b12fcf1e54f78a584a3122f3b91e1/users/93b561f19cce4f61b413e0af676afa29/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:00.799850 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269c225-5edc-444a-9c37-85b91e53b582 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca9b12fcf1e54f78a584a3122f3b91e1, user_id=93b561f19cce4f61b413e0af676afa29, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:00.801305 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269c225-5edc-444a-9c37-85b91e53b582 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:00.822013 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 578/1153] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:53:00 2022] PUT /identity/v3/projects/ca9b12fcf1e54f78a584a3122f3b91e1/users/93b561f19cce4f61b413e0af676afa29/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:53:02.795092 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ab0df-7377-4edf-9063-5c9e118c69a2 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:02.795745 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ab0df-7377-4edf-9063-5c9e118c69a2 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:02.795745 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ab0df-7377-4edf-9063-5c9e118c69a2 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:02.798229 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 576/1154] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:53:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:53:02.806170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92fb06-5b22-4532-9620-13306ee440d3 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:02.806636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92fb06-5b22-4532-9620-13306ee440d3 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:02.806745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92fb06-5b22-4532-9620-13306ee440d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:02.829750 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-9d92fb06-5b22-4532-9620-13306ee440d3 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:53:02.831698 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-9d92fb06-5b22-4532-9620-13306ee440d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:53:02.908092 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 579/1155] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:53:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 01:53:02.932029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ab0df-7377-4edf-9063-5c9e118c69a2 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:03.039698 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ab0df-7377-4edf-9063-5c9e118c69a2 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:03.075459 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cc3c9-1e0c-4a87-a0ae-48dc68732906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:03.076184 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cc3c9-1e0c-4a87-a0ae-48dc68732906 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:03.076462 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cc3c9-1e0c-4a87-a0ae-48dc68732906 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:03.076745 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cc3c9-1e0c-4a87-a0ae-48dc68732906 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:03.087458 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cc3c9-1e0c-4a87-a0ae-48dc68732906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:53:03.095447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-220cc3c9-1e0c-4a87-a0ae-48dc68732906 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:53:03.095447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:53:03.095447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:53:03.095447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:53:03.095447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:53:03.095447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:53:03.095447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:53:03.095447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:53:03.095447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:53:03.095447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:53:03.095447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:53:03.095447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:53:03.095447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:53:03.095447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:53:03.095447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:53:03.095447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:53:03.096501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:53:03.096501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:53:03.096501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:53:03.096501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:53:03.096501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:53:03.096501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:53:03.096501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:53:03.096501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:53:03.096501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:53:03.096501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:53:03.096501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:53:03.096501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:53:03.096501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:53:03.096501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:53:03.096501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:53:03.096501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:53:03.097413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:53:03.097413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:53:03.097413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:53:03.097413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:53:03.097413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:53:03.097413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:53:03.097413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:53:03.097413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:53:03.097413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:53:03.097413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:53:03.097413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:53:03.097413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:53:03.097413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 577/1156] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:53:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:53:03.102787 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92fb06-5b22-4532-9620-13306ee440d3 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:03.115758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:03.210474 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92fb06-5b22-4532-9620-13306ee440d3 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:03.246624 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e34d19-e30d-4454-b131-5ef61c3c96be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:03.247282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e34d19-e30d-4454-b131-5ef61c3c96be None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:03.247597 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e34d19-e30d-4454-b131-5ef61c3c96be None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:03.247869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e34d19-e30d-4454-b131-5ef61c3c96be None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:03.248616 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e34d19-e30d-4454-b131-5ef61c3c96be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:53:03.248925 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e34d19-e30d-4454-b131-5ef61c3c96be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:03.250317 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e34d19-e30d-4454-b131-5ef61c3c96be None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:03.258647 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 580/1157] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:53:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:53:03.267960 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cc3c9-1e0c-4a87-a0ae-48dc68732906 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:03.294432 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:03.382374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cc3c9-1e0c-4a87-a0ae-48dc68732906 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:03.422100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16746be-c735-43cd-a485-db14bd0da82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:03.423022 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16746be-c735-43cd-a485-db14bd0da82f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:03.423297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16746be-c735-43cd-a485-db14bd0da82f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:03.423600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16746be-c735-43cd-a485-db14bd0da82f None admin] PATH_INFO: `/v3/users/93b561f19cce4f61b413e0af676afa29` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:03.424918 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16746be-c735-43cd-a485-db14bd0da82f None admin] RBAC: Authorizing `identity:get_user(user_id=93b561f19cce4f61b413e0af676afa29)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:03.426338 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16746be-c735-43cd-a485-db14bd0da82f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:03.427993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 578/1158] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:53:03 2022] GET /identity/v3/users/93b561f19cce4f61b413e0af676afa29 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:53:03.437548 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e34d19-e30d-4454-b131-5ef61c3c96be None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:03.513151 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:03.545265 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e34d19-e30d-4454-b131-5ef61c3c96be None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:03.580799 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fdc3b-8124-4472-8e38-d785ea9846c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:03.581442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fdc3b-8124-4472-8e38-d785ea9846c1 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:03.581729 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fdc3b-8124-4472-8e38-d785ea9846c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:03.582008 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fdc3b-8124-4472-8e38-d785ea9846c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:03.655919 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fdc3b-8124-4472-8e38-d785ea9846c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:03.657340 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fdc3b-8124-4472-8e38-d785ea9846c1 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:03.724687 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:03.760309 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 581/1159] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:53:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 01:53:03.766371 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16746be-c735-43cd-a485-db14bd0da82f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:03.859080 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:03.875714 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16746be-c735-43cd-a485-db14bd0da82f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:03.911646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1326dd0-78da-4036-a40f-9bb14a66b654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:03.912443 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1326dd0-78da-4036-a40f-9bb14a66b654 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:03.912719 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1326dd0-78da-4036-a40f-9bb14a66b654 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:03.912988 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1326dd0-78da-4036-a40f-9bb14a66b654 None admin] PATH_INFO: `/v3/projects/ca9b12fcf1e54f78a584a3122f3b91e1` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:03.914205 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1326dd0-78da-4036-a40f-9bb14a66b654 None admin] RBAC: Authorizing `identity:get_project(project_id=ca9b12fcf1e54f78a584a3122f3b91e1)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:03.915666 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1326dd0-78da-4036-a40f-9bb14a66b654 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:03.917363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 579/1160] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:53:03 2022] GET /identity/v3/projects/ca9b12fcf1e54f78a584a3122f3b91e1 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:53:03.923741 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fdc3b-8124-4472-8e38-d785ea9846c1 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:04.031878 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fdc3b-8124-4472-8e38-d785ea9846c1 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:04.070783 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0ea3c-baad-4cd2-991a-5c51353b055b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:04.071442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0ea3c-baad-4cd2-991a-5c51353b055b None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:04.071749 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0ea3c-baad-4cd2-991a-5c51353b055b None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:04.072019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0ea3c-baad-4cd2-991a-5c51353b055b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:04.072849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0ea3c-baad-4cd2-991a-5c51353b055b None admin] RBAC: Adding query filter params (role.id=58e04437159e4eb39aa4a43c213ea34c, scope.project.id=ca9b12fcf1e54f78a584a3122f3b91e1, user.id=93b561f19cce4f61b413e0af676afa29) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:53:04.073162 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0ea3c-baad-4cd2-991a-5c51353b055b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:04.074611 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0ea3c-baad-4cd2-991a-5c51353b055b None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:04.080643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 582/1161] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:53:03 2022] GET /identity/v3/role_assignments?user.id=93b561f19cce4f61b413e0af676afa29&scope.project.id=ca9b12fcf1e54f78a584a3122f3b91e1&role.id=58e04437159e4eb39aa4a43c213ea34c => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:53:06.142581 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c59fb9-f5fc-483f-a7be-d1913778615b None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:06.143481 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c59fb9-f5fc-483f-a7be-d1913778615b None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:06.143481 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c59fb9-f5fc-483f-a7be-d1913778615b None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:06.145696 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 580/1162] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:53:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:53:06.151151 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e932332-e07a-4b5d-93de-0ada1f0899dc None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:06.151593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e932332-e07a-4b5d-93de-0ada1f0899dc None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:06.151681 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e932332-e07a-4b5d-93de-0ada1f0899dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:06.170581 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-3e932332-e07a-4b5d-93de-0ada1f0899dc None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:53:06.171803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-3e932332-e07a-4b5d-93de-0ada1f0899dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:53:06.202886 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:06.251509 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 583/1163] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:53:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:53:06.274330 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c59fb9-f5fc-483f-a7be-d1913778615b None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:06.386618 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c59fb9-f5fc-483f-a7be-d1913778615b None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:06.421871 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb575d9d-20ea-49aa-b8af-7ff0465f1c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:06.422545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb575d9d-20ea-49aa-b8af-7ff0465f1c41 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:06.422829 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb575d9d-20ea-49aa-b8af-7ff0465f1c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:06.423195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb575d9d-20ea-49aa-b8af-7ff0465f1c41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:06.448288 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:06.505201 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb575d9d-20ea-49aa-b8af-7ff0465f1c41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:06.506665 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb575d9d-20ea-49aa-b8af-7ff0465f1c41 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:06.613054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 581/1164] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:53:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 01:53:06.619519 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e932332-e07a-4b5d-93de-0ada1f0899dc None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:06.729444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e932332-e07a-4b5d-93de-0ada1f0899dc None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:06.770416 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06ba9c-42d9-435a-99d0-6ad15c1a731f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:06.771151 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06ba9c-42d9-435a-99d0-6ad15c1a731f None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:06.771451 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06ba9c-42d9-435a-99d0-6ad15c1a731f None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:06.771743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06ba9c-42d9-435a-99d0-6ad15c1a731f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:06.778933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06ba9c-42d9-435a-99d0-6ad15c1a731f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:06.780428 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06ba9c-42d9-435a-99d0-6ad15c1a731f None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:06.795562 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-7d06ba9c-42d9-435a-99d0-6ad15c1a731f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 01:53:06.795562 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:53:06.795562 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 23 01:53:06.795562 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 23 01:53:06.795562 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:53:06.795562 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:53:06.795562 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:53:06.795562 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:53:06.795562 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 23 01:53:06.795562 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:53:06.795562 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:53:06.795562 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:53:06.795562 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:53:06.795562 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:53:06.795562 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:53:06.795562 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:53:06.795562 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:53:06.796739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:53:06.796739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:53:06.796739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:53:06.796739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:53:06.796739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:53:06.796739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:53:06.796739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:53:06.796739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:53:06.796739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:53:06.796739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:53:06.796739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:53:06.796739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:53:06.796739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:53:06.796739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:53:06.796739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:53:06.796739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:53:06.797803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:53:06.797803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:53:06.797803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:53:06.797803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:53:06.797803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:53:06.797803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:53:06.797803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:53:06.797803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:53:06.797803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:53:06.797803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:53:06.797803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 23 01:53:06.797803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:53:06.797803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 01:53:06.797803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:53:06.797803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 584/1165] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 23 01:53:06 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:53:06.803172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb575d9d-20ea-49aa-b8af-7ff0465f1c41 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:06.860559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:06.912439 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb575d9d-20ea-49aa-b8af-7ff0465f1c41 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:06.950190 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cee363-0f22-4070-82f4-e5d54f656155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:06.950861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cee363-0f22-4070-82f4-e5d54f656155 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:06.951145 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cee363-0f22-4070-82f4-e5d54f656155 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:06.951442 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cee363-0f22-4070-82f4-e5d54f656155 None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:06.952182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cee363-0f22-4070-82f4-e5d54f656155 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:53:06.952493 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cee363-0f22-4070-82f4-e5d54f656155 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:06.953950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cee363-0f22-4070-82f4-e5d54f656155 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:06.961347 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 582/1166] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Jun 23 01:53:06 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:53:09.014292 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db585609-3caf-424d-8d27-26e8b036c16e None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:09.014851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db585609-3caf-424d-8d27-26e8b036c16e None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:09.014851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db585609-3caf-424d-8d27-26e8b036c16e None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:09.016495 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 585/1167] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:53:09.024787 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada327c-2532-44c0-8d03-4ed9ec4ca43a None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:09.025513 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada327c-2532-44c0-8d03-4ed9ec4ca43a None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:09.025680 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada327c-2532-44c0-8d03-4ed9ec4ca43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:09.051905 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-aada327c-2532-44c0-8d03-4ed9ec4ca43a None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:53:09.053094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-aada327c-2532-44c0-8d03-4ed9ec4ca43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:53:09.133323 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 583/1168] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:53:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:53:09.159871 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db585609-3caf-424d-8d27-26e8b036c16e None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:09.192843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:09.270686 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db585609-3caf-424d-8d27-26e8b036c16e None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:09.306037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43e670-9df6-4c0c-b2c3-f95253964930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:09.306687 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43e670-9df6-4c0c-b2c3-f95253964930 None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:09.306968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43e670-9df6-4c0c-b2c3-f95253964930 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:09.307243 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43e670-9df6-4c0c-b2c3-f95253964930 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:09.308029 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43e670-9df6-4c0c-b2c3-f95253964930 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:09.309408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43e670-9df6-4c0c-b2c3-f95253964930 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:09.327283 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 586/1169] 10.222.0.13 () {60 vars in 1138 bytes} [Thu Jun 23 01:53:09 2022] POST /identity/v3/domains => generated 267 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:53:11.354250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796759a-26cc-4198-8557-b6d33fcfec67 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:11.355173 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796759a-26cc-4198-8557-b6d33fcfec67 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:11.355173 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796759a-26cc-4198-8557-b6d33fcfec67 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:11.357403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 584/1170] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:53:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:53:11.363973 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c61836-8eee-4b2a-94e6-2d3fc06ca762 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:11.364424 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c61836-8eee-4b2a-94e6-2d3fc06ca762 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:11.364524 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c61836-8eee-4b2a-94e6-2d3fc06ca762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:11.382404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-e3c61836-8eee-4b2a-94e6-2d3fc06ca762 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:53:11.383613 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-e3c61836-8eee-4b2a-94e6-2d3fc06ca762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:53:11.459106 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 587/1171] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:53:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:53:11.483741 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796759a-26cc-4198-8557-b6d33fcfec67 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:11.538600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:11.604485 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796759a-26cc-4198-8557-b6d33fcfec67 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:11.640885 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8dc12-95a5-44fb-8bd3-5fe0f1d5a5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:11.641883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8dc12-95a5-44fb-8bd3-5fe0f1d5a5af None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:11.642161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8dc12-95a5-44fb-8bd3-5fe0f1d5a5af None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:11.642440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8dc12-95a5-44fb-8bd3-5fe0f1d5a5af None admin] PATH_INFO: `/v3/domains/ed4a788be31540799de15cf5f06c58ee` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:11.653230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8dc12-95a5-44fb-8bd3-5fe0f1d5a5af None admin] RBAC: Authorizing `identity:get_domain(domain_id=ed4a788be31540799de15cf5f06c58ee)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:11.654686 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8dc12-95a5-44fb-8bd3-5fe0f1d5a5af None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:11.656399 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 585/1172] 10.222.0.13 () {56 vars in 1183 bytes} [Thu Jun 23 01:53:11 2022] GET /identity/v3/domains/ed4a788be31540799de15cf5f06c58ee => generated 267 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:53:11.666042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c61836-8eee-4b2a-94e6-2d3fc06ca762 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:11.692549 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:11.776833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c61836-8eee-4b2a-94e6-2d3fc06ca762 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:11.811925 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290eda4c-78ec-4fcb-8f86-eafa539c6a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:11.812572 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290eda4c-78ec-4fcb-8f86-eafa539c6a00 None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:11.812876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290eda4c-78ec-4fcb-8f86-eafa539c6a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:11.813192 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290eda4c-78ec-4fcb-8f86-eafa539c6a00 None admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:11.813892 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290eda4c-78ec-4fcb-8f86-eafa539c6a00 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:11.815379 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290eda4c-78ec-4fcb-8f86-eafa539c6a00 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:11.843203 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 588/1173] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 01:53:11 2022] POST /identity/v3/projects => generated 361 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:53:13.868051 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fb1f4-117a-4b7f-acaf-38008de51f37 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:13.868638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fb1f4-117a-4b7f-acaf-38008de51f37 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:13.868638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fb1f4-117a-4b7f-acaf-38008de51f37 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:13.870022 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 586/1174] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:53:13.876471 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec15d63-eacf-4f90-b5e6-ac9d412d6baa None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:13.877221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec15d63-eacf-4f90-b5e6-ac9d412d6baa None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:13.877380 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec15d63-eacf-4f90-b5e6-ac9d412d6baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:13.905718 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-3ec15d63-eacf-4f90-b5e6-ac9d412d6baa None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:53:13.907348 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-3ec15d63-eacf-4f90-b5e6-ac9d412d6baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:53:13.972988 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:13.979106 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 589/1175] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:53:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:53:14.004799 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fb1f4-117a-4b7f-acaf-38008de51f37 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:14.121434 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fb1f4-117a-4b7f-acaf-38008de51f37 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:14.130795 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:14.159283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270af96-3bdc-4ee3-a33b-eea817e7e038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:14.160204 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270af96-3bdc-4ee3-a33b-eea817e7e038 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:14.160493 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270af96-3bdc-4ee3-a33b-eea817e7e038 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:14.160771 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270af96-3bdc-4ee3-a33b-eea817e7e038 None admin] PATH_INFO: `/v3/domains/ed4a788be31540799de15cf5f06c58ee` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:14.162041 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4270af96-3bdc-4ee3-a33b-eea817e7e038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ed4a788be31540799de15cf5f06c58ee)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:14.163521 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4270af96-3bdc-4ee3-a33b-eea817e7e038 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:14.165170 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 587/1176] 10.222.0.13 () {56 vars in 1183 bytes} [Thu Jun 23 01:53:14 2022] GET /identity/v3/domains/ed4a788be31540799de15cf5f06c58ee => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:53:14.171150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec15d63-eacf-4f90-b5e6-ac9d412d6baa None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:14.274693 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec15d63-eacf-4f90-b5e6-ac9d412d6baa None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:14.311518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfce215-0ee4-40bf-9ca2-b2bcbfb82ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:14.312192 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfce215-0ee4-40bf-9ca2-b2bcbfb82ade None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:14.312472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfce215-0ee4-40bf-9ca2-b2bcbfb82ade None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:14.312937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfce215-0ee4-40bf-9ca2-b2bcbfb82ade None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:14.313502 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfce215-0ee4-40bf-9ca2-b2bcbfb82ade None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:14.314948 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfce215-0ee4-40bf-9ca2-b2bcbfb82ade None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:14.336997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 590/1177] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 01:53:14 2022] POST /identity/v3/users => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:53:16.450408 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5923b3-4740-41af-83b0-02fb5529ca7a None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:16.450975 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5923b3-4740-41af-83b0-02fb5529ca7a None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:16.450975 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5923b3-4740-41af-83b0-02fb5529ca7a None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:16.452384 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 588/1178] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:53:16.458827 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c1d41-8222-4246-8e3e-9516f2058e71 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:16.459615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c1d41-8222-4246-8e3e-9516f2058e71 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:16.459767 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c1d41-8222-4246-8e3e-9516f2058e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:16.486817 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-c54c1d41-8222-4246-8e3e-9516f2058e71 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:53:16.488042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-c54c1d41-8222-4246-8e3e-9516f2058e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:53:16.562875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:16.585565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 591/1179] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:53:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:53:16.618331 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5923b3-4740-41af-83b0-02fb5529ca7a None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:16.731624 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5923b3-4740-41af-83b0-02fb5529ca7a None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:16.768653 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e80105-75b2-45eb-9e1d-d0a4666e77e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:16.769445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e80105-75b2-45eb-9e1d-d0a4666e77e8 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:16.769726 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e80105-75b2-45eb-9e1d-d0a4666e77e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:16.769999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e80105-75b2-45eb-9e1d-d0a4666e77e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:16.781154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e80105-75b2-45eb-9e1d-d0a4666e77e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:53:16.789638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-17e80105-75b2-45eb-9e1d-d0a4666e77e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:53:16.789638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:53:16.789638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:53:16.789638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:53:16.789638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:53:16.789638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:53:16.789638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:53:16.789638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:53:16.789638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:53:16.789638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:53:16.789638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:53:16.789638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:53:16.789638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:53:16.789638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:53:16.789638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:53:16.789638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:53:16.790770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:53:16.790770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:53:16.790770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:53:16.790770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:53:16.790770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:53:16.790770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:53:16.790770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:53:16.790770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:53:16.790770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:53:16.790770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:53:16.790770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:53:16.790770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:53:16.790770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:53:16.790770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:53:16.790770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:53:16.790770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:53:16.791732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:53:16.791732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:53:16.791732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:53:16.791732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:53:16.791732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:53:16.791732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:53:16.791732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:53:16.791732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:53:16.791732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:53:16.791732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:53:16.791732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:53:16.791732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:53:16.791732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 589/1180] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:53:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:53:16.797806 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c1d41-8222-4246-8e3e-9516f2058e71 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:16.931637 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c1d41-8222-4246-8e3e-9516f2058e71 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:16.971712 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c2a9e-f5f5-405c-b508-71611b076ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:16.972386 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c2a9e-f5f5-405c-b508-71611b076ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:16.972665 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c2a9e-f5f5-405c-b508-71611b076ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:16.972934 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c2a9e-f5f5-405c-b508-71611b076ae4 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:16.973696 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c2a9e-f5f5-405c-b508-71611b076ae4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:53:16.974000 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c2a9e-f5f5-405c-b508-71611b076ae4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:16.975394 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c2a9e-f5f5-405c-b508-71611b076ae4 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:16.983704 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 592/1181] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:53:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:53:16.990088 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e80105-75b2-45eb-9e1d-d0a4666e77e8 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:17.026608 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:17.092515 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e80105-75b2-45eb-9e1d-d0a4666e77e8 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:17.128209 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de2ad0-3e51-4301-95fd-6c37a7aa2139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:17.129097 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de2ad0-3e51-4301-95fd-6c37a7aa2139 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:17.129376 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de2ad0-3e51-4301-95fd-6c37a7aa2139 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:17.129646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de2ad0-3e51-4301-95fd-6c37a7aa2139 None admin] PATH_INFO: `/v3/users/341cae4326a449458ac0733f807de15f` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:17.144158 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de2ad0-3e51-4301-95fd-6c37a7aa2139 None admin] RBAC: Authorizing `identity:get_user(user_id=341cae4326a449458ac0733f807de15f)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:17.145605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de2ad0-3e51-4301-95fd-6c37a7aa2139 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:17.147257 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 590/1182] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:53:16 2022] GET /identity/v3/users/341cae4326a449458ac0733f807de15f => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:53:17.156361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c2a9e-f5f5-405c-b508-71611b076ae4 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:17.210906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:17.273660 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c2a9e-f5f5-405c-b508-71611b076ae4 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:17.311300 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4e44e-8713-4d6e-aafe-9cde0b75d5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:17.311970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4e44e-8713-4d6e-aafe-9cde0b75d5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:17.312249 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4e44e-8713-4d6e-aafe-9cde0b75d5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:17.312527 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4e44e-8713-4d6e-aafe-9cde0b75d5d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:17.382022 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4e44e-8713-4d6e-aafe-9cde0b75d5d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:17.383526 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4e44e-8713-4d6e-aafe-9cde0b75d5d6 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:17.430352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:17.494284 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 593/1183] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:53:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 01:53:17.502620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de2ad0-3e51-4301-95fd-6c37a7aa2139 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:17.605402 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:17.613718 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de2ad0-3e51-4301-95fd-6c37a7aa2139 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:17.651379 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3222d24e-acc4-4ba2-9365-0c0dd1fe4c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:17.652281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222d24e-acc4-4ba2-9365-0c0dd1fe4c75 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:17.652559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222d24e-acc4-4ba2-9365-0c0dd1fe4c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:17.652872 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222d24e-acc4-4ba2-9365-0c0dd1fe4c75 None admin] PATH_INFO: `/v3/projects/e036a1b7008e4b47b34a56d13543808b` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:17.654099 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3222d24e-acc4-4ba2-9365-0c0dd1fe4c75 None admin] RBAC: Authorizing `identity:get_project(project_id=e036a1b7008e4b47b34a56d13543808b)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:17.655581 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3222d24e-acc4-4ba2-9365-0c0dd1fe4c75 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:17.657974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 591/1184] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:53:17 2022] GET /identity/v3/projects/e036a1b7008e4b47b34a56d13543808b => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:53:17.667264 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4e44e-8713-4d6e-aafe-9cde0b75d5d6 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:17.794995 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4e44e-8713-4d6e-aafe-9cde0b75d5d6 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:17.834238 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c28f9-f816-46a0-afb9-f68d59d7b726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:17.834878 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c28f9-f816-46a0-afb9-f68d59d7b726 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:17.835153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c28f9-f816-46a0-afb9-f68d59d7b726 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:17.835517 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c28f9-f816-46a0-afb9-f68d59d7b726 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:17.836271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c28f9-f816-46a0-afb9-f68d59d7b726 None admin] RBAC: Adding query filter params (role.id=58e04437159e4eb39aa4a43c213ea34c, scope.project.id=e036a1b7008e4b47b34a56d13543808b, user.id=341cae4326a449458ac0733f807de15f) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:53:17.836582 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c28f9-f816-46a0-afb9-f68d59d7b726 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:17.838027 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c28f9-f816-46a0-afb9-f68d59d7b726 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:17.844254 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 594/1185] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:53:17 2022] GET /identity/v3/role_assignments?user.id=341cae4326a449458ac0733f807de15f&scope.project.id=e036a1b7008e4b47b34a56d13543808b&role.id=58e04437159e4eb39aa4a43c213ea34c => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:53:19.807498 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a556d1b-c5e8-4376-88a2-5b03bea12bed None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:19.808384 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a556d1b-c5e8-4376-88a2-5b03bea12bed None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:19.808384 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a556d1b-c5e8-4376-88a2-5b03bea12bed None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:19.811015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 592/1186] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:53:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:53:19.820096 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbaa0d-74a9-4027-bade-b06607a074d0 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:19.820512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbaa0d-74a9-4027-bade-b06607a074d0 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:19.820694 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbaa0d-74a9-4027-bade-b06607a074d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:19.847133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-bcdbaa0d-74a9-4027-bade-b06607a074d0 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:53:19.848363 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-bcdbaa0d-74a9-4027-bade-b06607a074d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:53:19.851252 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:19.924411 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 595/1187] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:53:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:53:19.952120 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a556d1b-c5e8-4376-88a2-5b03bea12bed None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:20.066640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a556d1b-c5e8-4376-88a2-5b03bea12bed None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:20.102162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7380c-66da-4b87-b96d-e78d17e79734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:20.102975 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7380c-66da-4b87-b96d-e78d17e79734 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:20.103255 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7380c-66da-4b87-b96d-e78d17e79734 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:20.103563 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7380c-66da-4b87-b96d-e78d17e79734 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:20.114878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7380c-66da-4b87-b96d-e78d17e79734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:53:20.122593 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-5bc7380c-66da-4b87-b96d-e78d17e79734 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:53:20.122593 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:53:20.122593 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:53:20.122593 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:53:20.122593 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:53:20.122593 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:53:20.122593 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:53:20.122593 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:53:20.122593 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:53:20.122593 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:53:20.122593 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:53:20.122593 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:53:20.122593 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:53:20.122593 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:53:20.122593 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:53:20.122593 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:53:20.123705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:53:20.123705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:53:20.123705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:53:20.123705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:53:20.123705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:53:20.123705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:53:20.123705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:53:20.123705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:53:20.123705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:53:20.123705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:53:20.123705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:53:20.123705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:53:20.123705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:53:20.123705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:53:20.123705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:53:20.123705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:53:20.124744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:53:20.124744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:53:20.124744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:53:20.124744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:53:20.124744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:53:20.124744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:53:20.124744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:53:20.124744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:53:20.124744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:53:20.124744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:53:20.124744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:53:20.124744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:53:20.124744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 593/1188] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:53:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:53:20.130228 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbaa0d-74a9-4027-bade-b06607a074d0 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:20.243396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbaa0d-74a9-4027-bade-b06607a074d0 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:20.283912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da736d81-7c8e-4647-a1c9-bb5dd38ceb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:20.284583 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da736d81-7c8e-4647-a1c9-bb5dd38ceb64 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:20.284862 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da736d81-7c8e-4647-a1c9-bb5dd38ceb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:20.285137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da736d81-7c8e-4647-a1c9-bb5dd38ceb64 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:20.285888 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da736d81-7c8e-4647-a1c9-bb5dd38ceb64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:53:20.286194 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da736d81-7c8e-4647-a1c9-bb5dd38ceb64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:20.287616 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da736d81-7c8e-4647-a1c9-bb5dd38ceb64 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:20.296611 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 596/1189] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:53:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:53:20.305572 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7380c-66da-4b87-b96d-e78d17e79734 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:20.335034 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:20.413389 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7380c-66da-4b87-b96d-e78d17e79734 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:20.448166 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08d4e6-1142-49eb-ae9f-ad21f0054973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:20.449045 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08d4e6-1142-49eb-ae9f-ad21f0054973 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:20.449325 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08d4e6-1142-49eb-ae9f-ad21f0054973 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:20.449599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08d4e6-1142-49eb-ae9f-ad21f0054973 None admin] PATH_INFO: `/v3/users/341cae4326a449458ac0733f807de15f` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:20.450907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08d4e6-1142-49eb-ae9f-ad21f0054973 None admin] RBAC: Authorizing `identity:get_user(user_id=341cae4326a449458ac0733f807de15f)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:20.452391 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08d4e6-1142-49eb-ae9f-ad21f0054973 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:20.454113 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 594/1190] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:53:20 2022] GET /identity/v3/users/341cae4326a449458ac0733f807de15f => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:53:20.460901 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da736d81-7c8e-4647-a1c9-bb5dd38ceb64 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:20.465477 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:20.580611 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da736d81-7c8e-4647-a1c9-bb5dd38ceb64 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:20.615689 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f617b-289e-41bc-b4f1-9c364db527c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:20.616490 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f617b-289e-41bc-b4f1-9c364db527c6 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:20.616763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f617b-289e-41bc-b4f1-9c364db527c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:20.617024 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f617b-289e-41bc-b4f1-9c364db527c6 None admin] PATH_INFO: `/v3/projects/e036a1b7008e4b47b34a56d13543808b` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:20.618376 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f617b-289e-41bc-b4f1-9c364db527c6 None admin] RBAC: Authorizing `identity:get_project(project_id=e036a1b7008e4b47b34a56d13543808b)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:20.619879 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f617b-289e-41bc-b4f1-9c364db527c6 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:20.622021 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 597/1191] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:53:20 2022] GET /identity/v3/projects/e036a1b7008e4b47b34a56d13543808b => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:53:20.628468 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08d4e6-1142-49eb-ae9f-ad21f0054973 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:20.732735 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:20.749206 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08d4e6-1142-49eb-ae9f-ad21f0054973 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:20.783192 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2771fb-a00b-429e-9013-29f46e022689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:20.784115 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2771fb-a00b-429e-9013-29f46e022689 None admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:20.784353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2771fb-a00b-429e-9013-29f46e022689 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:20.784657 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2771fb-a00b-429e-9013-29f46e022689 None admin] PATH_INFO: `/v3/projects/e036a1b7008e4b47b34a56d13543808b/users/341cae4326a449458ac0733f807de15f/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:20.786862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2771fb-a00b-429e-9013-29f46e022689 None admin] RBAC: Authorizing `identity:create_grant(project_id=e036a1b7008e4b47b34a56d13543808b, user_id=341cae4326a449458ac0733f807de15f, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:20.788342 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2771fb-a00b-429e-9013-29f46e022689 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:20.807851 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 595/1192] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:53:20 2022] PUT /identity/v3/projects/e036a1b7008e4b47b34a56d13543808b/users/341cae4326a449458ac0733f807de15f/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:53:22.799046 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54b2c1-9c36-4761-a246-0947eb28e236 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:22.799640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54b2c1-9c36-4761-a246-0947eb28e236 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:22.799640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54b2c1-9c36-4761-a246-0947eb28e236 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:22.801037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 598/1193] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:53:22.806427 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad25d4-08de-4bc9-aee0-40aa31c5e1b1 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:22.806847 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad25d4-08de-4bc9-aee0-40aa31c5e1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:22.806952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad25d4-08de-4bc9-aee0-40aa31c5e1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:22.826374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-8bad25d4-08de-4bc9-aee0-40aa31c5e1b1 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:53:22.827599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-8bad25d4-08de-4bc9-aee0-40aa31c5e1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:53:22.901141 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 596/1194] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:53:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:53:22.925189 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54b2c1-9c36-4761-a246-0947eb28e236 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:22.998859 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:23.044897 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54b2c1-9c36-4761-a246-0947eb28e236 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:23.087345 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce028e-cb3e-4411-9c5e-2690d761e35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:23.088105 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce028e-cb3e-4411-9c5e-2690d761e35d None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:23.088382 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce028e-cb3e-4411-9c5e-2690d761e35d None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:23.088734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce028e-cb3e-4411-9c5e-2690d761e35d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:23.101268 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce028e-cb3e-4411-9c5e-2690d761e35d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:53:23.108885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-adce028e-cb3e-4411-9c5e-2690d761e35d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:53:23.108885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:53:23.108885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:53:23.108885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:53:23.108885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:53:23.108885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:53:23.108885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:53:23.108885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:53:23.108885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:53:23.108885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:53:23.108885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:53:23.108885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:53:23.108885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:53:23.108885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:53:23.108885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:53:23.108885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:53:23.109970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:53:23.109970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:53:23.109970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:53:23.109970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:53:23.109970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:53:23.109970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:53:23.109970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:53:23.109970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:53:23.109970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:53:23.109970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:53:23.109970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:53:23.109970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:53:23.109970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:53:23.109970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:53:23.109970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:53:23.109970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:53:23.111037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:53:23.111037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:53:23.111037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:53:23.111037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:53:23.111037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:53:23.111037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:53:23.111037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:53:23.111037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:53:23.111037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:53:23.111037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:53:23.111037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:53:23.111037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:53:23.111037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 599/1195] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:53:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:53:23.116838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad25d4-08de-4bc9-aee0-40aa31c5e1b1 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:23.208144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:23.239458 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad25d4-08de-4bc9-aee0-40aa31c5e1b1 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:23.275265 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af015a-eeae-49e7-870d-a81294c68eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:23.275995 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af015a-eeae-49e7-870d-a81294c68eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:23.276283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af015a-eeae-49e7-870d-a81294c68eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:23.276557 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af015a-eeae-49e7-870d-a81294c68eb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:23.277310 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af015a-eeae-49e7-870d-a81294c68eb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:53:23.277622 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af015a-eeae-49e7-870d-a81294c68eb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:23.279009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af015a-eeae-49e7-870d-a81294c68eb3 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:23.287666 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 597/1196] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:53:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:53:23.297374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce028e-cb3e-4411-9c5e-2690d761e35d None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:23.406415 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce028e-cb3e-4411-9c5e-2690d761e35d None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:23.438893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:23.445995 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ca87a-4467-4993-acc8-8bc8036cc21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:23.446868 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ca87a-4467-4993-acc8-8bc8036cc21c None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:23.447144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ca87a-4467-4993-acc8-8bc8036cc21c None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:23.447436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ca87a-4467-4993-acc8-8bc8036cc21c None admin] PATH_INFO: `/v3/users/341cae4326a449458ac0733f807de15f` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:23.448766 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ca87a-4467-4993-acc8-8bc8036cc21c None admin] RBAC: Authorizing `identity:get_user(user_id=341cae4326a449458ac0733f807de15f)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:23.450216 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ca87a-4467-4993-acc8-8bc8036cc21c None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:23.451892 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 600/1197] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 23 01:53:23 2022] GET /identity/v3/users/341cae4326a449458ac0733f807de15f => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:53:23.458864 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af015a-eeae-49e7-870d-a81294c68eb3 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:23.564482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af015a-eeae-49e7-870d-a81294c68eb3 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:23.601498 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542277d-e2d1-4ed0-bef5-b143f4ca11c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:23.602424 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542277d-e2d1-4ed0-bef5-b143f4ca11c7 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:23.602800 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542277d-e2d1-4ed0-bef5-b143f4ca11c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:23.603169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542277d-e2d1-4ed0-bef5-b143f4ca11c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:23.622175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:23.680559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542277d-e2d1-4ed0-bef5-b143f4ca11c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:23.681939 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542277d-e2d1-4ed0-bef5-b143f4ca11c7 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:23.782524 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 598/1198] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:53:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 01:53:23.789011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ca87a-4467-4993-acc8-8bc8036cc21c None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:23.893034 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ca87a-4467-4993-acc8-8bc8036cc21c None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:23.927969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb499e-e8aa-4562-a04e-76244df25c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:23.928837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb499e-e8aa-4562-a04e-76244df25c13 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:23.929126 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb499e-e8aa-4562-a04e-76244df25c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:23.929386 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb499e-e8aa-4562-a04e-76244df25c13 None admin] PATH_INFO: `/v3/projects/e036a1b7008e4b47b34a56d13543808b` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:23.930729 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb499e-e8aa-4562-a04e-76244df25c13 None admin] RBAC: Authorizing `identity:get_project(project_id=e036a1b7008e4b47b34a56d13543808b)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:23.932149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb499e-e8aa-4562-a04e-76244df25c13 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:23.933834 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 601/1199] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 23 01:53:23 2022] GET /identity/v3/projects/e036a1b7008e4b47b34a56d13543808b => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:53:23.940912 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542277d-e2d1-4ed0-bef5-b143f4ca11c7 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:53:23.988349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:24.048026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542277d-e2d1-4ed0-bef5-b143f4ca11c7 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:53:24.087228 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1d006-100a-4523-ac3a-d6661ec816e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:53:24.087922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1d006-100a-4523-ac3a-d6661ec816e9 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:53:24.088210 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1d006-100a-4523-ac3a-d6661ec816e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:53:24.088485 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1d006-100a-4523-ac3a-d6661ec816e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:53:24.089323 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1d006-100a-4523-ac3a-d6661ec816e9 None admin] RBAC: Adding query filter params (role.id=58e04437159e4eb39aa4a43c213ea34c, scope.project.id=e036a1b7008e4b47b34a56d13543808b, user.id=341cae4326a449458ac0733f807de15f) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:53:24.089642 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1d006-100a-4523-ac3a-d6661ec816e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:53:24.091091 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1d006-100a-4523-ac3a-d6661ec816e9 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:53:24.097467 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 599/1200] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:53:23 2022] GET /identity/v3/role_assignments?user.id=341cae4326a449458ac0733f807de15f&scope.project.id=e036a1b7008e4b47b34a56d13543808b&role.id=58e04437159e4eb39aa4a43c213ea34c => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:53:33.923384 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=67 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:53:34.094473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=47 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:20.352895 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77958304-9f98-46cb-b0cf-5d3383d67d54 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:20.353570 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77958304-9f98-46cb-b0cf-5d3383d67d54 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:20.353570 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77958304-9f98-46cb-b0cf-5d3383d67d54 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:20.354839 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 602/1201] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:54:20.361713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fab51-76aa-476e-9b68-b641e7db1098 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:20.362210 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fab51-76aa-476e-9b68-b641e7db1098 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:20.362334 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fab51-76aa-476e-9b68-b641e7db1098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:20.385191 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-a12fab51-76aa-476e-9b68-b641e7db1098 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:54:20.386586 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a12fab51-76aa-476e-9b68-b641e7db1098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:54:20.476550 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 600/1202] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:54:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:54:20.502521 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77958304-9f98-46cb-b0cf-5d3383d67d54 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:20.627204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77958304-9f98-46cb-b0cf-5d3383d67d54 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:20.670954 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb4fd8-0f72-4abe-8dd6-7c20c534f2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:20.671784 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb4fd8-0f72-4abe-8dd6-7c20c534f2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:20.672065 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb4fd8-0f72-4abe-8dd6-7c20c534f2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:20.672344 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb4fd8-0f72-4abe-8dd6-7c20c534f2f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:20.684550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb4fd8-0f72-4abe-8dd6-7c20c534f2f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:20.686034 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb4fd8-0f72-4abe-8dd6-7c20c534f2f6 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:20.705957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-94fb4fd8-0f72-4abe-8dd6-7c20c534f2f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:20.705957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:20.705957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:20.705957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:20.705957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:20.705957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:20.705957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:20.705957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:20.705957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:20.705957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:20.705957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:20.705957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:20.705957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:54:20.705957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:54:20.705957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:54:20.707048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:54:20.707048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:20.707048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:20.707048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:20.707048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:20.707048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:20.707048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:20.707048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:20.707048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:20.707048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:20.707048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:20.707048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:20.707048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:20.707048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:20.707048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:20.707048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:20.707048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:20.708413 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:54:20.708413 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:54:20.708413 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:20.708413 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:54:20.708413 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 603/1203] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:54:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:20.713386 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fab51-76aa-476e-9b68-b641e7db1098 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:20.848952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fab51-76aa-476e-9b68-b641e7db1098 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:20.889362 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:20.897945 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3df46d-4d96-4420-b21b-72d78726542d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:20.898656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3df46d-4d96-4420-b21b-72d78726542d None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:20.898952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3df46d-4d96-4420-b21b-72d78726542d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:20.899228 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3df46d-4d96-4420-b21b-72d78726542d None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:20.899971 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3df46d-4d96-4420-b21b-72d78726542d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:20.900285 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3df46d-4d96-4420-b21b-72d78726542d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:20.901760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3df46d-4d96-4420-b21b-72d78726542d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:20.915807 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 601/1204] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:20.921667 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb4fd8-0f72-4abe-8dd6-7c20c534f2f6 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:21.005510 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:21.067611 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb4fd8-0f72-4abe-8dd6-7c20c534f2f6 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:21.111679 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db10510-bcb0-42f3-be00-245f25fc1b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:21.112909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db10510-bcb0-42f3-be00-245f25fc1b98 None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:21.113290 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db10510-bcb0-42f3-be00-245f25fc1b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:21.113569 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db10510-bcb0-42f3-be00-245f25fc1b98 None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:21.114425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db10510-bcb0-42f3-be00-245f25fc1b98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:21.115933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db10510-bcb0-42f3-be00-245f25fc1b98 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:21.152105 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 604/1205] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 23 01:54:20 2022] POST /identity/v3/users => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:54:23.679818 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bd8c3-147a-4eaf-9aff-b87095ef6cbd None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:23.680436 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bd8c3-147a-4eaf-9aff-b87095ef6cbd None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:23.680436 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bd8c3-147a-4eaf-9aff-b87095ef6cbd None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:23.683456 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 602/1206] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:54:23.688091 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85f26a-4c6d-46f9-95f2-189903698f80 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:23.688705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85f26a-4c6d-46f9-95f2-189903698f80 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:23.688900 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85f26a-4c6d-46f9-95f2-189903698f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:23.708627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-3e85f26a-4c6d-46f9-95f2-189903698f80 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:54:23.710192 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-3e85f26a-4c6d-46f9-95f2-189903698f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:54:23.793859 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 605/1207] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:54:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:54:23.818853 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bd8c3-147a-4eaf-9aff-b87095ef6cbd None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:23.941164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bd8c3-147a-4eaf-9aff-b87095ef6cbd None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:23.977888 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36933f65-284d-4ba6-b150-ae7827df4de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:23.979002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36933f65-284d-4ba6-b150-ae7827df4de7 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:23.979317 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36933f65-284d-4ba6-b150-ae7827df4de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:23.979688 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36933f65-284d-4ba6-b150-ae7827df4de7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:23.991381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36933f65-284d-4ba6-b150-ae7827df4de7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:54:23.999627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-36933f65-284d-4ba6-b150-ae7827df4de7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:54:23.999627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:23.999627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:23.999627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:23.999627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:23.999627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:23.999627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:23.999627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:23.999627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:23.999627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:23.999627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:23.999627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:23.999627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:54:23.999627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:54:23.999627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:54:23.999627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:54:24.000693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:54:24.000693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:54:24.000693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:54:24.000693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:54:24.000693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:24.000693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:24.000693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:24.000693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:24.000693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:24.000693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:24.000693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:24.000693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:24.000693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:24.000693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:24.000693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:24.000693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:24.006839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:24.006839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:24.006839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:24.006839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:24.006839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:54:24.006839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:54:24.006839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:54:24.006839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:54:24.006839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:54:24.006839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:54:24.006839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:54:24.006839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:54:24.006839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 603/1208] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 01:54:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:24.007607 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85f26a-4c6d-46f9-95f2-189903698f80 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:24.053774 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:24.131670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85f26a-4c6d-46f9-95f2-189903698f80 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:24.174208 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c0414-678b-4970-a2be-ee8e5525076a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:24.174902 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c0414-678b-4970-a2be-ee8e5525076a None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:24.175218 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c0414-678b-4970-a2be-ee8e5525076a None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:24.175588 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c0414-678b-4970-a2be-ee8e5525076a None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:24.176490 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c0414-678b-4970-a2be-ee8e5525076a None admin] RBAC: Adding query filter params (name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:24.176840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c0414-678b-4970-a2be-ee8e5525076a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:24.178491 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c0414-678b-4970-a2be-ee8e5525076a None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:24.189399 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 606/1209] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 01:54:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:24.195110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36933f65-284d-4ba6-b150-ae7827df4de7 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:24.252594 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:24.313800 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36933f65-284d-4ba6-b150-ae7827df4de7 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:24.352039 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13caaef-b43b-4287-94cf-27bc89cc909e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:24.352900 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13caaef-b43b-4287-94cf-27bc89cc909e None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:24.353182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13caaef-b43b-4287-94cf-27bc89cc909e None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:24.353450 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13caaef-b43b-4287-94cf-27bc89cc909e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:24.365112 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13caaef-b43b-4287-94cf-27bc89cc909e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:24.366656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13caaef-b43b-4287-94cf-27bc89cc909e None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:24.384650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-c13caaef-b43b-4287-94cf-27bc89cc909e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:24.384650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:24.384650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:24.384650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:24.384650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:24.384650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:24.384650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:24.384650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:24.384650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:24.384650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:24.384650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:24.384650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:24.384650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:54:24.384650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:54:24.384650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:54:24.387567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:54:24.387567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:24.387567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:24.387567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:24.387567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:24.387567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:24.387567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:24.387567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:24.387567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:24.387567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:24.387567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:24.387567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:24.387567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:24.387567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:24.387567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:24.387567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:24.387567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:24.389391 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:54:24.389391 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:54:24.389391 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:24.389391 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:54:24.389391 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 604/1210] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:54:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:24.391980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c0414-678b-4970-a2be-ee8e5525076a None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:24.531783 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:24.538896 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c0414-678b-4970-a2be-ee8e5525076a None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:24.580427 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a57244-b384-4664-a185-f16ad6ce376e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:24.581169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a57244-b384-4664-a185-f16ad6ce376e None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:24.581531 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a57244-b384-4664-a185-f16ad6ce376e None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:24.581807 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a57244-b384-4664-a185-f16ad6ce376e None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:24.582592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a57244-b384-4664-a185-f16ad6ce376e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:24.583026 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a57244-b384-4664-a185-f16ad6ce376e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:24.584559 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a57244-b384-4664-a185-f16ad6ce376e None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:24.598327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 607/1211] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:54:24.606241 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13caaef-b43b-4287-94cf-27bc89cc909e None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:24.729653 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13caaef-b43b-4287-94cf-27bc89cc909e None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:24.731403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:24.768235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949adbf7-f5c1-4a27-bb75-c08dbcd92089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:24.769057 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949adbf7-f5c1-4a27-bb75-c08dbcd92089 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:24.769364 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949adbf7-f5c1-4a27-bb75-c08dbcd92089 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:24.769621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949adbf7-f5c1-4a27-bb75-c08dbcd92089 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:24.778023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949adbf7-f5c1-4a27-bb75-c08dbcd92089 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:24.779697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949adbf7-f5c1-4a27-bb75-c08dbcd92089 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:24.799530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-949adbf7-f5c1-4a27-bb75-c08dbcd92089 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 01:54:24.799530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:24.799530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:24.799530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:24.799530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:24.799530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:24.799530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:24.799530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:24.799530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:24.799530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:24.799530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:24.799530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:24.799530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:54:24.799530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:54:24.799530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:54:24.799530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:54:24.800761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:24.800761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:24.800761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:54:24.800761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:54:24.800761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:54:24.800761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:54:24.800761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:24.800761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:24.800761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:24.800761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:24.800761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:24.800761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:24.800761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:24.800761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:24.800761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:24.800761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:24.800761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:24.800761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:24.802028 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:24.802028 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:24.802028 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:54:24.802028 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:54:24.802028 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:54:24.802028 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:54:24.802028 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:54:24.802028 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:54:24.802028 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 01:54:24.802028 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:54:24.804868 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 605/1212] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:54:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:24.807150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a57244-b384-4664-a185-f16ad6ce376e None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:24.921459 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a57244-b384-4664-a185-f16ad6ce376e None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:24.969811 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f69a25-616b-474e-aceb-cc952e607aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:24.970621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f69a25-616b-474e-aceb-cc952e607aee None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:24.970947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f69a25-616b-474e-aceb-cc952e607aee None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:24.971300 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f69a25-616b-474e-aceb-cc952e607aee None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:24.972346 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f69a25-616b-474e-aceb-cc952e607aee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:24.972676 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f69a25-616b-474e-aceb-cc952e607aee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:24.974150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f69a25-616b-474e-aceb-cc952e607aee None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:25.001983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 608/1213] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Jun 23 01:54:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:25.003333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949adbf7-f5c1-4a27-bb75-c08dbcd92089 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:25.125692 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949adbf7-f5c1-4a27-bb75-c08dbcd92089 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:25.166951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981633d-9cea-45a8-81fd-9152eb1a8378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:25.167683 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981633d-9cea-45a8-81fd-9152eb1a8378 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:25.167957 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981633d-9cea-45a8-81fd-9152eb1a8378 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:25.168337 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981633d-9cea-45a8-81fd-9152eb1a8378 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:25.211700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:25.255676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981633d-9cea-45a8-81fd-9152eb1a8378 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:25.257346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981633d-9cea-45a8-81fd-9152eb1a8378 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:25.385235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 606/1214] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:54:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 01:54:25.386977 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f69a25-616b-474e-aceb-cc952e607aee None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:25.408283 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:25.509342 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f69a25-616b-474e-aceb-cc952e607aee None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:25.548854 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118e3fc-106a-466b-a0c2-e1b9bd5b30cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:25.549696 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118e3fc-106a-466b-a0c2-e1b9bd5b30cb None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:25.549976 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118e3fc-106a-466b-a0c2-e1b9bd5b30cb None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:25.550267 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118e3fc-106a-466b-a0c2-e1b9bd5b30cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:25.564509 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118e3fc-106a-466b-a0c2-e1b9bd5b30cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:25.566287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118e3fc-106a-466b-a0c2-e1b9bd5b30cb None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:25.589923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-9118e3fc-106a-466b-a0c2-e1b9bd5b30cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:25.589923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:25.589923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:25.589923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:25.589923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:25.589923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:25.589923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:25.589923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:25.589923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:25.589923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:25.589923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:25.589923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:25.589923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:54:25.589923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:54:25.589923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:54:25.590899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:54:25.590899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:25.590899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:25.590899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:25.590899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:25.590899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:25.590899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:25.590899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:25.590899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:25.590899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:25.590899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:25.590899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:25.590899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:25.590899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:25.590899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:25.590899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:25.590899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:25.591875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:54:25.591875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:54:25.591875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:25.591875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:54:25.591875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 609/1215] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:54:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:25.596537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981633d-9cea-45a8-81fd-9152eb1a8378 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:25.667358 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:25.710632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981633d-9cea-45a8-81fd-9152eb1a8378 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:25.746035 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737f05a-1557-4bad-b478-fcd59af8d7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:25.746783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737f05a-1557-4bad-b478-fcd59af8d7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:25.747169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737f05a-1557-4bad-b478-fcd59af8d7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:25.747474 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737f05a-1557-4bad-b478-fcd59af8d7c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:25.748246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737f05a-1557-4bad-b478-fcd59af8d7c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:25.748529 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737f05a-1557-4bad-b478-fcd59af8d7c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:25.749900 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737f05a-1557-4bad-b478-fcd59af8d7c4 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:25.762610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 607/1216] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:25.768434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118e3fc-106a-466b-a0c2-e1b9bd5b30cb None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:25.874069 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:25.915302 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118e3fc-106a-466b-a0c2-e1b9bd5b30cb None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:25.953017 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607cf066-60aa-4930-b034-b40a3757bff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:25.953905 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cf066-60aa-4930-b034-b40a3757bff3 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:25.954341 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cf066-60aa-4930-b034-b40a3757bff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:25.954619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cf066-60aa-4930-b034-b40a3757bff3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:25.961317 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607cf066-60aa-4930-b034-b40a3757bff3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:25.962788 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607cf066-60aa-4930-b034-b40a3757bff3 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:25.978080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-607cf066-60aa-4930-b034-b40a3757bff3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:54:25.978080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:25.978080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:25.978080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:25.978080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:25.978080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:25.978080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:25.978080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:25.978080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:25.978080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:25.978080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:25.978080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:25.978080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:54:25.978080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:54:25.978080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:54:25.979099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:54:25.979099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:25.979099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:25.979099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:25.979099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:25.979099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:25.979099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:25.979099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:25.979099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:25.979099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:25.979099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:25.979099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:25.979099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:25.979099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:25.979099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:25.979099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:25.979099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:25.980057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:54:25.980057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:54:25.980057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:54:25.980057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:54:25.980057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:54:25.980057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:54:25.980057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:54:25.980057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:54:25.983594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 610/1217] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:54:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:25.985729 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737f05a-1557-4bad-b478-fcd59af8d7c4 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:26.098426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737f05a-1557-4bad-b478-fcd59af8d7c4 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:26.124189 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:26.139442 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830a6c2-c334-4c9b-a97d-682e40626462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:26.139442 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830a6c2-c334-4c9b-a97d-682e40626462 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:26.139442 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830a6c2-c334-4c9b-a97d-682e40626462 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:26.139442 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830a6c2-c334-4c9b-a97d-682e40626462 None admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:26.139999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830a6c2-c334-4c9b-a97d-682e40626462 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:26.140193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830a6c2-c334-4c9b-a97d-682e40626462 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:26.141877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830a6c2-c334-4c9b-a97d-682e40626462 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:26.161961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 608/1218] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:54:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:54:26.163746 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607cf066-60aa-4930-b034-b40a3757bff3 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:26.289194 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607cf066-60aa-4930-b034-b40a3757bff3 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:26.322767 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:26.329824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1703bf-a361-4106-816e-869ea622cd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:26.330501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1703bf-a361-4106-816e-869ea622cd00 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:26.330785 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1703bf-a361-4106-816e-869ea622cd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:26.331065 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1703bf-a361-4106-816e-869ea622cd00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:26.331948 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1703bf-a361-4106-816e-869ea622cd00 None admin] RBAC: Adding query filter params (role.id=c8b68b76c1b44e549cc7520e5546d374, scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018, user.id=9756f5b9de8a4f23b365a96d309d86ea) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:26.332254 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1703bf-a361-4106-816e-869ea622cd00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:26.333727 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1703bf-a361-4106-816e-869ea622cd00 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:26.341134 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 611/1219] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:54:26 2022] GET /identity/v3/role_assignments?user.id=9756f5b9de8a4f23b365a96d309d86ea&scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018&role.id=c8b68b76c1b44e549cc7520e5546d374 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:28.433784 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacdd64-853f-423c-a761-d7a92e662786 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:28.434950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacdd64-853f-423c-a761-d7a92e662786 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:28.435096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacdd64-853f-423c-a761-d7a92e662786 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:28.437486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 609/1220] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:54:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:54:28.447118 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035c8bf-09a0-4c19-9674-c8192371af66 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:28.448043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035c8bf-09a0-4c19-9674-c8192371af66 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:28.448043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035c8bf-09a0-4c19-9674-c8192371af66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:28.468584 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-0035c8bf-09a0-4c19-9674-c8192371af66 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:54:28.470263 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-0035c8bf-09a0-4c19-9674-c8192371af66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:54:28.562023 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 612/1221] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:54:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 01:54:28.589115 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacdd64-853f-423c-a761-d7a92e662786 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:28.712814 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacdd64-853f-423c-a761-d7a92e662786 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:28.750014 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb93b7-6c28-45dd-90f1-0b1e959d57dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:28.750935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb93b7-6c28-45dd-90f1-0b1e959d57dd None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:28.751151 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb93b7-6c28-45dd-90f1-0b1e959d57dd None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:28.751537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb93b7-6c28-45dd-90f1-0b1e959d57dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:28.761948 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb93b7-6c28-45dd-90f1-0b1e959d57dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:54:28.770862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-30eb93b7-6c28-45dd-90f1-0b1e959d57dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:54:28.770862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:28.770862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:28.770862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:28.770862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:28.770862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:28.770862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:28.770862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:28.770862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:28.770862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:28.770862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:28.770862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:28.770862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:54:28.770862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:54:28.770862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:54:28.770862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:54:28.772074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:54:28.772074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:54:28.772074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:54:28.772074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:54:28.772074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:28.772074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:28.772074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:28.772074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:28.772074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:28.772074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:28.772074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:28.772074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:28.772074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:28.772074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:28.772074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:28.772074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:28.773206 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:28.773206 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:28.773206 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:28.773206 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:28.773206 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:54:28.773206 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:54:28.773206 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:54:28.773206 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:54:28.773206 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:54:28.773206 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:54:28.773206 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:54:28.773206 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:54:28.773206 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 610/1222] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 01:54:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:28.778642 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035c8bf-09a0-4c19-9674-c8192371af66 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:28.896576 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035c8bf-09a0-4c19-9674-c8192371af66 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:28.923358 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:28.935148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e86ba0-60e5-469d-bd5f-4c0077cc9521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:28.935856 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e86ba0-60e5-469d-bd5f-4c0077cc9521 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:28.936170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e86ba0-60e5-469d-bd5f-4c0077cc9521 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:28.936449 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e86ba0-60e5-469d-bd5f-4c0077cc9521 None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:28.937314 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e86ba0-60e5-469d-bd5f-4c0077cc9521 None admin] RBAC: Adding query filter params (name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:28.937581 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e86ba0-60e5-469d-bd5f-4c0077cc9521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:28.939561 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e86ba0-60e5-469d-bd5f-4c0077cc9521 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:28.948547 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 613/1223] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 01:54:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:28.954485 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb93b7-6c28-45dd-90f1-0b1e959d57dd None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:29.002450 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:29.061773 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb93b7-6c28-45dd-90f1-0b1e959d57dd None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:29.101844 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a59acc-9c84-4581-876e-6320c738ffa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:29.102749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a59acc-9c84-4581-876e-6320c738ffa9 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:29.103027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a59acc-9c84-4581-876e-6320c738ffa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:29.103317 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a59acc-9c84-4581-876e-6320c738ffa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:29.115940 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a59acc-9c84-4581-876e-6320c738ffa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:29.117427 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a59acc-9c84-4581-876e-6320c738ffa9 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:29.139337 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-e2a59acc-9c84-4581-876e-6320c738ffa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:29.139337 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:29.139337 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:29.139337 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:29.139337 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:29.139337 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:29.139337 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:29.139337 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:29.139337 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:29.139337 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:29.139337 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:29.139337 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:29.139337 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:54:29.139337 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:54:29.139337 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:54:29.140488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:54:29.140488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:29.140488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:29.140488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:29.140488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:29.140488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:29.140488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:29.140488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:29.140488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:29.140488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:29.140488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:29.140488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:29.140488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:29.140488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:29.140488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:29.140488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:29.140488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:29.141960 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:54:29.141960 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:54:29.141960 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:29.141960 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:54:29.141960 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 611/1224] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:54:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:54:29.147095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e86ba0-60e5-469d-bd5f-4c0077cc9521 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:29.261946 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e86ba0-60e5-469d-bd5f-4c0077cc9521 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:29.300062 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04b750-cff7-4707-838f-a0ae39026948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:29.300733 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04b750-cff7-4707-838f-a0ae39026948 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:29.301027 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04b750-cff7-4707-838f-a0ae39026948 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:29.301298 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04b750-cff7-4707-838f-a0ae39026948 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:29.301997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04b750-cff7-4707-838f-a0ae39026948 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:29.302306 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04b750-cff7-4707-838f-a0ae39026948 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:29.303724 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04b750-cff7-4707-838f-a0ae39026948 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:29.316732 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 614/1225] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:29.322720 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a59acc-9c84-4581-876e-6320c738ffa9 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:29.417227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:29.425832 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a59acc-9c84-4581-876e-6320c738ffa9 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:29.463879 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac26fe-845e-4fda-a914-077fce1f412b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:29.464901 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac26fe-845e-4fda-a914-077fce1f412b None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:29.465272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac26fe-845e-4fda-a914-077fce1f412b None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:29.465552 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac26fe-845e-4fda-a914-077fce1f412b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:29.474906 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac26fe-845e-4fda-a914-077fce1f412b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:29.476455 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac26fe-845e-4fda-a914-077fce1f412b None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:29.495289 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-adac26fe-845e-4fda-a914-077fce1f412b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 01:54:29.495289 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:29.495289 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:29.495289 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:29.495289 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:29.495289 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:29.495289 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:29.495289 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:29.495289 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:29.495289 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:29.495289 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:29.495289 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:29.495289 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:54:29.495289 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:54:29.495289 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:54:29.495289 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:54:29.496555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:29.496555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:29.496555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:54:29.496555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:54:29.496555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:54:29.496555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:54:29.496555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:29.496555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:29.496555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:29.496555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:29.496555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:29.496555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:29.496555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:29.496555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:29.496555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:29.496555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:29.496555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:29.496555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:29.502838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:29.502838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:29.502838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:54:29.502838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:54:29.502838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:54:29.502838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:54:29.502838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:54:29.502838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:54:29.502838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 01:54:29.502838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:54:29.502838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 612/1226] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:54:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:29.504673 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04b750-cff7-4707-838f-a0ae39026948 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:29.559489 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:29.616782 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04b750-cff7-4707-838f-a0ae39026948 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:29.656434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2c443-d3ff-44ac-bfd6-24e642e48f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:29.657855 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2c443-d3ff-44ac-bfd6-24e642e48f2d None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:29.658273 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2c443-d3ff-44ac-bfd6-24e642e48f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:29.658624 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2c443-d3ff-44ac-bfd6-24e642e48f2d None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:29.659614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2c443-d3ff-44ac-bfd6-24e642e48f2d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:29.659994 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2c443-d3ff-44ac-bfd6-24e642e48f2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:29.661700 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2c443-d3ff-44ac-bfd6-24e642e48f2d None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:29.682408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 615/1227] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Jun 23 01:54:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:29.688919 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac26fe-845e-4fda-a914-077fce1f412b None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:29.798850 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac26fe-845e-4fda-a914-077fce1f412b None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:29.834284 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca464a-94e8-4365-87c0-f4744284e5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:29.835005 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca464a-94e8-4365-87c0-f4744284e5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:29.835282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca464a-94e8-4365-87c0-f4744284e5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:29.835590 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca464a-94e8-4365-87c0-f4744284e5e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:29.851476 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca464a-94e8-4365-87c0-f4744284e5e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:29.853205 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca464a-94e8-4365-87c0-f4744284e5e4 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:29.875269 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-48ca464a-94e8-4365-87c0-f4744284e5e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:29.875269 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:29.875269 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:29.875269 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:29.875269 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:29.875269 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:29.875269 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:29.875269 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:29.875269 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:29.875269 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:29.875269 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:29.875269 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:29.875269 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:54:29.875269 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:54:29.875269 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:54:29.876320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:54:29.876320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:29.876320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:29.876320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:29.876320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:29.876320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:29.876320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:29.876320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:29.876320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:29.876320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:29.876320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:29.876320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:29.876320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:29.876320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:29.876320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:29.876320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:29.876320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:29.877248 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:54:29.877248 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:54:29.877248 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:29.877248 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:54:29.877470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 613/1228] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:54:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:29.884235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2c443-d3ff-44ac-bfd6-24e642e48f2d None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:29.996000 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2c443-d3ff-44ac-bfd6-24e642e48f2d None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:29.999045 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:30.031991 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a19f47-3251-46b9-aac4-28aa1edb85ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:30.033388 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a19f47-3251-46b9-aac4-28aa1edb85ba None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:30.033388 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a19f47-3251-46b9-aac4-28aa1edb85ba None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:30.033388 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a19f47-3251-46b9-aac4-28aa1edb85ba None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:30.034158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a19f47-3251-46b9-aac4-28aa1edb85ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:30.034449 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a19f47-3251-46b9-aac4-28aa1edb85ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:30.035881 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a19f47-3251-46b9-aac4-28aa1edb85ba None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:30.047702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 616/1229] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:54:30.053763 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca464a-94e8-4365-87c0-f4744284e5e4 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:30.063875 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:30.166909 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca464a-94e8-4365-87c0-f4744284e5e4 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:30.202520 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7b416-3eda-4eae-a597-3ce835317297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:30.203367 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7b416-3eda-4eae-a597-3ce835317297 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:30.203760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7b416-3eda-4eae-a597-3ce835317297 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:30.204069 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7b416-3eda-4eae-a597-3ce835317297 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:30.210917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa7b416-3eda-4eae-a597-3ce835317297 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:30.212401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa7b416-3eda-4eae-a597-3ce835317297 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:30.228568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-6aa7b416-3eda-4eae-a597-3ce835317297 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:54:30.228568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:30.228568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:30.228568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:30.228568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:30.228568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:30.228568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:30.228568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:30.228568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:30.228568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:30.228568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:30.228568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:30.228568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:54:30.228568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:54:30.228568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:54:30.229585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:54:30.229585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:30.229585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:30.229585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:30.229585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:30.229585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:30.229585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:30.229585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:30.229585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:30.229585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:30.229585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:30.229585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:30.229585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:30.229585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:30.229585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:30.229585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:30.229585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:30.230509 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:54:30.230509 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:54:30.230509 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:54:30.230509 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:54:30.230509 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:54:30.230509 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:54:30.230509 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:54:30.230509 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:54:30.230509 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 614/1230] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:54:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:30.236331 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a19f47-3251-46b9-aac4-28aa1edb85ba None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:30.347313 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a19f47-3251-46b9-aac4-28aa1edb85ba None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:30.385006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71409b62-6030-4b91-94d7-058de1679cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:30.385681 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71409b62-6030-4b91-94d7-058de1679cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:30.385977 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71409b62-6030-4b91-94d7-058de1679cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:30.386237 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71409b62-6030-4b91-94d7-058de1679cf9 None admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:30.387016 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71409b62-6030-4b91-94d7-058de1679cf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:30.387345 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71409b62-6030-4b91-94d7-058de1679cf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:30.388803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71409b62-6030-4b91-94d7-058de1679cf9 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:30.402354 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 617/1231] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:54:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:54:30.408562 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7b416-3eda-4eae-a597-3ce835317297 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:30.482056 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:30.528582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7b416-3eda-4eae-a597-3ce835317297 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:30.564990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18888a3-4275-4b89-b399-f72640b6c4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:30.566241 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18888a3-4275-4b89-b399-f72640b6c4ae None admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:30.566548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18888a3-4275-4b89-b399-f72640b6c4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:30.566829 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18888a3-4275-4b89-b399-f72640b6c4ae None admin] PATH_INFO: `/v3/projects/3f3b06be1b5a4b3a8235ebf22da2a018/users/9756f5b9de8a4f23b365a96d309d86ea/roles/c8b68b76c1b44e549cc7520e5546d374` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:30.585347 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18888a3-4275-4b89-b399-f72640b6c4ae None admin] RBAC: Authorizing `identity:create_grant(project_id=3f3b06be1b5a4b3a8235ebf22da2a018, user_id=9756f5b9de8a4f23b365a96d309d86ea, role_id=c8b68b76c1b44e549cc7520e5546d374)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:30.587020 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18888a3-4275-4b89-b399-f72640b6c4ae None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:30.603631 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 615/1232] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:54:30 2022] PUT /identity/v3/projects/3f3b06be1b5a4b3a8235ebf22da2a018/users/9756f5b9de8a4f23b365a96d309d86ea/roles/c8b68b76c1b44e549cc7520e5546d374 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 01:54:32.715735 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712947de-6662-4e3a-b78b-5263ae7261e7 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:32.716289 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712947de-6662-4e3a-b78b-5263ae7261e7 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:32.716289 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712947de-6662-4e3a-b78b-5263ae7261e7 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:32.717723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 618/1233] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:54:32.723840 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e14e49-7538-4b03-913f-f2d8b2c5568c None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:32.724315 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e14e49-7538-4b03-913f-f2d8b2c5568c None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:32.724406 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e14e49-7538-4b03-913f-f2d8b2c5568c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:32.742126 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-21e14e49-7538-4b03-913f-f2d8b2c5568c None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:54:32.743588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-21e14e49-7538-4b03-913f-f2d8b2c5568c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:54:32.810916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 616/1234] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:54:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:54:32.835394 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712947de-6662-4e3a-b78b-5263ae7261e7 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:32.863103 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:32.944768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712947de-6662-4e3a-b78b-5263ae7261e7 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:32.979210 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe0468-1dbc-4eee-9478-105e3f69119a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:32.979979 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe0468-1dbc-4eee-9478-105e3f69119a None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:32.980264 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe0468-1dbc-4eee-9478-105e3f69119a None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:32.980539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe0468-1dbc-4eee-9478-105e3f69119a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:32.991799 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe0468-1dbc-4eee-9478-105e3f69119a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:54:33.000442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-28fe0468-1dbc-4eee-9478-105e3f69119a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:54:33.000442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:33.000442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:33.000442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:33.000442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:33.000442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:33.000442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:33.000442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:33.000442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:33.000442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:33.000442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:33.000442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:33.000442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:54:33.000442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:54:33.000442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:54:33.000442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:54:33.002133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:54:33.002133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:54:33.002133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:54:33.002133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:54:33.002133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:33.002133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:33.002133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:33.002133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:33.002133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:33.002133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:33.002133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:33.002133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:33.002133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:33.002133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:33.002133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:33.002133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:33.003006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:33.003006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:33.003006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:33.003006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:33.003006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:54:33.003006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:54:33.003006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:54:33.003006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:54:33.003006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:54:33.003006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:54:33.003006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 01:54:33.003006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:54:33.003006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 619/1235] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 23 01:54:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:33.008401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e14e49-7538-4b03-913f-f2d8b2c5568c None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:33.060023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:33.115776 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e14e49-7538-4b03-913f-f2d8b2c5568c None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:33.150608 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc0159-b951-4683-a6a8-afb4a40e9277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:33.151285 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc0159-b951-4683-a6a8-afb4a40e9277 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:33.151597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc0159-b951-4683-a6a8-afb4a40e9277 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:33.151874 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc0159-b951-4683-a6a8-afb4a40e9277 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:33.152627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc0159-b951-4683-a6a8-afb4a40e9277 None admin] RBAC: Adding query filter params (name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:33.152934 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc0159-b951-4683-a6a8-afb4a40e9277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:33.154313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc0159-b951-4683-a6a8-afb4a40e9277 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:33.162939 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 617/1236] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 23 01:54:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:54:33.169013 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe0468-1dbc-4eee-9478-105e3f69119a None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:33.263576 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:33.279963 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe0468-1dbc-4eee-9478-105e3f69119a None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:33.319950 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7385afa-7b4f-46e2-b897-29e28094f140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:33.320812 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7385afa-7b4f-46e2-b897-29e28094f140 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:33.321069 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7385afa-7b4f-46e2-b897-29e28094f140 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:33.321365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7385afa-7b4f-46e2-b897-29e28094f140 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:33.337341 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7385afa-7b4f-46e2-b897-29e28094f140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:33.338981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7385afa-7b4f-46e2-b897-29e28094f140 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:33.357755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-b7385afa-7b4f-46e2-b897-29e28094f140 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:33.357755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:33.357755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:33.357755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:33.357755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:33.357755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:33.357755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:33.357755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:33.357755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:33.357755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:33.357755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:33.357755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:33.357755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:54:33.357755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:54:33.357755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:54:33.358869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:54:33.358869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:33.358869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:33.358869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:33.358869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:33.358869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:33.358869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:33.358869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:33.358869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:33.358869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:33.358869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:33.358869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:33.358869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:33.358869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:33.358869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:33.358869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:33.358869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:33.360141 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:54:33.360141 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:54:33.360141 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:33.360141 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:54:33.360141 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 620/1237] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:54:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:33.365580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc0159-b951-4683-a6a8-afb4a40e9277 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:33.497853 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc0159-b951-4683-a6a8-afb4a40e9277 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:33.507493 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:33.535494 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7836dc3-fa3a-46e5-85bc-ca6530877dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:33.536108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7836dc3-fa3a-46e5-85bc-ca6530877dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:33.536392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7836dc3-fa3a-46e5-85bc-ca6530877dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:33.536663 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7836dc3-fa3a-46e5-85bc-ca6530877dc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:33.537387 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7836dc3-fa3a-46e5-85bc-ca6530877dc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:33.537691 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7836dc3-fa3a-46e5-85bc-ca6530877dc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:33.539124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7836dc3-fa3a-46e5-85bc-ca6530877dc9 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:33.552712 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 618/1238] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:54:33.559165 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7385afa-7b4f-46e2-b897-29e28094f140 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:33.675023 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7385afa-7b4f-46e2-b897-29e28094f140 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:33.711973 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f014a7-4a97-4bee-8f78-c1c9b87757a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:33.712784 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f014a7-4a97-4bee-8f78-c1c9b87757a2 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:33.713062 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f014a7-4a97-4bee-8f78-c1c9b87757a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:33.713336 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f014a7-4a97-4bee-8f78-c1c9b87757a2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:33.716068 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:33.721936 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f014a7-4a97-4bee-8f78-c1c9b87757a2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:33.723630 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f014a7-4a97-4bee-8f78-c1c9b87757a2 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:33.737983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-46f014a7-4a97-4bee-8f78-c1c9b87757a2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 01:54:33.737983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:33.737983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:33.737983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:33.737983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:33.737983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:33.737983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:33.737983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:33.737983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:33.737983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:33.737983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:33.737983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:33.737983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:54:33.737983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:54:33.737983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:54:33.737983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:54:33.739291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:33.739291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:33.739291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:54:33.739291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:54:33.739291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:54:33.739291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:54:33.739291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:33.739291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:33.739291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:33.739291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:33.739291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:33.739291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:33.739291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:33.739291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:33.739291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:33.739291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:33.739291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:33.739291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:33.740688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:33.740688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:33.740688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:54:33.740688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:54:33.740688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:54:33.740688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:54:33.740688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:54:33.740688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:54:33.740688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 01:54:33.740688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:54:33.740688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 621/1239] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:54:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:33.744997 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7836dc3-fa3a-46e5-85bc-ca6530877dc9 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:33.849416 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7836dc3-fa3a-46e5-85bc-ca6530877dc9 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:33.886541 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11697b94-efca-4f6f-b6b6-8982010a7269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:33.887313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11697b94-efca-4f6f-b6b6-8982010a7269 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:33.887667 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11697b94-efca-4f6f-b6b6-8982010a7269 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:33.888029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11697b94-efca-4f6f-b6b6-8982010a7269 None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:33.888899 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11697b94-efca-4f6f-b6b6-8982010a7269 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:33.889147 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11697b94-efca-4f6f-b6b6-8982010a7269 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:33.890602 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11697b94-efca-4f6f-b6b6-8982010a7269 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:33.912165 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 619/1240] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Jun 23 01:54:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:33.919591 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f014a7-4a97-4bee-8f78-c1c9b87757a2 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:34.040755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f014a7-4a97-4bee-8f78-c1c9b87757a2 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:34.084159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398026b-ec5e-4e48-aacc-659bac135154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:34.084811 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398026b-ec5e-4e48-aacc-659bac135154 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:34.085116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398026b-ec5e-4e48-aacc-659bac135154 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:34.085370 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398026b-ec5e-4e48-aacc-659bac135154 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:34.152127 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:34.159352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398026b-ec5e-4e48-aacc-659bac135154 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:34.160929 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398026b-ec5e-4e48-aacc-659bac135154 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:34.265345 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 622/1241] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:54:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 01:54:34.271256 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11697b94-efca-4f6f-b6b6-8982010a7269 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:34.300531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:34.375325 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11697b94-efca-4f6f-b6b6-8982010a7269 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:34.413622 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f53c6e-7ca1-4a1f-8537-aaa3603d5893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:34.414445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f53c6e-7ca1-4a1f-8537-aaa3603d5893 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:34.414714 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f53c6e-7ca1-4a1f-8537-aaa3603d5893 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:34.414991 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f53c6e-7ca1-4a1f-8537-aaa3603d5893 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:34.426333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f53c6e-7ca1-4a1f-8537-aaa3603d5893 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:34.428015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f53c6e-7ca1-4a1f-8537-aaa3603d5893 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:34.447258 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-98f53c6e-7ca1-4a1f-8537-aaa3603d5893 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:34.447258 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:34.447258 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:34.447258 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:34.447258 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:34.447258 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:34.447258 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:34.447258 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:34.447258 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:34.447258 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:34.447258 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:34.447258 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:34.447258 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:54:34.447258 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:54:34.447258 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:54:34.448448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:54:34.448448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:34.448448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:34.448448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:34.448448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:34.448448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:34.448448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:34.448448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:34.448448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:34.448448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:34.448448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:34.448448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:34.448448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:34.448448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:34.448448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:34.448448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:34.448448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:34.449490 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:54:34.449490 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:54:34.449490 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:34.449490 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:54:34.449490 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 620/1242] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:54:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:34.454565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398026b-ec5e-4e48-aacc-659bac135154 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:34.554927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:34.561270 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398026b-ec5e-4e48-aacc-659bac135154 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:34.594691 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1078537-1ad9-400e-a9b0-bf89947cc2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:34.595398 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1078537-1ad9-400e-a9b0-bf89947cc2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:34.595702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1078537-1ad9-400e-a9b0-bf89947cc2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:34.595982 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1078537-1ad9-400e-a9b0-bf89947cc2c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:34.596690 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1078537-1ad9-400e-a9b0-bf89947cc2c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:34.596992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1078537-1ad9-400e-a9b0-bf89947cc2c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:34.598358 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1078537-1ad9-400e-a9b0-bf89947cc2c1 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:34.609913 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 623/1243] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:34.615861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f53c6e-7ca1-4a1f-8537-aaa3603d5893 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:34.713974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:34.739916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f53c6e-7ca1-4a1f-8537-aaa3603d5893 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:34.791035 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8f395-0ea6-4bf2-876b-8d131bcb67f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:34.792362 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8f395-0ea6-4bf2-876b-8d131bcb67f3 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:34.792803 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8f395-0ea6-4bf2-876b-8d131bcb67f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:34.793506 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8f395-0ea6-4bf2-876b-8d131bcb67f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:34.802307 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8f395-0ea6-4bf2-876b-8d131bcb67f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:34.804018 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8f395-0ea6-4bf2-876b-8d131bcb67f3 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:34.820843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-66e8f395-0ea6-4bf2-876b-8d131bcb67f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:54:34.820843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:34.820843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:34.820843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:34.820843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:34.820843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:34.820843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:34.820843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:34.820843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:34.820843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:34.820843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:34.820843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:34.820843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:54:34.820843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:54:34.820843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:54:34.822009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:54:34.822009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:34.822009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:34.822009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:34.822009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:34.822009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:34.822009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:34.822009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:34.822009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:34.822009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:34.822009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:34.822009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:34.822009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:34.822009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:34.822009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:34.822009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:34.822009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:34.823100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:54:34.823100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:54:34.823100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:54:34.823100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:54:34.823100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:54:34.823100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:54:34.823100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:54:34.823100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:54:34.829185 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 621/1244] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:54:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:34.829316 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1078537-1ad9-400e-a9b0-bf89947cc2c1 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:34.941148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1078537-1ad9-400e-a9b0-bf89947cc2c1 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:34.980625 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50cfc2-0de1-4f6f-8e4a-3ab974ee9e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:34.982508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50cfc2-0de1-4f6f-8e4a-3ab974ee9e62 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:34.982866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50cfc2-0de1-4f6f-8e4a-3ab974ee9e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:34.983275 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50cfc2-0de1-4f6f-8e4a-3ab974ee9e62 None admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:34.984105 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50cfc2-0de1-4f6f-8e4a-3ab974ee9e62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:34.984482 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50cfc2-0de1-4f6f-8e4a-3ab974ee9e62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:34.986621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50cfc2-0de1-4f6f-8e4a-3ab974ee9e62 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:34.999958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 624/1245] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:54:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:35.006572 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8f395-0ea6-4bf2-876b-8d131bcb67f3 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:35.127173 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8f395-0ea6-4bf2-876b-8d131bcb67f3 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:35.164979 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828a466-25c7-46a0-9959-5d2c72ad6f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:35.165710 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828a466-25c7-46a0-9959-5d2c72ad6f81 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:35.165993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828a466-25c7-46a0-9959-5d2c72ad6f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:35.166289 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828a466-25c7-46a0-9959-5d2c72ad6f81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:35.167196 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828a466-25c7-46a0-9959-5d2c72ad6f81 None admin] RBAC: Adding query filter params (role.id=c8b68b76c1b44e549cc7520e5546d374, scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018, user.id=9756f5b9de8a4f23b365a96d309d86ea) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:35.167531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828a466-25c7-46a0-9959-5d2c72ad6f81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:35.169066 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828a466-25c7-46a0-9959-5d2c72ad6f81 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:35.175299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 622/1246] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:54:35 2022] GET /identity/v3/role_assignments?user.id=9756f5b9de8a4f23b365a96d309d86ea&scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018&role.id=c8b68b76c1b44e549cc7520e5546d374 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:37.333434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c69dd-8c22-46e6-8c1d-2d3059788989 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:37.334075 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c69dd-8c22-46e6-8c1d-2d3059788989 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:37.334075 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c69dd-8c22-46e6-8c1d-2d3059788989 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:37.335868 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 625/1247] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:54:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:54:37.341837 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b58548-7d91-4bb3-bb07-8cc776a0a845 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:37.342371 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b58548-7d91-4bb3-bb07-8cc776a0a845 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:37.342843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b58548-7d91-4bb3-bb07-8cc776a0a845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:37.349932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:37.367754 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-16b58548-7d91-4bb3-bb07-8cc776a0a845 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:54:37.369010 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-16b58548-7d91-4bb3-bb07-8cc776a0a845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:54:37.445101 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 623/1248] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:54:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:54:37.469217 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c69dd-8c22-46e6-8c1d-2d3059788989 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:37.490516 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:37.581787 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c69dd-8c22-46e6-8c1d-2d3059788989 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:37.621394 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79c4ca-a462-4de3-bb0c-34d8fd6c0a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:37.622136 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79c4ca-a462-4de3-bb0c-34d8fd6c0a60 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:37.622456 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79c4ca-a462-4de3-bb0c-34d8fd6c0a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:37.622693 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79c4ca-a462-4de3-bb0c-34d8fd6c0a60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:37.633912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79c4ca-a462-4de3-bb0c-34d8fd6c0a60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:54:37.642606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-3c79c4ca-a462-4de3-bb0c-34d8fd6c0a60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:54:37.642606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:37.642606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:37.642606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:37.642606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:37.642606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:37.642606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:37.642606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:37.642606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:37.642606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:37.642606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:37.642606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:37.642606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:54:37.642606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:54:37.642606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:54:37.642606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:54:37.643840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:54:37.643840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:54:37.643840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:54:37.643840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:54:37.643840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:37.643840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:37.643840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:37.643840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:37.643840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:37.643840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:37.643840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:37.643840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:37.643840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:37.643840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:37.643840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:37.643840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:37.645012 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:37.645012 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:37.645012 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:37.645012 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:37.645012 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:54:37.645012 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:54:37.645012 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:54:37.645012 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:54:37.645012 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:54:37.645012 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:54:37.645012 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:54:37.645012 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:54:37.645012 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 626/1249] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:54:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:37.650130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b58548-7d91-4bb3-bb07-8cc776a0a845 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:37.759503 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b58548-7d91-4bb3-bb07-8cc776a0a845 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:37.790429 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:37.796309 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709eccb-a09b-49e4-96b5-559f69d34e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:37.797051 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709eccb-a09b-49e4-96b5-559f69d34e16 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:37.797463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709eccb-a09b-49e4-96b5-559f69d34e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:37.797737 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709eccb-a09b-49e4-96b5-559f69d34e16 None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:37.798491 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709eccb-a09b-49e4-96b5-559f69d34e16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:37.798801 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709eccb-a09b-49e4-96b5-559f69d34e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:37.800247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709eccb-a09b-49e4-96b5-559f69d34e16 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:37.809332 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 624/1250] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:54:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:37.816257 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79c4ca-a462-4de3-bb0c-34d8fd6c0a60 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:37.902463 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:37.929052 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79c4ca-a462-4de3-bb0c-34d8fd6c0a60 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:37.963762 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f4cbe-3304-4f04-9eea-57b1aeb05538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:37.964600 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f4cbe-3304-4f04-9eea-57b1aeb05538 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:37.964849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f4cbe-3304-4f04-9eea-57b1aeb05538 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:37.965118 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f4cbe-3304-4f04-9eea-57b1aeb05538 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:37.976480 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f4cbe-3304-4f04-9eea-57b1aeb05538 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:37.977953 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f4cbe-3304-4f04-9eea-57b1aeb05538 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:37.997019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-7c7f4cbe-3304-4f04-9eea-57b1aeb05538 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:37.997019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:37.997019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:37.997019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:37.997019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:37.997019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:37.997019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:37.997019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:37.997019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:37.997019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:37.997019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:37.997019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:37.997019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:54:37.997019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:54:37.997019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:54:37.998174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:54:37.998174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:37.998174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:37.998174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:37.998174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:37.998174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:37.998174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:37.998174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:37.998174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:37.998174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:37.998174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:37.998174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:37.998174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:37.998174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:37.998174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:37.998174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:37.998174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:37.999332 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:54:37.999332 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:54:37.999332 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:37.999332 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:54:37.999332 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 627/1251] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:54:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:38.006777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709eccb-a09b-49e4-96b5-559f69d34e16 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:38.121017 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709eccb-a09b-49e4-96b5-559f69d34e16 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:38.161044 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bde39-126f-40a1-b9f8-797b37203e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:38.161752 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bde39-126f-40a1-b9f8-797b37203e2d None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:38.162007 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bde39-126f-40a1-b9f8-797b37203e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:38.162283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bde39-126f-40a1-b9f8-797b37203e2d None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:38.163078 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bde39-126f-40a1-b9f8-797b37203e2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:38.163476 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bde39-126f-40a1-b9f8-797b37203e2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:38.164884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bde39-126f-40a1-b9f8-797b37203e2d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:38.178186 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 625/1252] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:38.184610 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f4cbe-3304-4f04-9eea-57b1aeb05538 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:38.297129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f4cbe-3304-4f04-9eea-57b1aeb05538 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:38.326918 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:38.335525 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dde563-63ac-4b7d-bc69-db725a82b9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:38.336351 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dde563-63ac-4b7d-bc69-db725a82b9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:38.336628 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dde563-63ac-4b7d-bc69-db725a82b9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:38.336985 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dde563-63ac-4b7d-bc69-db725a82b9f4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:38.347032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dde563-63ac-4b7d-bc69-db725a82b9f4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:38.348570 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dde563-63ac-4b7d-bc69-db725a82b9f4 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:38.363131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-18dde563-63ac-4b7d-bc69-db725a82b9f4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 01:54:38.363131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:38.363131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:38.363131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:38.363131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:38.363131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:38.363131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:38.363131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:38.363131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:38.363131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:38.363131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:38.363131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:38.363131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:54:38.363131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:54:38.363131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:54:38.363131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:54:38.364663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:38.364663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:38.364663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:54:38.364663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:54:38.364663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:54:38.364663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:54:38.364663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:38.364663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:38.364663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:38.364663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:38.364663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:38.364663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:38.364663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:38.364663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:38.364663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:38.364663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:38.364663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:38.364663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:38.365666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:38.365666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:38.365666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:54:38.365666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:54:38.365666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:54:38.365666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:54:38.365666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:54:38.365666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:54:38.365666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 01:54:38.365666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:54:38.365666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 628/1253] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:54:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:38.370247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bde39-126f-40a1-b9f8-797b37203e2d None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:38.432807 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:38.481675 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bde39-126f-40a1-b9f8-797b37203e2d None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:38.518679 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782aac3-efe7-45ac-a426-e4594125c739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:38.519393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782aac3-efe7-45ac-a426-e4594125c739 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:38.519691 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782aac3-efe7-45ac-a426-e4594125c739 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:38.519984 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782aac3-efe7-45ac-a426-e4594125c739 None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:38.520845 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782aac3-efe7-45ac-a426-e4594125c739 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:38.521136 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782aac3-efe7-45ac-a426-e4594125c739 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:38.522584 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782aac3-efe7-45ac-a426-e4594125c739 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:38.542080 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 626/1254] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Jun 23 01:54:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:38.548402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dde563-63ac-4b7d-bc69-db725a82b9f4 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:38.673728 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dde563-63ac-4b7d-bc69-db725a82b9f4 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:38.714241 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0c4e1-b18e-4447-9b52-37a5f8c798c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:38.714863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0c4e1-b18e-4447-9b52-37a5f8c798c5 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:38.715146 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0c4e1-b18e-4447-9b52-37a5f8c798c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:38.715430 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0c4e1-b18e-4447-9b52-37a5f8c798c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:38.779660 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:38.793309 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0c4e1-b18e-4447-9b52-37a5f8c798c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:38.794955 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0c4e1-b18e-4447-9b52-37a5f8c798c5 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:38.899987 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 629/1255] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:54:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 01:54:38.905951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782aac3-efe7-45ac-a426-e4594125c739 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:39.015896 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782aac3-efe7-45ac-a426-e4594125c739 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:39.030284 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:39.056577 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b5d56-0054-465c-a7c4-38f5cfc1dd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:39.057459 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b5d56-0054-465c-a7c4-38f5cfc1dd2f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:39.057744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b5d56-0054-465c-a7c4-38f5cfc1dd2f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:39.058035 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b5d56-0054-465c-a7c4-38f5cfc1dd2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:39.069557 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b5d56-0054-465c-a7c4-38f5cfc1dd2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:39.071650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b5d56-0054-465c-a7c4-38f5cfc1dd2f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:39.092046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-4a7b5d56-0054-465c-a7c4-38f5cfc1dd2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:39.092046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:39.092046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:39.092046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:39.092046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:39.092046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:39.092046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:39.092046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:39.092046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:39.092046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:39.092046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:39.092046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:39.092046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:54:39.092046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:54:39.092046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:54:39.093169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:54:39.093169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:39.093169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:39.093169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:39.093169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:39.093169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:39.093169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:39.093169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:39.093169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:39.093169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:39.093169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:39.093169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:39.093169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:39.093169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:39.093169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:39.093169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:39.093169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:39.094515 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:54:39.094515 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:54:39.094515 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:39.094515 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:54:39.096166 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 627/1256] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:54:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:39.102200 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0c4e1-b18e-4447-9b52-37a5f8c798c5 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:39.202159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:39.215100 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0c4e1-b18e-4447-9b52-37a5f8c798c5 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:39.252054 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e14ac7-c459-466c-8276-d266b5b0dc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:39.252725 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e14ac7-c459-466c-8276-d266b5b0dc02 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:39.253035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e14ac7-c459-466c-8276-d266b5b0dc02 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:39.253280 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e14ac7-c459-466c-8276-d266b5b0dc02 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:39.254003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e14ac7-c459-466c-8276-d266b5b0dc02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:39.254306 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e14ac7-c459-466c-8276-d266b5b0dc02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:39.255704 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e14ac7-c459-466c-8276-d266b5b0dc02 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:39.273394 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 630/1257] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:39.279138 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b5d56-0054-465c-a7c4-38f5cfc1dd2f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:39.387422 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b5d56-0054-465c-a7c4-38f5cfc1dd2f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:39.427208 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd243741-2b26-4425-bab6-019be8776a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:39.428064 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd243741-2b26-4425-bab6-019be8776a61 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:39.428346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd243741-2b26-4425-bab6-019be8776a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:39.428618 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd243741-2b26-4425-bab6-019be8776a61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:39.436096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd243741-2b26-4425-bab6-019be8776a61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:39.437557 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd243741-2b26-4425-bab6-019be8776a61 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:39.452164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-bd243741-2b26-4425-bab6-019be8776a61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:54:39.452164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:39.452164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:39.452164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:39.452164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:39.452164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:39.452164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:39.452164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:39.452164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:39.452164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:39.452164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:39.452164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:39.452164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:54:39.452164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:54:39.452164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:54:39.453383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:54:39.453383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:39.453383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:39.453383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:39.453383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:39.453383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:39.453383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:39.453383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:39.453383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:39.453383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:39.453383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:39.453383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:39.453383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:39.453383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:39.453383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:39.453383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:39.453383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:39.454862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:54:39.454862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:54:39.454862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:54:39.454862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:54:39.454862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:54:39.454862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:54:39.454862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:54:39.454862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:54:39.454862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 628/1258] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:54:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:39.460028 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e14ac7-c459-466c-8276-d266b5b0dc02 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:39.577928 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e14ac7-c459-466c-8276-d266b5b0dc02 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:39.621023 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacebfe-351f-4e9b-8a4e-235951c3ade3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:39.621779 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacebfe-351f-4e9b-8a4e-235951c3ade3 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:39.622075 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacebfe-351f-4e9b-8a4e-235951c3ade3 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:39.622386 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacebfe-351f-4e9b-8a4e-235951c3ade3 None admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:39.623248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacebfe-351f-4e9b-8a4e-235951c3ade3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:39.623607 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacebfe-351f-4e9b-8a4e-235951c3ade3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:39.625651 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacebfe-351f-4e9b-8a4e-235951c3ade3 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:39.648183 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 631/1259] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:54:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:39.649780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd243741-2b26-4425-bab6-019be8776a61 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:39.680781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:39.769446 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd243741-2b26-4425-bab6-019be8776a61 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:39.811100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c609f-47e1-425e-8c4a-3584c1a316e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:39.812012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c609f-47e1-425e-8c4a-3584c1a316e9 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:39.812301 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c609f-47e1-425e-8c4a-3584c1a316e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:39.812582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c609f-47e1-425e-8c4a-3584c1a316e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:39.813493 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c609f-47e1-425e-8c4a-3584c1a316e9 None admin] RBAC: Adding query filter params (role.id=58e04437159e4eb39aa4a43c213ea34c, scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018, user.id=9756f5b9de8a4f23b365a96d309d86ea) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:39.813818 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c609f-47e1-425e-8c4a-3584c1a316e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:39.815288 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c609f-47e1-425e-8c4a-3584c1a316e9 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:39.821606 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 629/1260] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:54:39 2022] GET /identity/v3/role_assignments?user.id=9756f5b9de8a4f23b365a96d309d86ea&scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018&role.id=58e04437159e4eb39aa4a43c213ea34c => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:41.928592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccc017-6528-43b8-8cb7-945080fb8bc8 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:41.929032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccc017-6528-43b8-8cb7-945080fb8bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:41.929156 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccc017-6528-43b8-8cb7-945080fb8bc8 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:41.931349 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 632/1261] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:54:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:54:41.939957 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905cfaa-25c1-475e-a52b-452601e5c7f5 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:41.940437 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905cfaa-25c1-475e-a52b-452601e5c7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:41.940526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905cfaa-25c1-475e-a52b-452601e5c7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:41.958410 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-2905cfaa-25c1-475e-a52b-452601e5c7f5 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:54:41.959657 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-2905cfaa-25c1-475e-a52b-452601e5c7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:54:42.041856 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 630/1262] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:54:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:54:42.072494 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccc017-6528-43b8-8cb7-945080fb8bc8 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:42.087687 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:42.200932 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccc017-6528-43b8-8cb7-945080fb8bc8 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:42.243694 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866ab2f-418d-46e0-8d95-1e333a1ca40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:42.244525 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866ab2f-418d-46e0-8d95-1e333a1ca40b None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:42.244803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866ab2f-418d-46e0-8d95-1e333a1ca40b None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:42.245079 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866ab2f-418d-46e0-8d95-1e333a1ca40b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:42.256675 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866ab2f-418d-46e0-8d95-1e333a1ca40b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:54:42.264360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-5866ab2f-418d-46e0-8d95-1e333a1ca40b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:54:42.264360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:42.264360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:42.264360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:42.264360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:42.264360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:42.264360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:42.264360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:42.264360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:42.264360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:42.264360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:42.264360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:42.264360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:54:42.264360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:54:42.264360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:54:42.264360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:54:42.265484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:54:42.265484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:54:42.265484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:54:42.265484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:54:42.265484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:42.265484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:42.265484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:42.265484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:42.265484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:42.265484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:42.265484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:42.265484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:42.265484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:42.265484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:42.265484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:42.265484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:42.266875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:42.266875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:42.266875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:42.266875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:42.266875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:54:42.266875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:54:42.266875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:54:42.266875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:54:42.266875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:54:42.266875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:54:42.266875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:54:42.266875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:54:42.266875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 633/1263] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:54:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:42.273700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905cfaa-25c1-475e-a52b-452601e5c7f5 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:42.298806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:42.388029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905cfaa-25c1-475e-a52b-452601e5c7f5 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:42.436271 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bb6c6-2278-41d1-ab26-5d25d1d1ef1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:42.437195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bb6c6-2278-41d1-ab26-5d25d1d1ef1f None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:42.437657 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bb6c6-2278-41d1-ab26-5d25d1d1ef1f None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:42.437915 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bb6c6-2278-41d1-ab26-5d25d1d1ef1f None admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:42.439017 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bb6c6-2278-41d1-ab26-5d25d1d1ef1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:42.439487 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bb6c6-2278-41d1-ab26-5d25d1d1ef1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:42.441594 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bb6c6-2278-41d1-ab26-5d25d1d1ef1f None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:42.456280 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 631/1264] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:54:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:42.462312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866ab2f-418d-46e0-8d95-1e333a1ca40b None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:42.535271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:42.571727 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866ab2f-418d-46e0-8d95-1e333a1ca40b None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:42.606814 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065ebe9-d28f-493b-8f74-f96668be36b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:42.607640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065ebe9-d28f-493b-8f74-f96668be36b1 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:42.607921 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065ebe9-d28f-493b-8f74-f96668be36b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:42.608199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065ebe9-d28f-493b-8f74-f96668be36b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:42.619809 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065ebe9-d28f-493b-8f74-f96668be36b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:42.621390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065ebe9-d28f-493b-8f74-f96668be36b1 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:42.641967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-2065ebe9-d28f-493b-8f74-f96668be36b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:42.641967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:42.641967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:42.641967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:42.641967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:42.641967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:42.641967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:42.641967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:42.641967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:42.641967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:42.641967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:42.641967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:42.641967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:54:42.641967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:54:42.641967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:54:42.643453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:54:42.643453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:42.643453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:42.643453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:42.643453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:42.643453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:42.643453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:42.643453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:42.643453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:42.643453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:42.643453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:42.643453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:42.643453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:42.643453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:42.643453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:42.643453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:42.643453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:42.644620 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:54:42.644620 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:54:42.644620 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:42.644620 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:54:42.648663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 634/1265] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:54:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:42.650009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bb6c6-2278-41d1-ab26-5d25d1d1ef1f None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:42.737929 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:42.762551 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bb6c6-2278-41d1-ab26-5d25d1d1ef1f None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:42.801156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82897801-b3cb-42f6-a0c5-56d41aca9fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:42.802159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82897801-b3cb-42f6-a0c5-56d41aca9fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:42.802584 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82897801-b3cb-42f6-a0c5-56d41aca9fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:42.803013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82897801-b3cb-42f6-a0c5-56d41aca9fd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:42.804230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82897801-b3cb-42f6-a0c5-56d41aca9fd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:42.804705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82897801-b3cb-42f6-a0c5-56d41aca9fd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:42.806931 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82897801-b3cb-42f6-a0c5-56d41aca9fd0 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:42.822030 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 632/1266] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:42.828142 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065ebe9-d28f-493b-8f74-f96668be36b1 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:42.950038 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065ebe9-d28f-493b-8f74-f96668be36b1 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:42.972186 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:42.988131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ece9b-a47b-4a8a-b832-cfaddea3c79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:42.988884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ece9b-a47b-4a8a-b832-cfaddea3c79c None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:42.989160 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ece9b-a47b-4a8a-b832-cfaddea3c79c None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:42.989437 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ece9b-a47b-4a8a-b832-cfaddea3c79c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:42.996917 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ece9b-a47b-4a8a-b832-cfaddea3c79c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:42.998373 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ece9b-a47b-4a8a-b832-cfaddea3c79c None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:43.012740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-2e6ece9b-a47b-4a8a-b832-cfaddea3c79c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 01:54:43.012740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:43.012740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:43.012740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:43.012740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:43.012740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:43.012740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:43.012740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:43.012740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:43.012740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:43.012740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:43.012740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:43.012740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:54:43.012740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:54:43.012740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:54:43.012740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:54:43.013805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:43.013805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:43.013805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:54:43.013805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:54:43.013805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:54:43.013805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:54:43.013805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:43.013805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:43.013805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:43.013805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:43.013805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:43.013805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:43.013805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:43.013805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:43.013805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:43.013805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:43.013805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:43.013805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:43.014981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:43.014981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:43.014981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:54:43.014981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:54:43.014981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:54:43.014981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:54:43.014981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:54:43.014981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:54:43.014981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 01:54:43.014981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:54:43.014981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 635/1267] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:54:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:43.020452 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82897801-b3cb-42f6-a0c5-56d41aca9fd0 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:43.122421 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82897801-b3cb-42f6-a0c5-56d41aca9fd0 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:43.158077 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1963c94-cdf8-493f-a218-5a2cd5aa2746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:43.158741 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1963c94-cdf8-493f-a218-5a2cd5aa2746 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:43.159022 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1963c94-cdf8-493f-a218-5a2cd5aa2746 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:43.159280 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1963c94-cdf8-493f-a218-5a2cd5aa2746 None admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:43.160154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1963c94-cdf8-493f-a218-5a2cd5aa2746 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:43.160463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1963c94-cdf8-493f-a218-5a2cd5aa2746 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:43.161928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1963c94-cdf8-493f-a218-5a2cd5aa2746 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:43.170584 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:43.185357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 633/1268] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Jun 23 01:54:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:43.193755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ece9b-a47b-4a8a-b832-cfaddea3c79c None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:43.304358 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ece9b-a47b-4a8a-b832-cfaddea3c79c None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:43.341434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a247a-6533-4f46-939c-e7b643e8f3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:43.342247 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a247a-6533-4f46-939c-e7b643e8f3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:43.342529 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a247a-6533-4f46-939c-e7b643e8f3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:43.342809 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a247a-6533-4f46-939c-e7b643e8f3c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:43.354126 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a247a-6533-4f46-939c-e7b643e8f3c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:43.355655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a247a-6533-4f46-939c-e7b643e8f3c7 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:43.373153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-5a5a247a-6533-4f46-939c-e7b643e8f3c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:43.373153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:43.373153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:43.373153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:43.373153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:43.373153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:43.373153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:43.373153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:43.373153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:43.373153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:43.373153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:43.373153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:43.373153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:54:43.373153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:54:43.373153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:54:43.374190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:54:43.374190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:43.374190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:43.374190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:43.374190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:43.374190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:43.374190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:43.374190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:43.374190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:43.374190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:43.374190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:43.374190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:43.374190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:43.374190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:43.374190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:43.374190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:43.374190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:43.375691 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:54:43.375691 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:54:43.375691 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:43.375691 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:54:43.375691 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 636/1269] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:54:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:43.382512 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1963c94-cdf8-493f-a218-5a2cd5aa2746 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:43.486063 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1963c94-cdf8-493f-a218-5a2cd5aa2746 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:43.521524 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df3406-c11c-4d3d-aa69-feb7c5ae4f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:43.522187 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df3406-c11c-4d3d-aa69-feb7c5ae4f67 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:43.522468 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df3406-c11c-4d3d-aa69-feb7c5ae4f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:43.522745 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df3406-c11c-4d3d-aa69-feb7c5ae4f67 None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:43.523464 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df3406-c11c-4d3d-aa69-feb7c5ae4f67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:43.523802 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df3406-c11c-4d3d-aa69-feb7c5ae4f67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:43.525172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df3406-c11c-4d3d-aa69-feb7c5ae4f67 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:43.536457 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 634/1270] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:43.545358 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a247a-6533-4f46-939c-e7b643e8f3c7 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:43.579030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:43.655984 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a247a-6533-4f46-939c-e7b643e8f3c7 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:43.694451 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b5204-7095-4a98-a8c3-71eea4ae1ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:43.695316 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b5204-7095-4a98-a8c3-71eea4ae1ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:43.695660 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b5204-7095-4a98-a8c3-71eea4ae1ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:43.695970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b5204-7095-4a98-a8c3-71eea4ae1ce8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:43.703016 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b5204-7095-4a98-a8c3-71eea4ae1ce8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:43.704550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b5204-7095-4a98-a8c3-71eea4ae1ce8 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:43.719649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-860b5204-7095-4a98-a8c3-71eea4ae1ce8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:54:43.719649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:43.719649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:43.719649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:43.719649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:43.719649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:43.719649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:43.719649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:43.719649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:43.719649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:43.719649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:43.719649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:43.719649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:54:43.719649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:54:43.719649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:54:43.720658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:54:43.720658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:43.720658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:43.720658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:43.720658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:43.720658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:43.720658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:43.720658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:43.720658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:43.720658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:43.720658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:43.720658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:43.720658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:43.720658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:43.720658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:43.720658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:43.720658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:43.721580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:54:43.721580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:54:43.721580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:54:43.721580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:54:43.721580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:54:43.721580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:54:43.721580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:54:43.721580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:54:43.721580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 637/1271] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:54:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:43.726952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df3406-c11c-4d3d-aa69-feb7c5ae4f67 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:43.786881 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:43.835307 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df3406-c11c-4d3d-aa69-feb7c5ae4f67 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:43.872844 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddcd60-e2e6-48b1-bde6-0c5807ccd026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:43.873507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddcd60-e2e6-48b1-bde6-0c5807ccd026 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:43.873788 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddcd60-e2e6-48b1-bde6-0c5807ccd026 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:43.874065 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddcd60-e2e6-48b1-bde6-0c5807ccd026 None admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:43.874831 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddcd60-e2e6-48b1-bde6-0c5807ccd026 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:43.875267 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddcd60-e2e6-48b1-bde6-0c5807ccd026 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:43.876756 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddcd60-e2e6-48b1-bde6-0c5807ccd026 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:43.890477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 635/1272] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:54:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:54:43.899856 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b5204-7095-4a98-a8c3-71eea4ae1ce8 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:44.008685 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:44.018454 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b5204-7095-4a98-a8c3-71eea4ae1ce8 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:44.055196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2210b-be5a-4e5e-96f4-37547ca040f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:44.056138 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2210b-be5a-4e5e-96f4-37547ca040f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:44.056454 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2210b-be5a-4e5e-96f4-37547ca040f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:44.056735 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2210b-be5a-4e5e-96f4-37547ca040f2 None admin] PATH_INFO: `/v3/projects/3f3b06be1b5a4b3a8235ebf22da2a018/users/9756f5b9de8a4f23b365a96d309d86ea/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:44.059261 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2210b-be5a-4e5e-96f4-37547ca040f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f3b06be1b5a4b3a8235ebf22da2a018, user_id=9756f5b9de8a4f23b365a96d309d86ea, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:44.060761 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2210b-be5a-4e5e-96f4-37547ca040f2 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:44.081101 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 638/1273] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 23 01:54:43 2022] PUT /identity/v3/projects/3f3b06be1b5a4b3a8235ebf22da2a018/users/9756f5b9de8a4f23b365a96d309d86ea/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 01:54:46.058124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aadf76-19e2-4270-9442-736c5994b959 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:46.059352 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aadf76-19e2-4270-9442-736c5994b959 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:46.059352 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aadf76-19e2-4270-9442-736c5994b959 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:46.061558 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 636/1274] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:54:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:54:46.067768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a49067-28b0-4324-afb6-1298062fd0b5 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:46.068208 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a49067-28b0-4324-afb6-1298062fd0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:46.068451 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a49067-28b0-4324-afb6-1298062fd0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:46.089646 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-b4a49067-28b0-4324-afb6-1298062fd0b5 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:54:46.090839 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-b4a49067-28b0-4324-afb6-1298062fd0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:54:46.174149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 639/1275] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:54:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:54:46.198832 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aadf76-19e2-4270-9442-736c5994b959 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:46.303440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aadf76-19e2-4270-9442-736c5994b959 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:46.322095 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:46.342621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0cd18-5a08-4877-96f1-2ce23d9f4ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:46.343438 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0cd18-5a08-4877-96f1-2ce23d9f4ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:46.343788 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0cd18-5a08-4877-96f1-2ce23d9f4ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:46.344064 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0cd18-5a08-4877-96f1-2ce23d9f4ed7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:46.358745 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0cd18-5a08-4877-96f1-2ce23d9f4ed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 01:54:46.366426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-78a0cd18-5a08-4877-96f1-2ce23d9f4ed7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:54:46.366426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:46.366426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:46.366426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:46.366426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:46.366426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:46.366426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:46.366426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:46.366426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:46.366426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:46.366426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:46.366426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:46.366426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 01:54:46.366426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 01:54:46.366426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 01:54:46.366426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 01:54:46.367532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 01:54:46.367532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 01:54:46.367532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 01:54:46.367532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 01:54:46.367532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:46.367532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:46.367532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:46.367532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:46.367532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:46.367532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:46.367532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:46.367532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:46.367532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:46.367532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:46.367532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:46.367532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:46.368454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:46.368454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:46.368454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:46.368454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:46.368454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 01:54:46.368454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 01:54:46.368454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 01:54:46.368454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 01:54:46.368454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 01:54:46.368454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 01:54:46.368454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 01:54:46.368454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:54:46.368454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 637/1276] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 23 01:54:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:46.374050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a49067-28b0-4324-afb6-1298062fd0b5 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:46.458296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:46.481098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a49067-28b0-4324-afb6-1298062fd0b5 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:46.516879 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43815d-5b6c-4b0f-9a46-c05cd5fdd2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:46.517554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43815d-5b6c-4b0f-9a46-c05cd5fdd2ca None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:46.517864 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43815d-5b6c-4b0f-9a46-c05cd5fdd2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:46.518167 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43815d-5b6c-4b0f-9a46-c05cd5fdd2ca None admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:46.518933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43815d-5b6c-4b0f-9a46-c05cd5fdd2ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:46.519251 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43815d-5b6c-4b0f-9a46-c05cd5fdd2ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:46.520655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43815d-5b6c-4b0f-9a46-c05cd5fdd2ca None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:46.528863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 640/1277] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 23 01:54:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:46.535008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0cd18-5a08-4877-96f1-2ce23d9f4ed7 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:46.646851 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0cd18-5a08-4877-96f1-2ce23d9f4ed7 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:46.682243 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031d380-9624-4071-b4e4-4b670819fb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:46.683048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031d380-9624-4071-b4e4-4b670819fb00 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:46.683328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031d380-9624-4071-b4e4-4b670819fb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:46.683626 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031d380-9624-4071-b4e4-4b670819fb00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:46.695112 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031d380-9624-4071-b4e4-4b670819fb00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:46.696599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031d380-9624-4071-b4e4-4b670819fb00 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:46.713463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-2031d380-9624-4071-b4e4-4b670819fb00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:46.713463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:46.713463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:46.713463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:46.713463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:46.713463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:46.713463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:46.713463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:46.713463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:46.713463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:46.713463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:46.713463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:46.713463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:54:46.713463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:54:46.713463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:54:46.714475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:54:46.714475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:46.714475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:46.714475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:46.714475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:46.714475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:46.714475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:46.714475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:46.714475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:46.714475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:46.714475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:46.714475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:46.714475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:46.714475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:46.714475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:46.714475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:46.714475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:46.715434 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:54:46.715434 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:54:46.715434 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:46.715434 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:54:46.715434 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 638/1278] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:54:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:46.720771 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43815d-5b6c-4b0f-9a46-c05cd5fdd2ca None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:46.831141 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43815d-5b6c-4b0f-9a46-c05cd5fdd2ca None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:46.869384 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d470c-a473-4b50-8fd1-9eaaac4c3d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:46.870047 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d470c-a473-4b50-8fd1-9eaaac4c3d12 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:46.870364 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d470c-a473-4b50-8fd1-9eaaac4c3d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:46.870671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d470c-a473-4b50-8fd1-9eaaac4c3d12 None admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:46.871461 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d470c-a473-4b50-8fd1-9eaaac4c3d12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:46.871769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d470c-a473-4b50-8fd1-9eaaac4c3d12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:46.873148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d470c-a473-4b50-8fd1-9eaaac4c3d12 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:46.885051 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 641/1279] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:46.891246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031d380-9624-4071-b4e4-4b670819fb00 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:46.924979 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:47.004709 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031d380-9624-4071-b4e4-4b670819fb00 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:47.043645 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2b856-6497-4bde-9cfa-25035f4c2636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:47.044862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2b856-6497-4bde-9cfa-25035f4c2636 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:47.045298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2b856-6497-4bde-9cfa-25035f4c2636 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:47.045725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2b856-6497-4bde-9cfa-25035f4c2636 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:47.054762 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2b856-6497-4bde-9cfa-25035f4c2636 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:47.056247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2b856-6497-4bde-9cfa-25035f4c2636 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:47.071482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-5dc2b856-6497-4bde-9cfa-25035f4c2636 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 01:54:47.071482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:47.071482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:47.071482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:47.071482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:47.071482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:47.071482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:47.071482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:47.071482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:47.071482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:47.071482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:47.071482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:47.071482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 01:54:47.071482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 01:54:47.071482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 01:54:47.071482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 01:54:47.072959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:47.072959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:47.072959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 01:54:47.072959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:54:47.072959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 01:54:47.072959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 01:54:47.072959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:47.072959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:47.072959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:47.072959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:47.072959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:47.072959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:47.072959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:47.072959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:47.072959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:47.072959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:47.072959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:47.072959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:47.073932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:47.073932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:47.073932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 01:54:47.073932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 01:54:47.073932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 01:54:47.073932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 01:54:47.073932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 01:54:47.073932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 01:54:47.073932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 01:54:47.073932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:54:47.073932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 639/1280] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:54:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 01:54:47.080383 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d470c-a473-4b50-8fd1-9eaaac4c3d12 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:47.086549 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:47.204710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d470c-a473-4b50-8fd1-9eaaac4c3d12 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:47.239598 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3cf13-a4ef-4438-b282-e522e3438d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:47.240265 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3cf13-a4ef-4438-b282-e522e3438d42 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:47.240537 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3cf13-a4ef-4438-b282-e522e3438d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:47.240806 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3cf13-a4ef-4438-b282-e522e3438d42 None admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:47.241635 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3cf13-a4ef-4438-b282-e522e3438d42 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:47.241940 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3cf13-a4ef-4438-b282-e522e3438d42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:47.243377 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3cf13-a4ef-4438-b282-e522e3438d42 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:47.261279 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 642/1281] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Jun 23 01:54:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:47.267639 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2b856-6497-4bde-9cfa-25035f4c2636 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:47.359345 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:47.374288 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2b856-6497-4bde-9cfa-25035f4c2636 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:47.409515 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90dab5f-a1a1-4aa2-96c2-a187ce94be3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:47.410159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90dab5f-a1a1-4aa2-96c2-a187ce94be3b None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:47.410442 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90dab5f-a1a1-4aa2-96c2-a187ce94be3b None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:47.410720 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90dab5f-a1a1-4aa2-96c2-a187ce94be3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:47.484554 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90dab5f-a1a1-4aa2-96c2-a187ce94be3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:47.486018 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90dab5f-a1a1-4aa2-96c2-a187ce94be3b None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:47.576923 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:47.587498 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 640/1282] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 23 01:54:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 01:54:47.593729 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3cf13-a4ef-4438-b282-e522e3438d42 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:47.662390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:47.703333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3cf13-a4ef-4438-b282-e522e3438d42 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:47.739092 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753777f3-07da-4983-bf6a-d06137520917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:47.739904 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753777f3-07da-4983-bf6a-d06137520917 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:47.740178 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753777f3-07da-4983-bf6a-d06137520917 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:47.740447 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753777f3-07da-4983-bf6a-d06137520917 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:47.751360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753777f3-07da-4983-bf6a-d06137520917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:47.752843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753777f3-07da-4983-bf6a-d06137520917 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:47.770661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-753777f3-07da-4983-bf6a-d06137520917 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:47.770661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:47.770661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:47.770661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:47.770661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:47.770661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:47.770661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:47.770661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:47.770661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:47.770661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:47.770661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:47.770661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:47.770661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 01:54:47.770661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 01:54:47.770661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 01:54:47.771710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 01:54:47.771710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:47.771710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:47.771710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:47.771710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:47.771710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:47.771710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:47.771710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:47.771710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:47.771710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:47.771710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:47.771710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:47.771710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:47.771710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:47.771710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:47.771710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:47.771710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:47.772613 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 01:54:47.772613 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 01:54:47.772613 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 01:54:47.772613 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:54:47.772613 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 643/1283] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:54:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:47.779824 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90dab5f-a1a1-4aa2-96c2-a187ce94be3b None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:47.881316 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90dab5f-a1a1-4aa2-96c2-a187ce94be3b None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:47.920577 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930fbcf-f0d4-4389-9b92-bff4e9c49b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:47.921546 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930fbcf-f0d4-4389-9b92-bff4e9c49b41 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:47.924566 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930fbcf-f0d4-4389-9b92-bff4e9c49b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:47.924566 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930fbcf-f0d4-4389-9b92-bff4e9c49b41 None admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:47.924566 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930fbcf-f0d4-4389-9b92-bff4e9c49b41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:47.924566 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930fbcf-f0d4-4389-9b92-bff4e9c49b41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:47.924892 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930fbcf-f0d4-4389-9b92-bff4e9c49b41 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:47.941836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 641/1284] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 23 01:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:47.947821 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753777f3-07da-4983-bf6a-d06137520917 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:48.050944 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753777f3-07da-4983-bf6a-d06137520917 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:48.066564 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:48.096784 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de77d29-e75f-4057-bb8b-23b17aed4d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:48.098012 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de77d29-e75f-4057-bb8b-23b17aed4d73 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:48.098518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de77d29-e75f-4057-bb8b-23b17aed4d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:48.098932 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de77d29-e75f-4057-bb8b-23b17aed4d73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:48.110648 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de77d29-e75f-4057-bb8b-23b17aed4d73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:48.113028 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de77d29-e75f-4057-bb8b-23b17aed4d73 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:48.132003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application [None req-0de77d29-e75f-4057-bb8b-23b17aed4d73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:54:48.132003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:48.132003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:48.132003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:48.132003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:48.132003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:48.132003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:48.132003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:48.132003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:48.132003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:48.132003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:48.132003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:48.132003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 01:54:48.132003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 01:54:48.132003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 01:54:48.133030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 01:54:48.133030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:48.133030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:48.133030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:48.133030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:48.133030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:48.133030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:48.133030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:48.133030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:48.133030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:48.133030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:48.133030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:48.133030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:48.133030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:48.133030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:48.133030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:48.133030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:48.134108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 01:54:48.134108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 01:54:48.134108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 01:54:48.134108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 01:54:48.134108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 01:54:48.134108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 01:54:48.134108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 01:54:48.134108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: ERROR keystone.server.flask.application Jun 23 01:54:48.134108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 644/1285] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 23 01:54:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:48.139222 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930fbcf-f0d4-4389-9b92-bff4e9c49b41 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:48.192372 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:48.255761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930fbcf-f0d4-4389-9b92-bff4e9c49b41 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:48.291179 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf9b07-84b8-476e-bd46-aae64b91668e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:48.291872 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf9b07-84b8-476e-bd46-aae64b91668e None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:48.292149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf9b07-84b8-476e-bd46-aae64b91668e None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:48.292421 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf9b07-84b8-476e-bd46-aae64b91668e None admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:48.293202 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf9b07-84b8-476e-bd46-aae64b91668e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:48.293515 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf9b07-84b8-476e-bd46-aae64b91668e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:48.294941 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf9b07-84b8-476e-bd46-aae64b91668e None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:48.307117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 642/1286] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 23 01:54:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:48.314497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de77d29-e75f-4057-bb8b-23b17aed4d73 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:48.429733 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de77d29-e75f-4057-bb8b-23b17aed4d73 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:48.464810 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e3e4d-aa57-4bfc-8625-6c2075c810f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:48.465462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e3e4d-aa57-4bfc-8625-6c2075c810f4 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:48.465742 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e3e4d-aa57-4bfc-8625-6c2075c810f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:48.466017 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e3e4d-aa57-4bfc-8625-6c2075c810f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:48.466846 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e3e4d-aa57-4bfc-8625-6c2075c810f4 None admin] RBAC: Adding query filter params (role.id=58e04437159e4eb39aa4a43c213ea34c, scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018, user.id=9756f5b9de8a4f23b365a96d309d86ea) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:48.467159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e3e4d-aa57-4bfc-8625-6c2075c810f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:48.468675 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e3e4d-aa57-4bfc-8625-6c2075c810f4 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:48.474763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 645/1287] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 23 01:54:48 2022] GET /identity/v3/role_assignments?user.id=9756f5b9de8a4f23b365a96d309d86ea&scope.project.id=3f3b06be1b5a4b3a8235ebf22da2a018&role.id=58e04437159e4eb39aa4a43c213ea34c => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:50.465950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d32c94-419f-487d-8df8-01fe2bb93e04 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:50.466831 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d32c94-419f-487d-8df8-01fe2bb93e04 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:50.466831 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d32c94-419f-487d-8df8-01fe2bb93e04 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:50.469050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 643/1288] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:54:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:54:50.475274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b9adf-0cba-485b-a342-c2b053c374c6 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:50.475722 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b9adf-0cba-485b-a342-c2b053c374c6 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:50.475919 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b9adf-0cba-485b-a342-c2b053c374c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:50.497834 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-7d6b9adf-0cba-485b-a342-c2b053c374c6 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:54:50.499032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-7d6b9adf-0cba-485b-a342-c2b053c374c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:54:50.533757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:50.572592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 646/1289] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:54:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:54:50.595839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d32c94-419f-487d-8df8-01fe2bb93e04 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:50.717062 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d32c94-419f-487d-8df8-01fe2bb93e04 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:50.727871 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:50.753163 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d0897-1b08-46e3-9312-52d01508257d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:50.753965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d0897-1b08-46e3-9312-52d01508257d None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:50.754244 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d0897-1b08-46e3-9312-52d01508257d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:50.754518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d0897-1b08-46e3-9312-52d01508257d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:50.755171 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d0897-1b08-46e3-9312-52d01508257d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:50.756593 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d0897-1b08-46e3-9312-52d01508257d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:50.768780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-aa3d0897-1b08-46e3-9312-52d01508257d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 01:54:50.768780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:50.768780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:54:50.768780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:54:50.768780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:54:50.768780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:54:50.768780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:54:50.768780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:54:50.768780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 01:54:50.768780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:54:50.768780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:54:50.768780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:54:50.768780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:50.768780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:50.768780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:50.768780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:50.768780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:50.770046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:50.770046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:50.770046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:50.770046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:50.770046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:50.770046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:50.770046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:54:50.770046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:54:50.770046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:54:50.770046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:54:50.770046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:50.770046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:50.770046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:50.770046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:50.770046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:50.770046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:50.771068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:50.771068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:50.771068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:50.771068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:50.771068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:50.771068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:50.771068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:50.771068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:50.771068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:50.771068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:50.771068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:54:50.771068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:54:50.771068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 01:54:50.771068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:54:50.771068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 644/1290] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 23 01:54:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:50.776338 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b9adf-0cba-485b-a342-c2b053c374c6 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:50.884020 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b9adf-0cba-485b-a342-c2b053c374c6 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:50.925213 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825812a-a0fe-4308-88a2-9397ec85e05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:50.925887 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825812a-a0fe-4308-88a2-9397ec85e05b None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:50.926168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825812a-a0fe-4308-88a2-9397ec85e05b None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:50.926855 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825812a-a0fe-4308-88a2-9397ec85e05b None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:50.927133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825812a-a0fe-4308-88a2-9397ec85e05b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:50.927452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825812a-a0fe-4308-88a2-9397ec85e05b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:50.928846 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825812a-a0fe-4308-88a2-9397ec85e05b None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:50.934714 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 647/1291] 10.222.0.13 () {56 vars in 1116 bytes} [Thu Jun 23 01:54:50 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:54:50.940943 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d0897-1b08-46e3-9312-52d01508257d None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:51.045162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d0897-1b08-46e3-9312-52d01508257d None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:51.084462 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b41540-115b-424d-922e-04ee21417e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:51.085119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b41540-115b-424d-922e-04ee21417e3d None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:51.085401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b41540-115b-424d-922e-04ee21417e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:51.085668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b41540-115b-424d-922e-04ee21417e3d None admin] PATH_INFO: `/v3/services` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:51.086373 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b41540-115b-424d-922e-04ee21417e3d None admin] RBAC: Adding query filter params (type=placement) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:51.086679 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b41540-115b-424d-922e-04ee21417e3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:51.088089 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b41540-115b-424d-922e-04ee21417e3d None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:51.092754 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 645/1292] 10.222.0.13 () {56 vars in 1116 bytes} [Thu Jun 23 01:54:50 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:53.086828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58817068-af2f-49e6-8b60-18bd401def79 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:53.087774 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58817068-af2f-49e6-8b60-18bd401def79 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:53.087774 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58817068-af2f-49e6-8b60-18bd401def79 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:53.089962 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 648/1293] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:54:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:54:53.096998 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dede21f-adfa-46c4-b7de-dd41d0a2f195 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:53.097414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dede21f-adfa-46c4-b7de-dd41d0a2f195 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:53.097548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dede21f-adfa-46c4-b7de-dd41d0a2f195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:53.115747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-8dede21f-adfa-46c4-b7de-dd41d0a2f195 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:54:53.116941 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-8dede21f-adfa-46c4-b7de-dd41d0a2f195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:54:53.148673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:53.187514 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 646/1294] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:54:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:54:53.211064 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58817068-af2f-49e6-8b60-18bd401def79 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:53.250906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:53.329039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58817068-af2f-49e6-8b60-18bd401def79 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:53.365246 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99517bb-d876-46f0-9527-86c3e4a9f7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:53.365906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99517bb-d876-46f0-9527-86c3e4a9f7d9 None admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:53.366191 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99517bb-d876-46f0-9527-86c3e4a9f7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:53.366465 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99517bb-d876-46f0-9527-86c3e4a9f7d9 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:53.367181 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99517bb-d876-46f0-9527-86c3e4a9f7d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:53.368594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99517bb-d876-46f0-9527-86c3e4a9f7d9 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:53.388169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 649/1295] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 23 01:54:53 2022] POST /identity/v3/services => generated 246 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:54:55.393479 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15d4d9-167f-49d4-9248-cae285f4308e None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:55.394047 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15d4d9-167f-49d4-9248-cae285f4308e None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:55.394047 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15d4d9-167f-49d4-9248-cae285f4308e None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:55.395438 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 647/1296] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:54:55.401797 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac1070-ab06-4527-9110-16ae552e60fd None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:55.402486 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac1070-ab06-4527-9110-16ae552e60fd None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:55.402670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac1070-ab06-4527-9110-16ae552e60fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:55.421628 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-14ac1070-ab06-4527-9110-16ae552e60fd None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:54:55.422818 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-14ac1070-ab06-4527-9110-16ae552e60fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:54:55.511681 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 650/1297] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:54:55 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:54:55.543709 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15d4d9-167f-49d4-9248-cae285f4308e None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:55.655569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15d4d9-167f-49d4-9248-cae285f4308e None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:55.699291 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d719441-7dcc-41e1-891a-ab994c0e251b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:55.700144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d719441-7dcc-41e1-891a-ab994c0e251b None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:55.700419 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d719441-7dcc-41e1-891a-ab994c0e251b None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:55.700694 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d719441-7dcc-41e1-891a-ab994c0e251b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:55.701378 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d719441-7dcc-41e1-891a-ab994c0e251b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:55.702757 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d719441-7dcc-41e1-891a-ab994c0e251b None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:55.717207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-4d719441-7dcc-41e1-891a-ab994c0e251b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 01:54:55.717207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:55.717207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:54:55.717207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:54:55.717207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:54:55.717207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:54:55.717207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:54:55.717207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:54:55.717207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 01:54:55.717207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:54:55.717207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:54:55.717207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:54:55.717207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:55.717207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:55.717207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:55.717207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:55.717207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:55.718473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:55.718473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:55.718473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:55.718473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:55.718473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:55.718473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:55.718473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:54:55.718473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:54:55.718473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:54:55.718473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:54:55.718473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:55.718473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:55.718473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:55.718473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:55.718473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:55.718473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:55.719355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:55.719355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:55.719355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:55.719355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:55.719355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:55.719355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:55.719355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:55.719355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:55.719355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:55.719355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:55.719355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:54:55.719355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:54:55.719355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 01:54:55.719355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:54:55.719355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 648/1298] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 23 01:54:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:55.725279 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac1070-ab06-4527-9110-16ae552e60fd None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:55.745050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:55.838572 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac1070-ab06-4527-9110-16ae552e60fd None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:55.874155 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d72f1d-7fd4-499a-b704-cb9223a38049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:55.875240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d72f1d-7fd4-499a-b704-cb9223a38049 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:55.875401 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d72f1d-7fd4-499a-b704-cb9223a38049 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:55.875652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d72f1d-7fd4-499a-b704-cb9223a38049 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:55.876356 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d72f1d-7fd4-499a-b704-cb9223a38049 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:55.876664 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d72f1d-7fd4-499a-b704-cb9223a38049 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:55.878048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d72f1d-7fd4-499a-b704-cb9223a38049 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:55.883323 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 651/1299] 10.222.0.13 () {56 vars in 1116 bytes} [Thu Jun 23 01:54:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:55.892423 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d719441-7dcc-41e1-891a-ab994c0e251b None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:55.926015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:56.002317 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d719441-7dcc-41e1-891a-ab994c0e251b None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:56.042300 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50c3a6-c704-4b9d-8b19-3c54970720cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:56.043362 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50c3a6-c704-4b9d-8b19-3c54970720cd None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:56.043965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50c3a6-c704-4b9d-8b19-3c54970720cd None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:56.044418 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50c3a6-c704-4b9d-8b19-3c54970720cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:56.045742 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50c3a6-c704-4b9d-8b19-3c54970720cd None admin] RBAC: Adding query filter params (interface=public, service_id=eb460ee2445645419d33e4cf5b00b2bf, region_id=RegionOne) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:56.046263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50c3a6-c704-4b9d-8b19-3c54970720cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:56.047923 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50c3a6-c704-4b9d-8b19-3c54970720cd None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:56.053458 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 649/1300] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Jun 23 01:54:55 2022] GET /identity/v3/endpoints?service_id=eb460ee2445645419d33e4cf5b00b2bf&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 01:54:56.059781 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d72f1d-7fd4-499a-b704-cb9223a38049 None admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:56.146358 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:56.166052 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d72f1d-7fd4-499a-b704-cb9223a38049 None admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:56.202027 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84088ef-377c-44e4-930e-85a2aeb8e001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:56.202621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84088ef-377c-44e4-930e-85a2aeb8e001 None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:56.202958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84088ef-377c-44e4-930e-85a2aeb8e001 None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:56.203184 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84088ef-377c-44e4-930e-85a2aeb8e001 None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:56.203904 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84088ef-377c-44e4-930e-85a2aeb8e001 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:56.205297 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84088ef-377c-44e4-930e-85a2aeb8e001 None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:56.212225 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 652/1301] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 23 01:54:56 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 01:54:58.212110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5356b9-68b1-41af-9b87-8e11b480a95f None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:58.212952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5356b9-68b1-41af-9b87-8e11b480a95f None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:58.212952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5356b9-68b1-41af-9b87-8e11b480a95f None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:58.215167 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 650/1302] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:54:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:54:58.220565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd24812-816d-46f8-b51d-4053a257c9d3 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:58.221001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd24812-816d-46f8-b51d-4053a257c9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:58.221093 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd24812-816d-46f8-b51d-4053a257c9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:58.239455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-1dd24812-816d-46f8-b51d-4053a257c9d3 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:54:58.240662 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-1dd24812-816d-46f8-b51d-4053a257c9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:54:58.311219 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 653/1303] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:54:58 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 01:54:58.335817 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5356b9-68b1-41af-9b87-8e11b480a95f None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:58.437458 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:58.446352 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5356b9-68b1-41af-9b87-8e11b480a95f None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:58.488413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d10492-8a8b-4e89-b847-17322e1c7286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:58.489208 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d10492-8a8b-4e89-b847-17322e1c7286 None admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:58.489488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d10492-8a8b-4e89-b847-17322e1c7286 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:58.489732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d10492-8a8b-4e89-b847-17322e1c7286 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:58.490395 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d10492-8a8b-4e89-b847-17322e1c7286 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:58.491791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d10492-8a8b-4e89-b847-17322e1c7286 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:58.503821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application [None req-94d10492-8a8b-4e89-b847-17322e1c7286 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 01:54:58.503821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:58.503821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 01:54:58.503821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 01:54:58.503821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 01:54:58.503821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 01:54:58.503821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 01:54:58.503821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:54:58.503821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 01:54:58.503821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:54:58.503821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 01:54:58.503821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:54:58.503821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 01:54:58.503821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 01:54:58.503821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 01:54:58.503821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 01:54:58.503821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 01:54:58.504974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 01:54:58.504974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 01:54:58.504974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 01:54:58.504974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 01:54:58.504974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 01:54:58.504974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 01:54:58.504974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 01:54:58.504974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 01:54:58.504974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 01:54:58.504974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 01:54:58.504974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 01:54:58.504974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 01:54:58.504974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 01:54:58.504974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 01:54:58.504974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 01:54:58.504974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 01:54:58.505866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 01:54:58.505866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application with Lock( Jun 23 01:54:58.505866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 01:54:58.505866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self._enter() Jun 23 01:54:58.505866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 01:54:58.505866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 01:54:58.505866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 01:54:58.505866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application return self.creator() Jun 23 01:54:58.505866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 01:54:58.505866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application created_value = creator( Jun 23 01:54:58.505866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 01:54:58.505866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 01:54:58.505866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 01:54:58.505866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: ERROR keystone.server.flask.application Jun 23 01:54:58.505866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 651/1304] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 23 01:54:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 01:54:58.513520 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd24812-816d-46f8-b51d-4053a257c9d3 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:58.598102 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:54:58.622532 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd24812-816d-46f8-b51d-4053a257c9d3 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:58.658360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ea3fe-fe96-4475-bcfa-86ab5aeaf78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:58.659017 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ea3fe-fe96-4475-bcfa-86ab5aeaf78e None admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:58.659300 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ea3fe-fe96-4475-bcfa-86ab5aeaf78e None admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:58.659600 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ea3fe-fe96-4475-bcfa-86ab5aeaf78e None admin] PATH_INFO: `/v3/services` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:58.660310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ea3fe-fe96-4475-bcfa-86ab5aeaf78e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 01:54:58.660610 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ea3fe-fe96-4475-bcfa-86ab5aeaf78e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:58.661997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ea3fe-fe96-4475-bcfa-86ab5aeaf78e None admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:58.667266 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 654/1305] 10.222.0.13 () {56 vars in 1116 bytes} [Thu Jun 23 01:54:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 01:54:58.674015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d10492-8a8b-4e89-b847-17322e1c7286 None admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:54:58.788246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d10492-8a8b-4e89-b847-17322e1c7286 None admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:54:58.825298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f31a5-839b-4def-8de0-c0d6b1261e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:54:58.825962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f31a5-839b-4def-8de0-c0d6b1261e80 None admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:54:58.826238 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f31a5-839b-4def-8de0-c0d6b1261e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:54:58.826513 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f31a5-839b-4def-8de0-c0d6b1261e80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:54:58.827268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f31a5-839b-4def-8de0-c0d6b1261e80 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:54:58.829026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f31a5-839b-4def-8de0-c0d6b1261e80 None admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:54:58.851389 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 652/1306] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 23 01:54:58 2022] POST /identity/v3/endpoints => generated 331 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 01:55:08.664176 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=30 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:55:08.846986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:56:02.496469 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c08790-18b8-4858-a743-dbd2cf1369ee None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:02.496917 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c08790-18b8-4858-a743-dbd2cf1369ee None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:02.496917 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c08790-18b8-4858-a743-dbd2cf1369ee None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:02.502570 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 655/1307] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:56:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:56:02.504594 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fef3d-36f5-44a8-96aa-1a0c698a007a None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:02.505482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fef3d-36f5-44a8-96aa-1a0c698a007a None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:02.505948 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fef3d-36f5-44a8-96aa-1a0c698a007a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:02.673804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-d06fef3d-36f5-44a8-96aa-1a0c698a007a None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:56:02.675206 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-d06fef3d-36f5-44a8-96aa-1a0c698a007a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:02.804036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 653/1308] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 01:56:02.855246 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc714980-f789-44ae-b6e6-90ff25daad19 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:02.855577 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc714980-f789-44ae-b6e6-90ff25daad19 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:02.856001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc714980-f789-44ae-b6e6-90ff25daad19 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:02.857619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 656/1309] 10.222.0.13 () {54 vars in 964 bytes} [Thu Jun 23 01:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:56:02.863756 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf449b3-3fc4-47b5-afb1-e44f71853922 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:02.864027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf449b3-3fc4-47b5-afb1-e44f71853922 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:02.864326 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf449b3-3fc4-47b5-afb1-e44f71853922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:02.948900 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-fdf449b3-3fc4-47b5-afb1-e44f71853922 None None] MFA Rules not processed for user `8cda12550db1442ab04f30b9875fdbea`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:56:02.950120 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-fdf449b3-3fc4-47b5-afb1-e44f71853922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:02.971573 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:56:03.029503 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 654/1310] 10.222.0.13 () {58 vars in 1061 bytes} [Thu Jun 23 01:56:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:56:03.039090 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc714980-f789-44ae-b6e6-90ff25daad19 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:56:03.040958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-dc714980-f789-44ae-b6e6-90ff25daad19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:03.152600 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc714980-f789-44ae-b6e6-90ff25daad19 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:56:03.228615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b3398-715d-4352-a6d7-c70d9c6b0d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:56:03.229274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b3398-715d-4352-a6d7-c70d9c6b0d5a service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:03.229551 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b3398-715d-4352-a6d7-c70d9c6b0d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:03.229873 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b3398-715d-4352-a6d7-c70d9c6b0d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:03.231555 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-3d1b3398-715d-4352-a6d7-c70d9c6b0d5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:03.287442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:56:03.345495 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b3398-715d-4352-a6d7-c70d9c6b0d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:56:03.347220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b3398-715d-4352-a6d7-c70d9c6b0d5a service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:56:03.367216 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 657/1311] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:56:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:56:05.644821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d33de-503a-44cb-99f4-dbf26408c6ce None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:05.645378 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d33de-503a-44cb-99f4-dbf26408c6ce None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:05.645378 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d33de-503a-44cb-99f4-dbf26408c6ce None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:05.646784 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 655/1312] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:56:05.652377 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893da53-44fa-4fbe-8372-07f02b175e8d None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:05.652879 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893da53-44fa-4fbe-8372-07f02b175e8d None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:05.652982 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893da53-44fa-4fbe-8372-07f02b175e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:05.729822 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-4893da53-44fa-4fbe-8372-07f02b175e8d None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:56:05.731053 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-4893da53-44fa-4fbe-8372-07f02b175e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:05.841914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 658/1313] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:56:05.880374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d33de-503a-44cb-99f4-dbf26408c6ce None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:56:05.882015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-b54d33de-503a-44cb-99f4-dbf26408c6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:06.001839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d33de-503a-44cb-99f4-dbf26408c6ce None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:56:06.081924 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:56:06.084958 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c90f95-752d-493b-b58c-6a3c7f8d0355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:56:06.085752 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c90f95-752d-493b-b58c-6a3c7f8d0355 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:06.086039 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c90f95-752d-493b-b58c-6a3c7f8d0355 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:06.086322 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c90f95-752d-493b-b58c-6a3c7f8d0355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:06.088486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-12c90f95-752d-493b-b58c-6a3c7f8d0355 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:06.208647 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c90f95-752d-493b-b58c-6a3c7f8d0355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:56:06.210453 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c90f95-752d-493b-b58c-6a3c7f8d0355 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:56:06.231166 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 656/1314] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:56:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 01:56:08.529594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f961b-c12e-4d14-94d6-07d94b2df317 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:08.530244 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f961b-c12e-4d14-94d6-07d94b2df317 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:08.530244 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f961b-c12e-4d14-94d6-07d94b2df317 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:08.531578 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 659/1315] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:56:08.537846 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294472bd-7b1e-43c7-a0bb-2bac115f1c53 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:08.538567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294472bd-7b1e-43c7-a0bb-2bac115f1c53 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:08.538722 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294472bd-7b1e-43c7-a0bb-2bac115f1c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:08.610238 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-294472bd-7b1e-43c7-a0bb-2bac115f1c53 None None] MFA Rules not processed for user `0a55a1d08bab41e3ac768f97064540ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:56:08.611451 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-294472bd-7b1e-43c7-a0bb-2bac115f1c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:08.663737 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:56:08.709359 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 657/1316] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:56:08 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:56:08.758464 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f961b-c12e-4d14-94d6-07d94b2df317 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:56:08.760046 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-709f961b-c12e-4d14-94d6-07d94b2df317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:08.770309 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:56:08.872815 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f961b-c12e-4d14-94d6-07d94b2df317 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:56:08.952577 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfd052-5152-468f-b50b-c3e71c0819be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:56:08.953227 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfd052-5152-468f-b50b-c3e71c0819be service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:08.953504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfd052-5152-468f-b50b-c3e71c0819be service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:08.953772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfd052-5152-468f-b50b-c3e71c0819be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:08.955400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-17cfd052-5152-468f-b50b-c3e71c0819be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:09.018505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:56:09.067660 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cfd052-5152-468f-b50b-c3e71c0819be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:56:09.069129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cfd052-5152-468f-b50b-c3e71c0819be service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:56:09.088425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 660/1317] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:56:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:56:11.638654 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7566c4-7dbc-4673-b8cb-de130fe5bfb0 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:11.639211 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7566c4-7dbc-4673-b8cb-de130fe5bfb0 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:11.639211 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7566c4-7dbc-4673-b8cb-de130fe5bfb0 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:11.640863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 658/1318] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:56:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:56:11.650084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c1ee4-f1ab-4616-ab04-2b1a4d9f7ba9 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:11.650499 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c1ee4-f1ab-4616-ab04-2b1a4d9f7ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:11.650834 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c1ee4-f1ab-4616-ab04-2b1a4d9f7ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:11.726667 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-6e4c1ee4-f1ab-4616-ab04-2b1a4d9f7ba9 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:56:11.727936 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-6e4c1ee4-f1ab-4616-ab04-2b1a4d9f7ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:11.834170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 661/1319] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:56:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:56:11.877460 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7566c4-7dbc-4673-b8cb-de130fe5bfb0 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:56:11.879860 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-8c7566c4-7dbc-4673-b8cb-de130fe5bfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:11.999914 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7566c4-7dbc-4673-b8cb-de130fe5bfb0 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:56:12.088259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140683d-6635-4ce2-ac29-931e33374d09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:56:12.088912 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140683d-6635-4ce2-ac29-931e33374d09 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:12.089193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140683d-6635-4ce2-ac29-931e33374d09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:12.089467 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140683d-6635-4ce2-ac29-931e33374d09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:12.091103 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-9140683d-6635-4ce2-ac29-931e33374d09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:12.098334 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:56:12.205140 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140683d-6635-4ce2-ac29-931e33374d09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:56:12.206522 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140683d-6635-4ce2-ac29-931e33374d09 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:56:12.225797 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 659/1320] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:56:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:56:14.952236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0446ad-b878-4f26-8157-4ce67b367c5f None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:14.952790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0446ad-b878-4f26-8157-4ce67b367c5f None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:14.952790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0446ad-b878-4f26-8157-4ce67b367c5f None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:14.954187 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 662/1321] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:56:14.959582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb938ca-9579-4c1d-989f-0074e6ff4bd4 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:14.960044 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb938ca-9579-4c1d-989f-0074e6ff4bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:14.960144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb938ca-9579-4c1d-989f-0074e6ff4bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:15.028890 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-fcb938ca-9579-4c1d-989f-0074e6ff4bd4 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:56:15.030389 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-fcb938ca-9579-4c1d-989f-0074e6ff4bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:15.089555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:56:15.134853 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 660/1322] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:56:15.186647 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c8673-9572-4b7b-ad99-1c6d3973ca25 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:15.186858 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c8673-9572-4b7b-ad99-1c6d3973ca25 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:15.187145 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c8673-9572-4b7b-ad99-1c6d3973ca25 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:15.188603 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 663/1323] 10.222.0.13 () {54 vars in 964 bytes} [Thu Jun 23 01:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:56:15.195037 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b4b63-0156-4f34-96c6-799f7964f3ef None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:15.195281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b4b63-0156-4f34-96c6-799f7964f3ef None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:15.195634 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b4b63-0156-4f34-96c6-799f7964f3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:15.276551 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-ab6b4b63-0156-4f34-96c6-799f7964f3ef None None] MFA Rules not processed for user `8cda12550db1442ab04f30b9875fdbea`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:56:15.277822 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-ab6b4b63-0156-4f34-96c6-799f7964f3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:15.359220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 661/1324] 10.222.0.13 () {58 vars in 1061 bytes} [Thu Jun 23 01:56:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:56:15.368493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c8673-9572-4b7b-ad99-1c6d3973ca25 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:56:15.370038 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-2e7c8673-9572-4b7b-ad99-1c6d3973ca25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:15.390815 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:56:15.479936 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c8673-9572-4b7b-ad99-1c6d3973ca25 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:56:15.559077 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0833f-386d-49e3-8cff-d38a723acf0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:56:15.559664 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0833f-386d-49e3-8cff-d38a723acf0d service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:15.559948 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0833f-386d-49e3-8cff-d38a723acf0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:15.560220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0833f-386d-49e3-8cff-d38a723acf0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:15.561916 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-fce0833f-386d-49e3-8cff-d38a723acf0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:15.635137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:56:15.676829 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0833f-386d-49e3-8cff-d38a723acf0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:56:15.678297 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0833f-386d-49e3-8cff-d38a723acf0d service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:56:15.697460 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 664/1325] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:56:18.015549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3f74b-2b03-4ecc-b2d1-cf679fdc74be None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:18.016135 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3f74b-2b03-4ecc-b2d1-cf679fdc74be None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:18.016135 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3f74b-2b03-4ecc-b2d1-cf679fdc74be None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:18.017491 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 662/1326] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:56:18.023143 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455fce5-adf4-47b8-855b-130f7d69aff4 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:18.023605 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455fce5-adf4-47b8-855b-130f7d69aff4 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:18.023713 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455fce5-adf4-47b8-855b-130f7d69aff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:18.095769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-5455fce5-adf4-47b8-855b-130f7d69aff4 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:56:18.096979 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5455fce5-adf4-47b8-855b-130f7d69aff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:18.216664 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 665/1327] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:56:18.253815 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3f74b-2b03-4ecc-b2d1-cf679fdc74be None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:56:18.255360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-51a3f74b-2b03-4ecc-b2d1-cf679fdc74be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:18.318941 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:56:18.365473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3f74b-2b03-4ecc-b2d1-cf679fdc74be None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:56:18.443525 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d1864-0ff9-4244-bfd0-f0e56b88b9b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:56:18.444078 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d1864-0ff9-4244-bfd0-f0e56b88b9b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:18.444359 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d1864-0ff9-4244-bfd0-f0e56b88b9b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:18.444633 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d1864-0ff9-4244-bfd0-f0e56b88b9b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:18.446285 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-e50d1864-0ff9-4244-bfd0-f0e56b88b9b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:18.556284 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:56:18.559348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d1864-0ff9-4244-bfd0-f0e56b88b9b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:56:18.561697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d1864-0ff9-4244-bfd0-f0e56b88b9b9 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:56:18.581902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 663/1328] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:56:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:56:20.707934 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997c8b9-3364-439e-871a-f6810f784114 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:20.708483 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997c8b9-3364-439e-871a-f6810f784114 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:20.708483 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997c8b9-3364-439e-871a-f6810f784114 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:20.709862 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 666/1329] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:56:20.715504 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596c4f7-6aa9-447b-9f42-63c76a7cf59a None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:20.715959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596c4f7-6aa9-447b-9f42-63c76a7cf59a None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:20.716080 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596c4f7-6aa9-447b-9f42-63c76a7cf59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:20.785253 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-b596c4f7-6aa9-447b-9f42-63c76a7cf59a None None] MFA Rules not processed for user `0a55a1d08bab41e3ac768f97064540ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:56:20.786465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-b596c4f7-6aa9-447b-9f42-63c76a7cf59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:20.884994 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 664/1330] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:56:20 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:56:20.923282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997c8b9-3364-439e-871a-f6810f784114 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:56:20.925123 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-a997c8b9-3364-439e-871a-f6810f784114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:20.961986 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:56:21.049893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997c8b9-3364-439e-871a-f6810f784114 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:56:21.125634 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10073b-e0a6-4734-9093-36dd059c33d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:56:21.126293 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10073b-e0a6-4734-9093-36dd059c33d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:21.126575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10073b-e0a6-4734-9093-36dd059c33d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:21.126848 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10073b-e0a6-4734-9093-36dd059c33d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:21.129037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-0c10073b-e0a6-4734-9093-36dd059c33d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:21.214654 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:56:21.249860 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10073b-e0a6-4734-9093-36dd059c33d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:56:21.251333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10073b-e0a6-4734-9093-36dd059c33d7 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:56:21.271667 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 667/1331] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:56:20 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:56:23.700857 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7ad59-7b37-4b9e-a163-770759e37af6 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:23.701680 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7ad59-7b37-4b9e-a163-770759e37af6 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:23.701680 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7ad59-7b37-4b9e-a163-770759e37af6 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:23.702891 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 665/1332] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:56:23.709257 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c5f18-6d33-4b71-9be2-eac2ac23b0b7 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:23.709975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c5f18-6d33-4b71-9be2-eac2ac23b0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:23.710164 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c5f18-6d33-4b71-9be2-eac2ac23b0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:23.793597 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-b47c5f18-6d33-4b71-9be2-eac2ac23b0b7 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:56:23.794803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-b47c5f18-6d33-4b71-9be2-eac2ac23b0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:23.924285 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 668/1333] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:56:23.960163 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7ad59-7b37-4b9e-a163-770759e37af6 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:56:23.961717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-2ed7ad59-7b37-4b9e-a163-770759e37af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:24.039759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:56:24.083675 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7ad59-7b37-4b9e-a163-770759e37af6 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:56:24.160802 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab50b0f-91b2-41ee-83e5-b35c694ab6ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:56:24.161453 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab50b0f-91b2-41ee-83e5-b35c694ab6ac service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:24.161738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab50b0f-91b2-41ee-83e5-b35c694ab6ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:24.162009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab50b0f-91b2-41ee-83e5-b35c694ab6ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:24.163698 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-bab50b0f-91b2-41ee-83e5-b35c694ab6ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:24.281208 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab50b0f-91b2-41ee-83e5-b35c694ab6ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:56:24.282667 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab50b0f-91b2-41ee-83e5-b35c694ab6ac service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:56:24.292867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:56:24.302416 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 666/1334] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:56:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:56:26.429854 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cabca-e4ea-4ff0-aeaf-5c43d55d9ff4 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:26.430450 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cabca-e4ea-4ff0-aeaf-5c43d55d9ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:26.430450 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cabca-e4ea-4ff0-aeaf-5c43d55d9ff4 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:26.432961 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 669/1335] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:56:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:56:26.439581 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9111e6-3463-4adf-aca9-c893999e9133 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:26.439975 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9111e6-3463-4adf-aca9-c893999e9133 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:26.440184 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9111e6-3463-4adf-aca9-c893999e9133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:26.509359 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-de9111e6-3463-4adf-aca9-c893999e9133 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:56:26.510569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-de9111e6-3463-4adf-aca9-c893999e9133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:26.627794 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 667/1336] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:56:26.672417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cabca-e4ea-4ff0-aeaf-5c43d55d9ff4 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:56:26.673933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-078cabca-e4ea-4ff0-aeaf-5c43d55d9ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:26.726328 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:56:26.795103 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cabca-e4ea-4ff0-aeaf-5c43d55d9ff4 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:56:26.871211 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e082d27-c217-4241-bc0f-8b651ebb2c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:56:26.871881 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e082d27-c217-4241-bc0f-8b651ebb2c1b service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:26.872157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e082d27-c217-4241-bc0f-8b651ebb2c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:26.872431 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e082d27-c217-4241-bc0f-8b651ebb2c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:26.874113 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-2e082d27-c217-4241-bc0f-8b651ebb2c1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:26.972973 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:56:27.001149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e082d27-c217-4241-bc0f-8b651ebb2c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:56:27.002615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e082d27-c217-4241-bc0f-8b651ebb2c1b service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:56:27.021855 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 670/1337] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:56:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:56:29.522137 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b06d00-3096-4e05-ad97-644815e8057d None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:29.522721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b06d00-3096-4e05-ad97-644815e8057d None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:29.522721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b06d00-3096-4e05-ad97-644815e8057d None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:29.524144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 668/1338] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:56:29.530891 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11110e3-bc6e-4756-8ce0-fc56b99a3f1b None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:29.531656 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11110e3-bc6e-4756-8ce0-fc56b99a3f1b None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:29.531831 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11110e3-bc6e-4756-8ce0-fc56b99a3f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:29.605850 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-c11110e3-bc6e-4756-8ce0-fc56b99a3f1b None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:56:29.607072 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-c11110e3-bc6e-4756-8ce0-fc56b99a3f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:29.725243 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 671/1339] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:56:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:56:29.765198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b06d00-3096-4e05-ad97-644815e8057d None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:56:29.766746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-29b06d00-3096-4e05-ad97-644815e8057d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:29.851694 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:56:29.882194 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b06d00-3096-4e05-ad97-644815e8057d None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:56:29.969181 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d0b9c-cdda-44f5-b99a-739d967488ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:56:29.969849 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d0b9c-cdda-44f5-b99a-739d967488ea service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:29.970129 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d0b9c-cdda-44f5-b99a-739d967488ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:29.970403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d0b9c-cdda-44f5-b99a-739d967488ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:29.972111 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-119d0b9c-cdda-44f5-b99a-739d967488ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:30.087639 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d0b9c-cdda-44f5-b99a-739d967488ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:56:30.089088 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d0b9c-cdda-44f5-b99a-739d967488ea service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:56:30.107454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 669/1340] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:56:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:56:34.107658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a5472-fdbb-47f0-a188-75294b2677bd None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:34.108253 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a5472-fdbb-47f0-a188-75294b2677bd None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:34.108253 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a5472-fdbb-47f0-a188-75294b2677bd None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:34.109616 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 672/1341] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:56:34.115115 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8805e09-a778-4d5d-919e-8b5ee4c76684 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:34.115589 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8805e09-a778-4d5d-919e-8b5ee4c76684 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:34.115700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8805e09-a778-4d5d-919e-8b5ee4c76684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:34.122306 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:56:34.191882 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-d8805e09-a778-4d5d-919e-8b5ee4c76684 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:56:34.193130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-d8805e09-a778-4d5d-919e-8b5ee4c76684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:34.307018 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 670/1342] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 01:56:34.347029 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a5472-fdbb-47f0-a188-75294b2677bd None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:56:34.350214 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-123a5472-fdbb-47f0-a188-75294b2677bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:34.401573 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:56:34.450506 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a5472-fdbb-47f0-a188-75294b2677bd None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:56:34.454965 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8480af-6a46-46b0-8293-45f51f0cdb60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:56:34.455659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8480af-6a46-46b0-8293-45f51f0cdb60 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:34.455940 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8480af-6a46-46b0-8293-45f51f0cdb60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:34.456212 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8480af-6a46-46b0-8293-45f51f0cdb60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:34.465995 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8480af-6a46-46b0-8293-45f51f0cdb60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:56:34.467738 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8480af-6a46-46b0-8293-45f51f0cdb60 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:56:34.477603 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 673/1343] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:56:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:56:37.051836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c819db-3086-45ac-bcdd-7a6542009c69 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:37.052431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c819db-3086-45ac-bcdd-7a6542009c69 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:37.052431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c819db-3086-45ac-bcdd-7a6542009c69 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:37.053953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 671/1344] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:56:37.059465 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f1a23-3c1b-42ae-a1a3-f415c4274cdb None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:37.059891 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f1a23-3c1b-42ae-a1a3-f415c4274cdb None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:37.060023 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f1a23-3c1b-42ae-a1a3-f415c4274cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:37.089835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-833f1a23-3c1b-42ae-a1a3-f415c4274cdb None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:56:37.091040 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-833f1a23-3c1b-42ae-a1a3-f415c4274cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:37.172293 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 674/1345] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:56:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:56:37.210867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c819db-3086-45ac-bcdd-7a6542009c69 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:56:37.222496 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c819db-3086-45ac-bcdd-7a6542009c69 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:56:37.226934 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f228956-27be-4055-bb87-1fc657ab18ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:56:37.227671 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f228956-27be-4055-bb87-1fc657ab18ef service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:37.227953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f228956-27be-4055-bb87-1fc657ab18ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:37.228221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f228956-27be-4055-bb87-1fc657ab18ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:37.239299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f228956-27be-4055-bb87-1fc657ab18ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:56:37.241192 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f228956-27be-4055-bb87-1fc657ab18ef service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:56:37.252585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 672/1346] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:56:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:56:41.313979 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d85a2c-3ea5-41a1-9bb8-184751e7ea95 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:41.314568 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d85a2c-3ea5-41a1-9bb8-184751e7ea95 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:41.314568 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d85a2c-3ea5-41a1-9bb8-184751e7ea95 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:41.315943 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 675/1347] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:56:41.321230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6cf69-712f-47b2-a830-886d18b8d46b None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:41.321656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6cf69-712f-47b2-a830-886d18b8d46b None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:41.321770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6cf69-712f-47b2-a830-886d18b8d46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:41.340900 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-bdf6cf69-712f-47b2-a830-886d18b8d46b None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:56:41.342165 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-bdf6cf69-712f-47b2-a830-886d18b8d46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:41.350215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 673/1348] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:56:41.388419 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d85a2c-3ea5-41a1-9bb8-184751e7ea95 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:56:41.399633 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d85a2c-3ea5-41a1-9bb8-184751e7ea95 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:56:41.403318 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe392c-eb32-44d0-9e0f-179584ac3d0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:56:41.404207 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe392c-eb32-44d0-9e0f-179584ac3d0b service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:41.404490 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe392c-eb32-44d0-9e0f-179584ac3d0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:41.404762 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe392c-eb32-44d0-9e0f-179584ac3d0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:41.413886 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe392c-eb32-44d0-9e0f-179584ac3d0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:56:41.415332 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe392c-eb32-44d0-9e0f-179584ac3d0b service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:56:41.424845 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 676/1349] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:56:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:56:46.651884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4651c8c-f1d0-45b8-9309-549cb88d77d1 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:46.653143 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4651c8c-f1d0-45b8-9309-549cb88d77d1 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:46.653633 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4651c8c-f1d0-45b8-9309-549cb88d77d1 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:46.655791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 674/1350] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 23 01:56:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:56:46.660939 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a01bc1-de72-4941-a865-0aeb456ce0c0 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:46.661731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a01bc1-de72-4941-a865-0aeb456ce0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:46.662155 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a01bc1-de72-4941-a865-0aeb456ce0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:46.742315 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-90a01bc1-de72-4941-a865-0aeb456ce0c0 None None] MFA Rules not processed for user `9756f5b9de8a4f23b365a96d309d86ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:56:46.743589 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-90a01bc1-de72-4941-a865-0aeb456ce0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:46.776360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:56:46.824340 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 677/1351] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 23 01:56:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:56:51.096696 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51281eb-e8c6-46ac-af81-1790e085d0d9 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:51.097599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51281eb-e8c6-46ac-af81-1790e085d0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:51.097884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51281eb-e8c6-46ac-af81-1790e085d0d9 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:51.099540 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 675/1352] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 23 01:56:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:56:51.104897 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7d5c2-34c1-4304-9eb2-db5c91fc91c8 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:51.105663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7d5c2-34c1-4304-9eb2-db5c91fc91c8 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:51.106131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7d5c2-34c1-4304-9eb2-db5c91fc91c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:51.125073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-32d7d5c2-34c1-4304-9eb2-db5c91fc91c8 None None] MFA Rules not processed for user `9756f5b9de8a4f23b365a96d309d86ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:56:51.126555 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-32d7d5c2-34c1-4304-9eb2-db5c91fc91c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:51.135732 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 678/1353] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 23 01:56:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:56:51.335256 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=72 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:56:52.629916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d31aef-41bd-4c87-aae5-ae26ba07a7fd None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:52.630574 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d31aef-41bd-4c87-aae5-ae26ba07a7fd None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:52.630574 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d31aef-41bd-4c87-aae5-ae26ba07a7fd None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:52.632012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 676/1354] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 23 01:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:56:52.637417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b90755-88dc-450d-9887-81e5c530c996 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:52.637966 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b90755-88dc-450d-9887-81e5c530c996 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:52.638050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b90755-88dc-450d-9887-81e5c530c996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:52.657985 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-96b90755-88dc-450d-9887-81e5c530c996 None None] MFA Rules not processed for user `9756f5b9de8a4f23b365a96d309d86ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:56:52.659187 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-96b90755-88dc-450d-9887-81e5c530c996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:52.667824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 679/1355] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 23 01:56:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:56:56.263072 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b378aa-ee4a-40fd-82c7-743a230961b2 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:56.263977 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b378aa-ee4a-40fd-82c7-743a230961b2 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:56.264398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b378aa-ee4a-40fd-82c7-743a230961b2 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:56.265949 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 677/1356] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:56:56.272324 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded5b39-87e3-4201-a689-ce9662f78fb0 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:56.272778 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded5b39-87e3-4201-a689-ce9662f78fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:56.272883 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded5b39-87e3-4201-a689-ce9662f78fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:56.295640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-eded5b39-87e3-4201-a689-ce9662f78fb0 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:56:56.297095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-eded5b39-87e3-4201-a689-ce9662f78fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:56.311433 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 680/1357] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:56:56.366527 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c86a9e-10a4-42b4-892e-e00e9be0a409 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:56.367163 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c86a9e-10a4-42b4-892e-e00e9be0a409 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:56.367783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c86a9e-10a4-42b4-892e-e00e9be0a409 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:56.369791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 678/1358] 10.222.0.13 () {54 vars in 961 bytes} [Thu Jun 23 01:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:56:56.378006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb4fcf-a26b-41fd-9f6f-76b3ca9ce2d4 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:56.378513 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb4fcf-a26b-41fd-9f6f-76b3ca9ce2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:56.378933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb4fcf-a26b-41fd-9f6f-76b3ca9ce2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:56.440588 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-24bb4fcf-a26b-41fd-9f6f-76b3ca9ce2d4 None None] MFA Rules not processed for user `9d3b5180fb7144c394c39d4db28713b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:56:56.441828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-24bb4fcf-a26b-41fd-9f6f-76b3ca9ce2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:56.529984 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 681/1359] 10.222.0.13 () {58 vars in 1058 bytes} [Thu Jun 23 01:56:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:56:56.538150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c86a9e-10a4-42b4-892e-e00e9be0a409 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:56:56.553874 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c86a9e-10a4-42b4-892e-e00e9be0a409 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:56:56.560429 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a570d5-eab5-4560-b06e-458d0e7f0547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:56:56.561185 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a570d5-eab5-4560-b06e-458d0e7f0547 service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:56.561471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a570d5-eab5-4560-b06e-458d0e7f0547 service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:56.561748 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a570d5-eab5-4560-b06e-458d0e7f0547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:56.571097 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a570d5-eab5-4560-b06e-458d0e7f0547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:56:56.572749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a570d5-eab5-4560-b06e-458d0e7f0547 service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:56:56.582722 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 679/1360] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:56:58.828484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc757e94-528a-415c-8a5d-948e03b6b1b9 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:58.829026 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc757e94-528a-415c-8a5d-948e03b6b1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:58.829026 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc757e94-528a-415c-8a5d-948e03b6b1b9 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:58.830506 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 682/1361] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:56:58.835758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293857bd-5449-49e3-95e4-2317650bce30 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:58.836199 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293857bd-5449-49e3-95e4-2317650bce30 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:58.836279 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293857bd-5449-49e3-95e4-2317650bce30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:58.855739 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-293857bd-5449-49e3-95e4-2317650bce30 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:56:58.857059 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-293857bd-5449-49e3-95e4-2317650bce30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:56:58.865218 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 680/1362] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:56:58.910529 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc757e94-528a-415c-8a5d-948e03b6b1b9 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:56:58.926234 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc757e94-528a-415c-8a5d-948e03b6b1b9 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:56:58.932997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e0270-b7f6-4168-a2c3-aa4c29f742ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:56:58.933656 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e0270-b7f6-4168-a2c3-aa4c29f742ec service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:56:58.934062 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e0270-b7f6-4168-a2c3-aa4c29f742ec service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:56:58.934350 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e0270-b7f6-4168-a2c3-aa4c29f742ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:56:58.943295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e0270-b7f6-4168-a2c3-aa4c29f742ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:56:58.944993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e0270-b7f6-4168-a2c3-aa4c29f742ec service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:56:58.955567 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 683/1363] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:56:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:57:01.377333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854c6ca-4c7f-498b-8b7d-704f08651c63 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:01.377835 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854c6ca-4c7f-498b-8b7d-704f08651c63 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:01.377930 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854c6ca-4c7f-498b-8b7d-704f08651c63 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:01.379338 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 681/1364] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:01.384877 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d956455-df33-4e88-800a-aecdffb8ff39 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:01.385294 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d956455-df33-4e88-800a-aecdffb8ff39 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:01.385496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d956455-df33-4e88-800a-aecdffb8ff39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:01.404367 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-4d956455-df33-4e88-800a-aecdffb8ff39 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:01.405562 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-4d956455-df33-4e88-800a-aecdffb8ff39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:01.413715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 684/1365] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:01.476513 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb8f4b-fe78-497f-ab4b-90fd74da9102 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:01.476803 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb8f4b-fe78-497f-ab4b-90fd74da9102 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:01.477086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb8f4b-fe78-497f-ab4b-90fd74da9102 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:01.478485 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 682/1366] 10.222.0.13 () {54 vars in 961 bytes} [Thu Jun 23 01:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:01.491744 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119e3ce-18f2-42d9-ac41-f5ae75d9fbae None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:01.492017 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119e3ce-18f2-42d9-ac41-f5ae75d9fbae None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:01.492304 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119e3ce-18f2-42d9-ac41-f5ae75d9fbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:01.514072 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-a119e3ce-18f2-42d9-ac41-f5ae75d9fbae None None] MFA Rules not processed for user `9d3b5180fb7144c394c39d4db28713b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:01.515180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-a119e3ce-18f2-42d9-ac41-f5ae75d9fbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:01.524456 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 685/1367] 10.222.0.13 () {58 vars in 1058 bytes} [Thu Jun 23 01:57:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:01.532403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb8f4b-fe78-497f-ab4b-90fd74da9102 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:57:01.546820 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb8f4b-fe78-497f-ab4b-90fd74da9102 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:57:01.552260 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd523472-1854-4f5f-8815-38059958f3a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:57:01.552909 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd523472-1854-4f5f-8815-38059958f3a8 service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:01.553192 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd523472-1854-4f5f-8815-38059958f3a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:01.553469 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd523472-1854-4f5f-8815-38059958f3a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:01.562437 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd523472-1854-4f5f-8815-38059958f3a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:57:01.564100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd523472-1854-4f5f-8815-38059958f3a8 service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:57:01.573730 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 683/1368] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:57:03.678180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdce08-e3ea-4a70-8058-33e4f8084cdb None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:03.679095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdce08-e3ea-4a70-8058-33e4f8084cdb None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:03.679395 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdce08-e3ea-4a70-8058-33e4f8084cdb None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:03.680850 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 686/1369] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:57:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:03.686674 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c7fda-c0e3-4450-90df-802e2d2e25ed None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:03.687129 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c7fda-c0e3-4450-90df-802e2d2e25ed None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:03.687220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c7fda-c0e3-4450-90df-802e2d2e25ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:03.706537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-350c7fda-c0e3-4450-90df-802e2d2e25ed None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:03.707772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-350c7fda-c0e3-4450-90df-802e2d2e25ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:03.716206 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 684/1370] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:03.759432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdce08-e3ea-4a70-8058-33e4f8084cdb None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:57:03.774199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdce08-e3ea-4a70-8058-33e4f8084cdb None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:57:03.780232 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e4205-4ab0-445f-a56d-3acd4d6e5fa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:57:03.780917 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e4205-4ab0-445f-a56d-3acd4d6e5fa7 service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:03.781177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e4205-4ab0-445f-a56d-3acd4d6e5fa7 service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:03.781459 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e4205-4ab0-445f-a56d-3acd4d6e5fa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:03.803792 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e4205-4ab0-445f-a56d-3acd4d6e5fa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:57:03.805464 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e4205-4ab0-445f-a56d-3acd4d6e5fa7 service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:57:03.818066 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 687/1371] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:57:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:57:04.457676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec38291-43c7-47ff-8af4-b0e291633001 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:04.458480 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec38291-43c7-47ff-8af4-b0e291633001 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:04.458796 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec38291-43c7-47ff-8af4-b0e291633001 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:04.460401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 685/1372] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:57:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:04.466002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ea7bc-3503-49e0-a3a9-702a390c2d42 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:04.466351 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ea7bc-3503-49e0-a3a9-702a390c2d42 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:04.466672 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ea7bc-3503-49e0-a3a9-702a390c2d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:04.485880 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-8c4ea7bc-3503-49e0-a3a9-702a390c2d42 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:04.487199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-8c4ea7bc-3503-49e0-a3a9-702a390c2d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:04.495466 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 688/1373] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 01:57:04.808478 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb89580-ed0e-415d-a338-426c200ebb0c None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:04.809072 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb89580-ed0e-415d-a338-426c200ebb0c None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:04.809568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb89580-ed0e-415d-a338-426c200ebb0c None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:04.811198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 686/1374] 10.222.0.13 () {54 vars in 963 bytes} [Thu Jun 23 01:57:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:04.816981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3bd42-2fa9-4f8d-9709-a2d0084acaba None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:04.817569 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3bd42-2fa9-4f8d-9709-a2d0084acaba None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:04.817655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3bd42-2fa9-4f8d-9709-a2d0084acaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:04.824800 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:57:04.869863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-c1f3bd42-2fa9-4f8d-9709-a2d0084acaba None None] MFA Rules not processed for user `883b947de43d4779b5f95103775430c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:04.871305 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-c1f3bd42-2fa9-4f8d-9709-a2d0084acaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:04.934406 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 689/1375] 10.222.0.13 () {58 vars in 1060 bytes} [Thu Jun 23 01:57:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:04.942626 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb89580-ed0e-415d-a338-426c200ebb0c None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:57:04.954308 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb89580-ed0e-415d-a338-426c200ebb0c None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:57:04.957777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7eefa3-fa90-4e1d-b913-dce273079278 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:57:04.958423 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7eefa3-fa90-4e1d-b913-dce273079278 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:04.958703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7eefa3-fa90-4e1d-b913-dce273079278 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:04.958977 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7eefa3-fa90-4e1d-b913-dce273079278 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:04.969179 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7eefa3-fa90-4e1d-b913-dce273079278 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:57:04.970847 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7eefa3-fa90-4e1d-b913-dce273079278 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:57:04.982261 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 687/1376] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:57:05.908662 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b5aa2-77af-4d77-917a-011fdd9d3ae1 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:05.909160 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b5aa2-77af-4d77-917a-011fdd9d3ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:05.909160 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b5aa2-77af-4d77-917a-011fdd9d3ae1 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:05.915532 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 690/1377] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:57:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:05.917521 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08d883-4f02-41d9-a950-a33eda2c00dd None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:05.917521 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08d883-4f02-41d9-a950-a33eda2c00dd None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:05.917521 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08d883-4f02-41d9-a950-a33eda2c00dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:05.943492 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-4c08d883-4f02-41d9-a950-a33eda2c00dd None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:05.944781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-4c08d883-4f02-41d9-a950-a33eda2c00dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:05.953212 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 688/1378] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:06.001911 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b5aa2-77af-4d77-917a-011fdd9d3ae1 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:57:06.016625 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b5aa2-77af-4d77-917a-011fdd9d3ae1 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:57:06.022057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c22c65-c8d2-418a-b9b6-00839ace6838 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:57:06.022771 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c22c65-c8d2-418a-b9b6-00839ace6838 service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:06.023119 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c22c65-c8d2-418a-b9b6-00839ace6838 service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:06.023487 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c22c65-c8d2-418a-b9b6-00839ace6838 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:06.032467 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c22c65-c8d2-418a-b9b6-00839ace6838 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:57:06.034091 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c22c65-c8d2-418a-b9b6-00839ace6838 service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:57:06.043788 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 691/1379] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:57:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 01:57:08.101666 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb13f57-b8dc-4aa5-b5c1-83343a922f90 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:08.102179 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb13f57-b8dc-4aa5-b5c1-83343a922f90 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:08.102179 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb13f57-b8dc-4aa5-b5c1-83343a922f90 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:08.103522 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 689/1380] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:08.109458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0937961-fad0-49e8-83e5-024eeb5664d5 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:08.109893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0937961-fad0-49e8-83e5-024eeb5664d5 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:08.109991 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0937961-fad0-49e8-83e5-024eeb5664d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:08.129508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-b0937961-fad0-49e8-83e5-024eeb5664d5 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:08.130726 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-b0937961-fad0-49e8-83e5-024eeb5664d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:08.139920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 692/1381] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:08.186548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb13f57-b8dc-4aa5-b5c1-83343a922f90 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:57:08.203648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb13f57-b8dc-4aa5-b5c1-83343a922f90 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:57:08.209818 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a078fc-3ae9-4623-bb99-1dec23c6b6e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:57:08.210477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a078fc-3ae9-4623-bb99-1dec23c6b6e7 service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:08.210758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a078fc-3ae9-4623-bb99-1dec23c6b6e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:08.211035 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a078fc-3ae9-4623-bb99-1dec23c6b6e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:08.220332 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a078fc-3ae9-4623-bb99-1dec23c6b6e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:57:08.221956 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a078fc-3ae9-4623-bb99-1dec23c6b6e7 service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:57:08.237001 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 690/1382] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 01:57:10.320427 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f73e9a-289b-4923-b49b-4ab6f57501c8 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:10.321034 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f73e9a-289b-4923-b49b-4ab6f57501c8 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:10.321034 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f73e9a-289b-4923-b49b-4ab6f57501c8 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:10.322341 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 693/1383] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:10.327780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f769b-ca1a-4eeb-bbdb-b029e6c3b2c7 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:10.328245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f769b-ca1a-4eeb-bbdb-b029e6c3b2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:10.328330 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f769b-ca1a-4eeb-bbdb-b029e6c3b2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:10.347509 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-053f769b-ca1a-4eeb-bbdb-b029e6c3b2c7 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:10.348731 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-053f769b-ca1a-4eeb-bbdb-b029e6c3b2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:10.357160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 691/1384] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:10.398742 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f73e9a-289b-4923-b49b-4ab6f57501c8 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:57:10.414084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f73e9a-289b-4923-b49b-4ab6f57501c8 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:57:10.419611 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baebe7d-79a2-4417-8188-6ed877bf1a83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:57:10.420269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baebe7d-79a2-4417-8188-6ed877bf1a83 service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:10.420549 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baebe7d-79a2-4417-8188-6ed877bf1a83 service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:10.421454 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baebe7d-79a2-4417-8188-6ed877bf1a83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:10.430738 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baebe7d-79a2-4417-8188-6ed877bf1a83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:57:10.432624 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baebe7d-79a2-4417-8188-6ed877bf1a83 service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:57:10.443387 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 694/1385] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:57:12.481119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce62ab-2237-49e2-ba15-474f6c96ab71 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:12.481618 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce62ab-2237-49e2-ba15-474f6c96ab71 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:12.481731 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce62ab-2237-49e2-ba15-474f6c96ab71 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:12.483049 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 692/1386] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:12.488438 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6811da2-ebf2-4b93-9ac7-c3e0224d3eb1 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:12.488861 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6811da2-ebf2-4b93-9ac7-c3e0224d3eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:12.488994 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6811da2-ebf2-4b93-9ac7-c3e0224d3eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:12.508212 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-e6811da2-ebf2-4b93-9ac7-c3e0224d3eb1 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:12.509568 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-e6811da2-ebf2-4b93-9ac7-c3e0224d3eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:12.517550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 695/1387] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:12.562421 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce62ab-2237-49e2-ba15-474f6c96ab71 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:57:12.577042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce62ab-2237-49e2-ba15-474f6c96ab71 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:57:12.582410 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a065c3-c7e6-4d2a-bebf-6ac1405110de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:57:12.583055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a065c3-c7e6-4d2a-bebf-6ac1405110de service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:12.583335 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a065c3-c7e6-4d2a-bebf-6ac1405110de service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:12.583637 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a065c3-c7e6-4d2a-bebf-6ac1405110de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:12.592340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a065c3-c7e6-4d2a-bebf-6ac1405110de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:57:12.593928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a065c3-c7e6-4d2a-bebf-6ac1405110de service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:57:12.606196 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 693/1388] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:57:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:57:15.284942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199d71e-d5f8-4cf4-9a50-f7acf68cb996 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:15.285534 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199d71e-d5f8-4cf4-9a50-f7acf68cb996 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:15.285656 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199d71e-d5f8-4cf4-9a50-f7acf68cb996 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:15.287368 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 696/1389] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:57:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:15.294351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c985cc-f3d5-4266-935c-f821d3f2bb09 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:15.294809 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c985cc-f3d5-4266-935c-f821d3f2bb09 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:15.295061 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c985cc-f3d5-4266-935c-f821d3f2bb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:15.325153 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-b0c985cc-f3d5-4266-935c-f821d3f2bb09 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:15.326821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-b0c985cc-f3d5-4266-935c-f821d3f2bb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:15.340472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 694/1390] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:15.398136 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199d71e-d5f8-4cf4-9a50-f7acf68cb996 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:57:15.418865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199d71e-d5f8-4cf4-9a50-f7acf68cb996 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:57:15.426462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ec490-7100-476d-bb93-3aa076e2e5ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:57:15.427311 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ec490-7100-476d-bb93-3aa076e2e5ea service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:15.427793 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ec490-7100-476d-bb93-3aa076e2e5ea service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:15.428259 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ec490-7100-476d-bb93-3aa076e2e5ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:15.440684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ec490-7100-476d-bb93-3aa076e2e5ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:57:15.442966 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ec490-7100-476d-bb93-3aa076e2e5ea service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:57:15.456718 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 697/1391] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:57:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:57:17.991399 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630009e6-0dc7-45ca-a42a-35c71874df64 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:17.992003 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630009e6-0dc7-45ca-a42a-35c71874df64 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:17.992003 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630009e6-0dc7-45ca-a42a-35c71874df64 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:17.993408 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 695/1392] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:17.999591 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c9ee3-835d-4c5c-af94-087d69c307dc None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:18.000134 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c9ee3-835d-4c5c-af94-087d69c307dc None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:18.000267 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c9ee3-835d-4c5c-af94-087d69c307dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:18.019918 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-892c9ee3-835d-4c5c-af94-087d69c307dc None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:18.021216 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-892c9ee3-835d-4c5c-af94-087d69c307dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:18.037132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 698/1393] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:18.084506 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630009e6-0dc7-45ca-a42a-35c71874df64 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:57:18.099625 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630009e6-0dc7-45ca-a42a-35c71874df64 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:57:18.105540 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53081a-7065-49f9-bd35-ea878d07c3ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:57:18.106209 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53081a-7065-49f9-bd35-ea878d07c3ed service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:18.106507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53081a-7065-49f9-bd35-ea878d07c3ed service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:18.106793 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53081a-7065-49f9-bd35-ea878d07c3ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:18.115911 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53081a-7065-49f9-bd35-ea878d07c3ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:57:18.117577 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53081a-7065-49f9-bd35-ea878d07c3ed service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:57:18.128002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 696/1394] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:57:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:57:20.141058 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075b3f4-82b1-48a8-8aff-a19b4c882c7d None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:20.141692 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075b3f4-82b1-48a8-8aff-a19b4c882c7d None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:20.141692 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075b3f4-82b1-48a8-8aff-a19b4c882c7d None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:20.143047 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 699/1395] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:20.148747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04688313-821c-40a9-9559-49eaf7b29c2d None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:20.149175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04688313-821c-40a9-9559-49eaf7b29c2d None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:20.149322 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04688313-821c-40a9-9559-49eaf7b29c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:20.168496 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-04688313-821c-40a9-9559-49eaf7b29c2d None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:20.169715 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-04688313-821c-40a9-9559-49eaf7b29c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:20.178281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 697/1396] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:20.228380 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8387c-0b5b-41e6-b8ee-f50f86fc668b None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:20.228660 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8387c-0b5b-41e6-b8ee-f50f86fc668b None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:20.228929 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8387c-0b5b-41e6-b8ee-f50f86fc668b None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:20.230319 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 700/1397] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:20.234945 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6f431-423e-441a-b1f0-afdb25c4ddca None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:20.235238 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6f431-423e-441a-b1f0-afdb25c4ddca None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:20.235356 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72633687-4f89-49fd-8a27-635797905bfc None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:20.235550 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6f431-423e-441a-b1f0-afdb25c4ddca None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:20.235668 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72633687-4f89-49fd-8a27-635797905bfc None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:20.235842 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72633687-4f89-49fd-8a27-635797905bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:20.236962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 698/1398] 10.222.0.13 () {54 vars in 962 bytes} [Thu Jun 23 01:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:20.241824 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b8a2d-f11c-46d8-8b6b-fe8687f30f52 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:20.242114 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b8a2d-f11c-46d8-8b6b-fe8687f30f52 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:20.242491 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b8a2d-f11c-46d8-8b6b-fe8687f30f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:20.254618 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-72633687-4f89-49fd-8a27-635797905bfc None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:20.255809 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-72633687-4f89-49fd-8a27-635797905bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:20.263903 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 701/1399] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 01:57:20.291039 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-f43b8a2d-f11c-46d8-8b6b-fe8687f30f52 None None] MFA Rules not processed for user `46aba36939c549278bcdee7a04511e27`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:20.292287 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-f43b8a2d-f11c-46d8-8b6b-fe8687f30f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:20.310306 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72633687-4f89-49fd-8a27-635797905bfc None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:57:20.322856 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72633687-4f89-49fd-8a27-635797905bfc None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:57:20.328887 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0cded-d1ee-48ed-969a-a8cdd2d7a41a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:57:20.329523 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0cded-d1ee-48ed-969a-a8cdd2d7a41a service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:20.329816 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0cded-d1ee-48ed-969a-a8cdd2d7a41a service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:20.330088 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0cded-d1ee-48ed-969a-a8cdd2d7a41a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:20.339835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0cded-d1ee-48ed-969a-a8cdd2d7a41a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:57:20.341437 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0cded-d1ee-48ed-969a-a8cdd2d7a41a service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:57:20.350890 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 702/1400] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:57:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 01:57:20.357140 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 699/1401] 10.222.0.13 () {58 vars in 1059 bytes} [Thu Jun 23 01:57:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:20.364827 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0cded-d1ee-48ed-969a-a8cdd2d7a41a service nova] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:57:20.374555 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0cded-d1ee-48ed-969a-a8cdd2d7a41a service nova] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:57:20.380850 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91aa1b-be93-4079-b913-b3e01e8f3f2d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46aba36939c549278bcdee7a04511e27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:57:20.381524 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91aa1b-be93-4079-b913-b3e01e8f3f2d service glance] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:20.381797 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91aa1b-be93-4079-b913-b3e01e8f3f2d service glance] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:20.382064 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91aa1b-be93-4079-b913-b3e01e8f3f2d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:20.392244 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91aa1b-be93-4079-b913-b3e01e8f3f2d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:57:20.393767 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91aa1b-be93-4079-b913-b3e01e8f3f2d service glance] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:57:20.404029 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 703/1402] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:57:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:57:21.133086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65877533-cb16-4366-aa00-38e96adcf2e8 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:21.133476 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65877533-cb16-4366-aa00-38e96adcf2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:21.133830 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65877533-cb16-4366-aa00-38e96adcf2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:21.161228 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:57:21.186395 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-65877533-cb16-4366-aa00-38e96adcf2e8 None None] MFA Rules not processed for user `0dbf596d8f964d4695944a23dd8e4cef`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:21.187668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-65877533-cb16-4366-aa00-38e96adcf2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:21.254755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 700/1403] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 01:57:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 01:57:21.296295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fd7a4-cda9-40b9-a2e3-de73856eb2ed None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:21.296813 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fd7a4-cda9-40b9-a2e3-de73856eb2ed None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:21.296813 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fd7a4-cda9-40b9-a2e3-de73856eb2ed None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:21.298202 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 704/1404] 10.222.0.13 () {54 vars in 942 bytes} [Thu Jun 23 01:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:21.304748 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49455108-2e14-4a78-9415-6fe7515fdb21 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:21.305115 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49455108-2e14-4a78-9415-6fe7515fdb21 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:21.305479 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49455108-2e14-4a78-9415-6fe7515fdb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:21.360164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-49455108-2e14-4a78-9415-6fe7515fdb21 None None] MFA Rules not processed for user `1ae132c4d0b5461aa26ab929a017cb08`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:21.361521 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-49455108-2e14-4a78-9415-6fe7515fdb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:21.437310 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 701/1405] 10.222.0.13 () {58 vars in 1039 bytes} [Thu Jun 23 01:57:21 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:21.446770 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fd7a4-cda9-40b9-a2e3-de73856eb2ed None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:57:21.460816 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fd7a4-cda9-40b9-a2e3-de73856eb2ed None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:57:21.465989 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2640fb6-1c66-4579-bd5c-6947597c4a11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae132c4d0b5461aa26ab929a017cb08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:57:21.466632 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2640fb6-1c66-4579-bd5c-6947597c4a11 service swift] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:21.466912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2640fb6-1c66-4579-bd5c-6947597c4a11 service swift] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:21.467187 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2640fb6-1c66-4579-bd5c-6947597c4a11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:21.475637 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2640fb6-1c66-4579-bd5c-6947597c4a11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:57:21.477234 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2640fb6-1c66-4579-bd5c-6947597c4a11 service swift] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:57:21.486694 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 705/1406] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 01:57:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 01:57:22.417827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca380e7c-08a8-4824-949f-96a5f70adc10 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:22.419170 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca380e7c-08a8-4824-949f-96a5f70adc10 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:22.419170 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca380e7c-08a8-4824-949f-96a5f70adc10 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:22.420606 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 702/1407] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:57:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:22.425643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842826e-beda-4223-9666-b7baa4637252 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:22.426108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842826e-beda-4223-9666-b7baa4637252 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:22.426207 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842826e-beda-4223-9666-b7baa4637252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:22.447388 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-7842826e-beda-4223-9666-b7baa4637252 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:22.448944 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-7842826e-beda-4223-9666-b7baa4637252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:22.459496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 706/1408] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:22.501719 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca380e7c-08a8-4824-949f-96a5f70adc10 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:57:22.517763 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca380e7c-08a8-4824-949f-96a5f70adc10 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:57:22.525456 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda11992-664a-45dc-9a69-3d7f30ea4ea7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:57:22.526122 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda11992-664a-45dc-9a69-3d7f30ea4ea7 service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:22.526401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda11992-664a-45dc-9a69-3d7f30ea4ea7 service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:22.526673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda11992-664a-45dc-9a69-3d7f30ea4ea7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:22.537327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda11992-664a-45dc-9a69-3d7f30ea4ea7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:57:22.539044 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda11992-664a-45dc-9a69-3d7f30ea4ea7 service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:57:22.550698 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 703/1409] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:57:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:57:32.442117 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=87 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:57:32.545928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=82 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:57:43.816539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe0932-d7b4-49b4-b858-b5abab56947f None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:43.817159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe0932-d7b4-49b4-b858-b5abab56947f None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:43.817159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe0932-d7b4-49b4-b858-b5abab56947f None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:43.818552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 707/1410] 10.222.0.13 () {54 vars in 918 bytes} [Thu Jun 23 01:57:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:43.824121 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c23ad-deeb-4c30-948e-835838e36b5a None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:43.824737 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c23ad-deeb-4c30-948e-835838e36b5a None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:43.824737 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c23ad-deeb-4c30-948e-835838e36b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:43.850352 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-216c23ad-deeb-4c30-948e-835838e36b5a None None] MFA Rules not processed for user `9756f5b9de8a4f23b365a96d309d86ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:43.851636 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-216c23ad-deeb-4c30-948e-835838e36b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:43.863258 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 704/1411] 10.222.0.13 () {58 vars in 1015 bytes} [Thu Jun 23 01:57:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:43.879137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5e34f-46be-42b2-b39c-d5cd3c35c50e None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:43.879442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5e34f-46be-42b2-b39c-d5cd3c35c50e None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:43.879724 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5e34f-46be-42b2-b39c-d5cd3c35c50e None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:43.881163 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 708/1412] 10.222.0.13 () {54 vars in 918 bytes} [Thu Jun 23 01:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:43.888084 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd5fc3-7aff-43d1-abf5-c7272c5a7a2d None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:43.888417 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd5fc3-7aff-43d1-abf5-c7272c5a7a2d None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:43.888694 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd5fc3-7aff-43d1-abf5-c7272c5a7a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:43.917154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-24fd5fc3-7aff-43d1-abf5-c7272c5a7a2d None None] MFA Rules not processed for user `9d3b5180fb7144c394c39d4db28713b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:43.918843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-24fd5fc3-7aff-43d1-abf5-c7272c5a7a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:43.931298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 705/1413] 10.222.0.13 () {58 vars in 1015 bytes} [Thu Jun 23 01:57:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:46.433982 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b589a-31d7-4dd2-9f84-ad282dfa1218 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:46.434813 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b589a-31d7-4dd2-9f84-ad282dfa1218 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:46.434813 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b589a-31d7-4dd2-9f84-ad282dfa1218 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:46.436952 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 01:57:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 01:57:46.442532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d11981-db8a-4042-b7c1-d2a6d759d5a8 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:46.442938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d11981-db8a-4042-b7c1-d2a6d759d5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:46.443105 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d11981-db8a-4042-b7c1-d2a6d759d5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:46.469320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-75d11981-db8a-4042-b7c1-d2a6d759d5a8 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:46.470450 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-75d11981-db8a-4042-b7c1-d2a6d759d5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:46.479754 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 01:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:46.523231 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b589a-31d7-4dd2-9f84-ad282dfa1218 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:57:46.539957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b589a-31d7-4dd2-9f84-ad282dfa1218 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:57:46.545515 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b471e51-5d61-45b1-aebc-adbef01fd041 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:57:46.546146 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b471e51-5d61-45b1-aebc-adbef01fd041 service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:46.546429 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b471e51-5d61-45b1-aebc-adbef01fd041 service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:46.546698 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b471e51-5d61-45b1-aebc-adbef01fd041 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:46.555225 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b471e51-5d61-45b1-aebc-adbef01fd041 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:57:46.557173 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b471e51-5d61-45b1-aebc-adbef01fd041 service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:57:46.566813 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 710/1416] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:57:47.476124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103bb74-45f6-400a-a791-23d3aabcee57 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:47.476723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103bb74-45f6-400a-a791-23d3aabcee57 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:47.476723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103bb74-45f6-400a-a791-23d3aabcee57 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:47.478026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 01:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:47.484397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b743ec7-28e5-4850-8354-f7378b2101a1 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:47.484838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b743ec7-28e5-4850-8354-f7378b2101a1 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:47.484949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b743ec7-28e5-4850-8354-f7378b2101a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:47.512902 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-5b743ec7-28e5-4850-8354-f7378b2101a1 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:47.514095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5b743ec7-28e5-4850-8354-f7378b2101a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:47.523297 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 01:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:47.673535 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103bb74-45f6-400a-a791-23d3aabcee57 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:57:47.690382 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103bb74-45f6-400a-a791-23d3aabcee57 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:57:47.697187 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd7465-5e2d-4026-b738-1d1de3a10106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:57:47.697855 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd7465-5e2d-4026-b738-1d1de3a10106 service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:47.698132 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd7465-5e2d-4026-b738-1d1de3a10106 service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:47.698399 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd7465-5e2d-4026-b738-1d1de3a10106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:47.707700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd7465-5e2d-4026-b738-1d1de3a10106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:57:47.709291 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd7465-5e2d-4026-b738-1d1de3a10106 service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:57:47.719018 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 708/1419] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:57:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:57:48.607849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66da7a1-0e41-4f67-b3b8-c87cc16a494f None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:48.608753 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66da7a1-0e41-4f67-b3b8-c87cc16a494f None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:48.608753 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66da7a1-0e41-4f67-b3b8-c87cc16a494f None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:48.610933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 01:57:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:48.616258 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebac73-74d1-49b0-bed8-25ad8290301e None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:48.616687 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebac73-74d1-49b0-bed8-25ad8290301e None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:48.616801 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebac73-74d1-49b0-bed8-25ad8290301e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:48.635614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-98ebac73-74d1-49b0-bed8-25ad8290301e None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:48.636925 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-98ebac73-74d1-49b0-bed8-25ad8290301e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:48.645263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 01:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 01:57:48.805050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66da7a1-0e41-4f67-b3b8-c87cc16a494f None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:57:48.825354 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66da7a1-0e41-4f67-b3b8-c87cc16a494f None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:57:48.833379 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519392f-9aa8-47a9-9835-f5df78e2f10f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:57:48.834024 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519392f-9aa8-47a9-9835-f5df78e2f10f service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:48.834301 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519392f-9aa8-47a9-9835-f5df78e2f10f service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:48.834569 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519392f-9aa8-47a9-9835-f5df78e2f10f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:48.844310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519392f-9aa8-47a9-9835-f5df78e2f10f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:57:48.845939 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519392f-9aa8-47a9-9835-f5df78e2f10f service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:57:48.856210 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 713/1422] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:57:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:57:49.716824 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121c491-1059-47be-9948-d707d1ec6937 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:49.717442 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121c491-1059-47be-9948-d707d1ec6937 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:49.717442 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121c491-1059-47be-9948-d707d1ec6937 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:49.718776 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 01:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:49.724950 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31401e8c-0202-4e16-bfa8-396ae8e882e8 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:49.725651 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31401e8c-0202-4e16-bfa8-396ae8e882e8 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:49.725834 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31401e8c-0202-4e16-bfa8-396ae8e882e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:49.746891 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-31401e8c-0202-4e16-bfa8-396ae8e882e8 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:49.748116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-31401e8c-0202-4e16-bfa8-396ae8e882e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:49.757145 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 01:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:49.908703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121c491-1059-47be-9948-d707d1ec6937 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:57:49.928043 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121c491-1059-47be-9948-d707d1ec6937 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:57:49.935611 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d59d07-fdc7-4aa3-b405-04a7988b65ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:57:49.936304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d59d07-fdc7-4aa3-b405-04a7988b65ee service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:49.936586 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d59d07-fdc7-4aa3-b405-04a7988b65ee service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:49.936865 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d59d07-fdc7-4aa3-b405-04a7988b65ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:49.945804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d59d07-fdc7-4aa3-b405-04a7988b65ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:57:49.947467 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d59d07-fdc7-4aa3-b405-04a7988b65ee service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:57:49.957403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 711/1425] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:57:50.850605 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae930f1-3b5b-4981-aef8-05915438aef3 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:50.851207 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae930f1-3b5b-4981-aef8-05915438aef3 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:50.851207 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae930f1-3b5b-4981-aef8-05915438aef3 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:50.852601 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 01:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:50.859207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48883a9c-77ea-40de-ac8c-ef30d1bb19c8 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:50.859981 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48883a9c-77ea-40de-ac8c-ef30d1bb19c8 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:50.860171 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48883a9c-77ea-40de-ac8c-ef30d1bb19c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:50.883628 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-48883a9c-77ea-40de-ac8c-ef30d1bb19c8 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:50.884825 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-48883a9c-77ea-40de-ac8c-ef30d1bb19c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:50.893826 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 01:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:51.051165 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae930f1-3b5b-4981-aef8-05915438aef3 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:57:51.079303 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae930f1-3b5b-4981-aef8-05915438aef3 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:57:51.086493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2e4c9-8aaa-4f3d-8e61-7045b77c1af0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:57:51.087120 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2e4c9-8aaa-4f3d-8e61-7045b77c1af0 service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:51.087392 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2e4c9-8aaa-4f3d-8e61-7045b77c1af0 service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:51.087718 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2e4c9-8aaa-4f3d-8e61-7045b77c1af0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:51.111766 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2e4c9-8aaa-4f3d-8e61-7045b77c1af0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:57:51.113307 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2e4c9-8aaa-4f3d-8e61-7045b77c1af0 service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:57:51.125532 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 716/1428] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:57:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:57:51.935996 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8781b3-1048-486f-bf7e-71313d732570 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:51.936488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8781b3-1048-486f-bf7e-71313d732570 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:51.936592 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8781b3-1048-486f-bf7e-71313d732570 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:51.938559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 01:57:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:51.943789 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32558740-b04e-43d1-bb33-b979e209f543 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:51.944228 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32558740-b04e-43d1-bb33-b979e209f543 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:51.944342 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32558740-b04e-43d1-bb33-b979e209f543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:51.965603 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-32558740-b04e-43d1-bb33-b979e209f543 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:51.967368 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-32558740-b04e-43d1-bb33-b979e209f543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:51.980634 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 01:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:52.133174 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8781b3-1048-486f-bf7e-71313d732570 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:57:52.151065 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8781b3-1048-486f-bf7e-71313d732570 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:57:52.161211 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfab676-9ede-4caf-8e83-e8316346b820 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:57:52.162073 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfab676-9ede-4caf-8e83-e8316346b820 service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:52.162439 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfab676-9ede-4caf-8e83-e8316346b820 service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:52.162844 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfab676-9ede-4caf-8e83-e8316346b820 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:52.173644 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfab676-9ede-4caf-8e83-e8316346b820 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:57:52.175253 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfab676-9ede-4caf-8e83-e8316346b820 service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:57:52.185710 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 714/1431] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:57:52.999344 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb6c48-e84b-4498-8ea4-074f41fca4a7 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:53.000030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb6c48-e84b-4498-8ea4-074f41fca4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:53.000030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb6c48-e84b-4498-8ea4-074f41fca4a7 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:53.001331 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 01:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:53.007466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b567d1-3265-4031-9230-03636030e729 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:53.008190 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b567d1-3265-4031-9230-03636030e729 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:53.008419 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b567d1-3265-4031-9230-03636030e729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:53.029871 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-33b567d1-3265-4031-9230-03636030e729 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:53.031079 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-33b567d1-3265-4031-9230-03636030e729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:53.040574 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 01:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:53.200511 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb6c48-e84b-4498-8ea4-074f41fca4a7 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:57:53.221050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb6c48-e84b-4498-8ea4-074f41fca4a7 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:57:53.227303 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564ec0a-77d2-405b-be86-110473c3ff6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:57:53.227967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564ec0a-77d2-405b-be86-110473c3ff6d service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:53.228252 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564ec0a-77d2-405b-be86-110473c3ff6d service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:53.228522 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564ec0a-77d2-405b-be86-110473c3ff6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:53.237945 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564ec0a-77d2-405b-be86-110473c3ff6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:57:53.239602 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564ec0a-77d2-405b-be86-110473c3ff6d service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:57:53.249969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 719/1434] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:57:54.057438 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0a725-a379-468e-9590-7490e84fb8ef None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:54.058230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0a725-a379-468e-9590-7490e84fb8ef None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:54.058776 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0a725-a379-468e-9590-7490e84fb8ef None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:54.060226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 01:57:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:54.066108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661452f-65bb-4bcd-96ae-ce3fb92dc341 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:54.066785 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661452f-65bb-4bcd-96ae-ce3fb92dc341 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:54.066906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661452f-65bb-4bcd-96ae-ce3fb92dc341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:54.092917 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-2661452f-65bb-4bcd-96ae-ce3fb92dc341 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:54.094148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-2661452f-65bb-4bcd-96ae-ce3fb92dc341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:54.103547 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 01:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:54.253533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0a725-a379-468e-9590-7490e84fb8ef None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:57:54.269805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0a725-a379-468e-9590-7490e84fb8ef None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:57:54.276101 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5546f6-b663-4e8e-beba-fd11b6b956e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:57:54.276790 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5546f6-b663-4e8e-beba-fd11b6b956e4 service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:54.277114 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5546f6-b663-4e8e-beba-fd11b6b956e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:54.277335 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5546f6-b663-4e8e-beba-fd11b6b956e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:54.286789 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5546f6-b663-4e8e-beba-fd11b6b956e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:57:54.288407 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5546f6-b663-4e8e-beba-fd11b6b956e4 service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:57:54.297791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 717/1437] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:57:55.101308 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d6bb0-004b-4ba8-9793-58fd3b7bab02 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:55.102230 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d6bb0-004b-4ba8-9793-58fd3b7bab02 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:55.102230 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d6bb0-004b-4ba8-9793-58fd3b7bab02 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:55.104423 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 01:57:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:55.110608 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579195bc-1581-4e5a-9094-6d55bf2b895f None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:55.111051 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579195bc-1581-4e5a-9094-6d55bf2b895f None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:55.111156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579195bc-1581-4e5a-9094-6d55bf2b895f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:55.136524 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-579195bc-1581-4e5a-9094-6d55bf2b895f None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:55.137766 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-579195bc-1581-4e5a-9094-6d55bf2b895f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:55.147536 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 01:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:55.298161 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d6bb0-004b-4ba8-9793-58fd3b7bab02 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:57:55.314439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d6bb0-004b-4ba8-9793-58fd3b7bab02 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:57:55.320754 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd7357-7ed0-47d2-adbe-a667e856848d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:57:55.321390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd7357-7ed0-47d2-adbe-a667e856848d service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:55.321671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd7357-7ed0-47d2-adbe-a667e856848d service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:55.321940 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd7357-7ed0-47d2-adbe-a667e856848d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:55.330479 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd7357-7ed0-47d2-adbe-a667e856848d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:57:55.332115 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd7357-7ed0-47d2-adbe-a667e856848d service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:57:55.341820 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 722/1440] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:57:57.263221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380d879-3822-4dcd-a782-3436140166c0 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:57.263874 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380d879-3822-4dcd-a782-3436140166c0 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:57.263874 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380d879-3822-4dcd-a782-3436140166c0 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:57.265691 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 01:57:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:57.271124 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ce15d-9423-4425-bd8e-f181228ef21f None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:57.271630 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ce15d-9423-4425-bd8e-f181228ef21f None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:57.271733 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ce15d-9423-4425-bd8e-f181228ef21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:57.290836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-532ce15d-9423-4425-bd8e-f181228ef21f None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:57.292173 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-532ce15d-9423-4425-bd8e-f181228ef21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:57.301082 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 01:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:57:57.339771 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380d879-3822-4dcd-a782-3436140166c0 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:57:57.351883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380d879-3822-4dcd-a782-3436140166c0 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:57:57.356270 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c342bc1-97e2-4045-a108-1244668b4c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:57:57.356913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c342bc1-97e2-4045-a108-1244668b4c56 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:57.357191 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c342bc1-97e2-4045-a108-1244668b4c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:57.357463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c342bc1-97e2-4045-a108-1244668b4c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:57.366846 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c342bc1-97e2-4045-a108-1244668b4c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:57:57.368310 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c342bc1-97e2-4045-a108-1244668b4c56 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:57:57.377781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 720/1443] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:57:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:57:59.538890 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e820f4-1cec-41a8-8877-b3a11af447b6 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:59.539545 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e820f4-1cec-41a8-8877-b3a11af447b6 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:59.539545 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e820f4-1cec-41a8-8877-b3a11af447b6 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:59.540852 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 01:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:57:59.547212 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3337c1-0736-493a-b1fd-990c897f1a17 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:59.547717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3337c1-0736-493a-b1fd-990c897f1a17 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:59.547826 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3337c1-0736-493a-b1fd-990c897f1a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:59.567267 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-5f3337c1-0736-493a-b1fd-990c897f1a17 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:57:59.568496 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-5f3337c1-0736-493a-b1fd-990c897f1a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:57:59.578302 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 01:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 01:57:59.619512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e820f4-1cec-41a8-8877-b3a11af447b6 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:57:59.636406 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e820f4-1cec-41a8-8877-b3a11af447b6 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:57:59.640316 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3990afd-be08-42fe-9c0a-2c61abc09c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:57:59.640954 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3990afd-be08-42fe-9c0a-2c61abc09c32 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:57:59.641231 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3990afd-be08-42fe-9c0a-2c61abc09c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:57:59.641498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3990afd-be08-42fe-9c0a-2c61abc09c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:57:59.651164 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3990afd-be08-42fe-9c0a-2c61abc09c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:57:59.652690 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3990afd-be08-42fe-9c0a-2c61abc09c32 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:57:59.662411 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 725/1446] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:57:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:58:02.004730 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c339e0-0f63-4e27-9e62-e343f28337aa None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:02.005476 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c339e0-0f63-4e27-9e62-e343f28337aa None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:02.005476 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c339e0-0f63-4e27-9e62-e343f28337aa None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:02.007839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 01:58:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:58:02.014648 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ced94-400f-4ced-864b-12c590319888 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:02.015121 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ced94-400f-4ced-864b-12c590319888 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:02.015229 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ced94-400f-4ced-864b-12c590319888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:02.035513 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-c35ced94-400f-4ced-864b-12c590319888 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:58:02.036784 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-c35ced94-400f-4ced-864b-12c590319888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:58:02.047239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 01:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:58:02.087832 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c339e0-0f63-4e27-9e62-e343f28337aa None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:58:02.090479 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-89c339e0-0f63-4e27-9e62-e343f28337aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:58:02.105114 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c339e0-0f63-4e27-9e62-e343f28337aa None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:58:02.108987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7ec9f-a525-44e6-960b-2baf456419b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:58:02.109641 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7ec9f-a525-44e6-960b-2baf456419b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:02.109962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7ec9f-a525-44e6-960b-2baf456419b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:02.110238 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7ec9f-a525-44e6-960b-2baf456419b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:02.120184 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7ec9f-a525-44e6-960b-2baf456419b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:58:02.121701 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7ec9f-a525-44e6-960b-2baf456419b7 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:58:02.131136 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 723/1449] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:58:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:58:04.320849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73647f54-b331-444f-a4d8-c86f8553683c None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:04.321584 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73647f54-b331-444f-a4d8-c86f8553683c None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:04.321584 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73647f54-b331-444f-a4d8-c86f8553683c None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:04.323900 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 01:58:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:58:04.330088 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411f04e-a01a-45d0-a44d-1b9bdbce12bf None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:04.330561 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411f04e-a01a-45d0-a44d-1b9bdbce12bf None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:04.330696 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411f04e-a01a-45d0-a44d-1b9bdbce12bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:04.353474 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-f411f04e-a01a-45d0-a44d-1b9bdbce12bf None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:58:04.354858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-f411f04e-a01a-45d0-a44d-1b9bdbce12bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:58:04.363282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 01:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:58:04.405257 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73647f54-b331-444f-a4d8-c86f8553683c None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:58:04.419057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73647f54-b331-444f-a4d8-c86f8553683c None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:58:04.423797 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b68a4-50fc-4bc2-b768-14facc533c90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:58:04.424436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b68a4-50fc-4bc2-b768-14facc533c90 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:04.424715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b68a4-50fc-4bc2-b768-14facc533c90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:04.424984 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b68a4-50fc-4bc2-b768-14facc533c90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:04.435246 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b68a4-50fc-4bc2-b768-14facc533c90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:58:04.436716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b68a4-50fc-4bc2-b768-14facc533c90 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:58:04.446168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 728/1452] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:58:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:58:06.552814 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbeb529-deb5-4075-93f2-859a2fb2ccf8 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:06.553418 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbeb529-deb5-4075-93f2-859a2fb2ccf8 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:06.553418 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbeb529-deb5-4075-93f2-859a2fb2ccf8 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:06.554740 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 01:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:58:06.561400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bce7fc-e20a-4158-b259-9480f161fe3d None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:06.561824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bce7fc-e20a-4158-b259-9480f161fe3d None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:06.561940 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bce7fc-e20a-4158-b259-9480f161fe3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:06.589505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-12bce7fc-e20a-4158-b259-9480f161fe3d None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:58:06.590723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-12bce7fc-e20a-4158-b259-9480f161fe3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:58:06.600202 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 01:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:58:06.643881 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbeb529-deb5-4075-93f2-859a2fb2ccf8 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:58:06.656670 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbeb529-deb5-4075-93f2-859a2fb2ccf8 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:58:06.661135 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97872fee-a2b0-40ea-9ecb-267e30e241de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:58:06.663262 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97872fee-a2b0-40ea-9ecb-267e30e241de service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:06.663584 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97872fee-a2b0-40ea-9ecb-267e30e241de service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:06.663867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97872fee-a2b0-40ea-9ecb-267e30e241de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:06.674478 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97872fee-a2b0-40ea-9ecb-267e30e241de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:58:06.676097 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97872fee-a2b0-40ea-9ecb-267e30e241de service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:58:06.686576 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 726/1455] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:58:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:58:08.761641 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8a44-d7a8-41c9-b632-8c8726a2c659 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:08.762547 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8a44-d7a8-41c9-b632-8c8726a2c659 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:08.762547 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8a44-d7a8-41c9-b632-8c8726a2c659 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:08.764877 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 01:58:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:58:08.773670 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f78d6-03b3-4126-a4b7-1b6bad9aca62 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:08.774112 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f78d6-03b3-4126-a4b7-1b6bad9aca62 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:08.774321 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f78d6-03b3-4126-a4b7-1b6bad9aca62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:08.800362 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-7d0f78d6-03b3-4126-a4b7-1b6bad9aca62 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:58:08.801563 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-7d0f78d6-03b3-4126-a4b7-1b6bad9aca62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:58:08.811235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 01:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:58:08.852186 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b8a44-d7a8-41c9-b632-8c8726a2c659 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:58:08.870879 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b8a44-d7a8-41c9-b632-8c8726a2c659 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:58:08.875592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c978a-16fa-46db-bf78-92007cadaf7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:58:08.876234 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c978a-16fa-46db-bf78-92007cadaf7e service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:08.876514 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c978a-16fa-46db-bf78-92007cadaf7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:08.876785 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c978a-16fa-46db-bf78-92007cadaf7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:08.887287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c978a-16fa-46db-bf78-92007cadaf7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:58:08.888759 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c978a-16fa-46db-bf78-92007cadaf7e service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:58:08.898636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 731/1458] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:58:10.950252 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c781f-abdc-413b-8693-59111f2bc251 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:10.950749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c781f-abdc-413b-8693-59111f2bc251 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:10.950749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c781f-abdc-413b-8693-59111f2bc251 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:10.952506 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 01:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:58:10.957400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495825d2-94cf-4b0c-bf0e-ecc780258946 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:10.957843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495825d2-94cf-4b0c-bf0e-ecc780258946 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:10.957941 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495825d2-94cf-4b0c-bf0e-ecc780258946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:10.976597 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-495825d2-94cf-4b0c-bf0e-ecc780258946 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:58:10.977788 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-495825d2-94cf-4b0c-bf0e-ecc780258946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:58:10.986184 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 01:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:58:11.028473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c781f-abdc-413b-8693-59111f2bc251 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:58:11.046093 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c781f-abdc-413b-8693-59111f2bc251 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:58:11.050568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa818b-85ae-4c33-82fd-ac7dee502b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:58:11.051221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa818b-85ae-4c33-82fd-ac7dee502b4c service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:11.051542 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa818b-85ae-4c33-82fd-ac7dee502b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:11.051819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa818b-85ae-4c33-82fd-ac7dee502b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:11.061944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa818b-85ae-4c33-82fd-ac7dee502b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:58:11.063394 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa818b-85ae-4c33-82fd-ac7dee502b4c service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:58:11.073400 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 729/1461] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:58:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:58:13.130629 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5d548-a93e-4308-9e03-63d11d971ae1 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:13.131211 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5d548-a93e-4308-9e03-63d11d971ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:13.131211 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5d548-a93e-4308-9e03-63d11d971ae1 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:13.132653 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 01:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:58:13.139271 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65754b5c-0c32-4d6b-a66b-7959b9d9c794 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:13.140087 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65754b5c-0c32-4d6b-a66b-7959b9d9c794 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:13.140261 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65754b5c-0c32-4d6b-a66b-7959b9d9c794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:13.150296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=79 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:58:13.171079 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-65754b5c-0c32-4d6b-a66b-7959b9d9c794 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:58:13.172340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-65754b5c-0c32-4d6b-a66b-7959b9d9c794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:58:13.181893 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 01:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:58:13.222468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5d548-a93e-4308-9e03-63d11d971ae1 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:58:13.230785 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=73 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:58:13.238843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5d548-a93e-4308-9e03-63d11d971ae1 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:58:13.243265 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef4a3f-7f22-4bf0-8fb4-9f6adc102c2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:58:13.243942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef4a3f-7f22-4bf0-8fb4-9f6adc102c2e service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:13.244223 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef4a3f-7f22-4bf0-8fb4-9f6adc102c2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:13.244538 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef4a3f-7f22-4bf0-8fb4-9f6adc102c2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:13.254292 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef4a3f-7f22-4bf0-8fb4-9f6adc102c2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:58:13.255778 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef4a3f-7f22-4bf0-8fb4-9f6adc102c2e service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:58:13.265547 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 734/1464] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 01:58:15.285536 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da100e4-74ab-4244-a30f-72c58d083f8c None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:15.286456 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da100e4-74ab-4244-a30f-72c58d083f8c None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:15.286456 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da100e4-74ab-4244-a30f-72c58d083f8c None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:15.288668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 01:58:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:58:15.294495 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a4116-069a-439e-ade8-9b33e309e91d None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:15.294938 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a4116-069a-439e-ade8-9b33e309e91d None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:15.295047 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a4116-069a-439e-ade8-9b33e309e91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:15.315343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-d16a4116-069a-439e-ade8-9b33e309e91d None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:58:15.316601 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-d16a4116-069a-439e-ade8-9b33e309e91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:58:15.325818 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 01:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:58:15.366064 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da100e4-74ab-4244-a30f-72c58d083f8c None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:58:15.385646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da100e4-74ab-4244-a30f-72c58d083f8c None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:58:15.390019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5944ae-8a1e-4f64-9b35-e538f0e5aba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:58:15.390655 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5944ae-8a1e-4f64-9b35-e538f0e5aba6 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:15.390932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5944ae-8a1e-4f64-9b35-e538f0e5aba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:15.391205 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5944ae-8a1e-4f64-9b35-e538f0e5aba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:15.400370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5944ae-8a1e-4f64-9b35-e538f0e5aba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:58:15.401821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5944ae-8a1e-4f64-9b35-e538f0e5aba6 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:58:15.415036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 732/1467] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:58:17.445983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197f28c-04b8-4da0-a5c7-84c4811052cf None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:17.446584 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197f28c-04b8-4da0-a5c7-84c4811052cf None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:17.446584 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197f28c-04b8-4da0-a5c7-84c4811052cf None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:17.447986 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 01:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:58:17.453685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808650-bc48-4611-884d-103fea0aca5b None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:17.454156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808650-bc48-4611-884d-103fea0aca5b None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:17.454252 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808650-bc48-4611-884d-103fea0aca5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:17.473346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-51808650-bc48-4611-884d-103fea0aca5b None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:58:17.474547 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-51808650-bc48-4611-884d-103fea0aca5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:58:17.484318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 01:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:58:17.522698 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197f28c-04b8-4da0-a5c7-84c4811052cf None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:58:17.534613 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197f28c-04b8-4da0-a5c7-84c4811052cf None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:58:17.538415 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd04cc-2161-4c5a-9348-991aadbc8300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:58:17.539052 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd04cc-2161-4c5a-9348-991aadbc8300 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:17.539330 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd04cc-2161-4c5a-9348-991aadbc8300 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:17.539606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd04cc-2161-4c5a-9348-991aadbc8300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:17.549642 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd04cc-2161-4c5a-9348-991aadbc8300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:58:17.551084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd04cc-2161-4c5a-9348-991aadbc8300 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:58:17.561197 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 737/1470] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:58:27.468041 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=11 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:58:27.556982 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=14 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:58:37.361452 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe690188-048b-41c6-84c0-6e8231b2cabd None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:37.362116 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe690188-048b-41c6-84c0-6e8231b2cabd None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:37.362116 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe690188-048b-41c6-84c0-6e8231b2cabd None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:37.363390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 734/1471] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:58:37.369184 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae6c2d-220b-4b1e-95ea-af7df7fc7bf5 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:37.369717 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae6c2d-220b-4b1e-95ea-af7df7fc7bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:37.369717 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae6c2d-220b-4b1e-95ea-af7df7fc7bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:37.388928 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-fbae6c2d-220b-4b1e-95ea-af7df7fc7bf5 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:58:37.390115 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-fbae6c2d-220b-4b1e-95ea-af7df7fc7bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:58:37.400061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 738/1472] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:58:37.456961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba1a61-5f6b-4b5c-87da-aa591dd85d83 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:37.457251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba1a61-5f6b-4b5c-87da-aa591dd85d83 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:37.457527 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba1a61-5f6b-4b5c-87da-aa591dd85d83 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:37.458905 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 735/1473] 10.222.0.13 () {54 vars in 962 bytes} [Thu Jun 23 01:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:58:37.464121 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56b717-8035-47ba-90f2-9f84dfc35026 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:37.464380 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56b717-8035-47ba-90f2-9f84dfc35026 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:37.464656 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56b717-8035-47ba-90f2-9f84dfc35026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:37.484007 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-ad56b717-8035-47ba-90f2-9f84dfc35026 None None] MFA Rules not processed for user `46aba36939c549278bcdee7a04511e27`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:58:37.485207 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-ad56b717-8035-47ba-90f2-9f84dfc35026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:58:37.492568 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 739/1474] 10.222.0.13 () {58 vars in 1059 bytes} [Thu Jun 23 01:58:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:58:37.500299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba1a61-5f6b-4b5c-87da-aa591dd85d83 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:58:37.512101 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba1a61-5f6b-4b5c-87da-aa591dd85d83 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:58:37.515971 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6eda2-7a3e-4050-9809-9f2f1ac460c9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46aba36939c549278bcdee7a04511e27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:58:37.516638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6eda2-7a3e-4050-9809-9f2f1ac460c9 service glance] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:37.516920 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6eda2-7a3e-4050-9809-9f2f1ac460c9 service glance] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:37.517196 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6eda2-7a3e-4050-9809-9f2f1ac460c9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:37.527117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6eda2-7a3e-4050-9809-9f2f1ac460c9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:58:37.528591 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6eda2-7a3e-4050-9809-9f2f1ac460c9 service glance] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:58:37.542561 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 736/1475] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:58:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:58:39.682324 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c1c4c-2332-4684-8347-71a59ad39bc8 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:39.682917 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c1c4c-2332-4684-8347-71a59ad39bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:39.682917 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c1c4c-2332-4684-8347-71a59ad39bc8 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:39.684304 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 740/1476] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:58:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:58:39.689870 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4137c97-7bc4-447c-992e-6a3c338677b4 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:39.690333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4137c97-7bc4-447c-992e-6a3c338677b4 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:39.690438 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4137c97-7bc4-447c-992e-6a3c338677b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:39.709898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-d4137c97-7bc4-447c-992e-6a3c338677b4 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:58:39.711096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-d4137c97-7bc4-447c-992e-6a3c338677b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:58:39.719737 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 737/1477] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:58:39.743278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c1c4c-2332-4684-8347-71a59ad39bc8 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:58:39.759626 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c1c4c-2332-4684-8347-71a59ad39bc8 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:58:39.768398 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afeb18d-7d1f-4069-940e-69535dc7266f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:58:39.769429 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afeb18d-7d1f-4069-940e-69535dc7266f admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:39.769887 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afeb18d-7d1f-4069-940e-69535dc7266f admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:39.770320 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afeb18d-7d1f-4069-940e-69535dc7266f admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:39.771575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afeb18d-7d1f-4069-940e-69535dc7266f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:58:39.774268 dv-cinder-815582-9-smb devstack@keystone.service[80430]: WARNING py.warnings [None req-5afeb18d-7d1f-4069-940e-69535dc7266f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 01:58:39.774268 dv-cinder-815582-9-smb devstack@keystone.service[80430]: warnings.warn(msg) Jun 23 01:58:39.774268 dv-cinder-815582-9-smb devstack@keystone.service[80430]: Jun 23 01:58:39.775652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afeb18d-7d1f-4069-940e-69535dc7266f admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:58:39.795851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 741/1478] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 23 01:58:39 2022] GET /identity/v3/projects => generated 2553 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 01:58:41.830504 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba79f4d-8b44-4165-8bd2-f717cf3530e2 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:41.831377 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba79f4d-8b44-4165-8bd2-f717cf3530e2 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:41.831377 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba79f4d-8b44-4165-8bd2-f717cf3530e2 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:41.833882 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 738/1479] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:58:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:58:41.839580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d3d68-0e12-4ce8-96a2-a0e4d90cc0ba None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:41.840029 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d3d68-0e12-4ce8-96a2-a0e4d90cc0ba None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:41.840151 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d3d68-0e12-4ce8-96a2-a0e4d90cc0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:41.859966 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-ba8d3d68-0e12-4ce8-96a2-a0e4d90cc0ba None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:58:41.861191 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-ba8d3d68-0e12-4ce8-96a2-a0e4d90cc0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:58:41.871439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 742/1480] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:58:41.921770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba79f4d-8b44-4165-8bd2-f717cf3530e2 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:58:41.939251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba79f4d-8b44-4165-8bd2-f717cf3530e2 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:58:41.944838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93da5ea-8047-4c82-84a2-6c08c61c23a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:58:41.945488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93da5ea-8047-4c82-84a2-6c08c61c23a8 service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:41.945794 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93da5ea-8047-4c82-84a2-6c08c61c23a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:41.946044 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93da5ea-8047-4c82-84a2-6c08c61c23a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:41.954464 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93da5ea-8047-4c82-84a2-6c08c61c23a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:58:41.956110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93da5ea-8047-4c82-84a2-6c08c61c23a8 service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:58:41.965826 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 739/1481] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:58:44.337536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc618c-29a9-40c8-90fd-d8dc3dab5bb0 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:44.338190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc618c-29a9-40c8-90fd-d8dc3dab5bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:44.338190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc618c-29a9-40c8-90fd-d8dc3dab5bb0 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:44.339739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 743/1482] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:58:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:58:44.345650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a52f97-39c0-4eb4-a50c-6b61fcd52f66 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:44.346203 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a52f97-39c0-4eb4-a50c-6b61fcd52f66 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:44.346203 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a52f97-39c0-4eb4-a50c-6b61fcd52f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:44.365339 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-63a52f97-39c0-4eb4-a50c-6b61fcd52f66 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:58:44.366586 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-63a52f97-39c0-4eb4-a50c-6b61fcd52f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:58:44.375349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 740/1483] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 01:58:44.411738 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc618c-29a9-40c8-90fd-d8dc3dab5bb0 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:58:44.423181 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc618c-29a9-40c8-90fd-d8dc3dab5bb0 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:58:44.427370 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30cf17-2429-492b-acb3-0722f4bf6c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:58:44.428079 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30cf17-2429-492b-acb3-0722f4bf6c1f service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:44.428361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30cf17-2429-492b-acb3-0722f4bf6c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:44.428635 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30cf17-2429-492b-acb3-0722f4bf6c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:44.439014 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30cf17-2429-492b-acb3-0722f4bf6c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:58:44.440431 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30cf17-2429-492b-acb3-0722f4bf6c1f service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:58:44.450666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 744/1484] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:58:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:58:46.742972 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cea4e3-d67e-4b18-bb07-873a807c6110 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:46.743981 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cea4e3-d67e-4b18-bb07-873a807c6110 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:46.743981 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cea4e3-d67e-4b18-bb07-873a807c6110 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:46.746249 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 741/1485] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:58:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:58:46.752496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529f9b1-5e93-490e-8777-d62454ccc683 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:46.753231 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529f9b1-5e93-490e-8777-d62454ccc683 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:46.753375 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529f9b1-5e93-490e-8777-d62454ccc683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:46.773708 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-d529f9b1-5e93-490e-8777-d62454ccc683 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:58:46.774942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-d529f9b1-5e93-490e-8777-d62454ccc683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:58:46.783928 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 745/1486] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:58:46.838328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cea4e3-d67e-4b18-bb07-873a807c6110 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:58:46.855877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cea4e3-d67e-4b18-bb07-873a807c6110 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:58:46.860049 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19926ff7-c896-46d7-bd20-bc978cdcfd19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:58:46.860694 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19926ff7-c896-46d7-bd20-bc978cdcfd19 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:46.860977 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19926ff7-c896-46d7-bd20-bc978cdcfd19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:46.861255 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19926ff7-c896-46d7-bd20-bc978cdcfd19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:46.870550 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19926ff7-c896-46d7-bd20-bc978cdcfd19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:58:46.872040 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19926ff7-c896-46d7-bd20-bc978cdcfd19 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:58:46.881528 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 742/1487] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:58:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:58:49.125743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a0a3f-a503-4ea3-82aa-d57a8bcc747c None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:49.126292 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a0a3f-a503-4ea3-82aa-d57a8bcc747c None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:49.126292 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a0a3f-a503-4ea3-82aa-d57a8bcc747c None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:49.128624 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 746/1488] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:58:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:58:49.136464 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab9c7e-5474-4833-a86e-0f2f7b5e60dc None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:49.136933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab9c7e-5474-4833-a86e-0f2f7b5e60dc None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:49.137051 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab9c7e-5474-4833-a86e-0f2f7b5e60dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:49.157339 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-2dab9c7e-5474-4833-a86e-0f2f7b5e60dc None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:58:49.158559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-2dab9c7e-5474-4833-a86e-0f2f7b5e60dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:58:49.169107 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 743/1489] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:58:49.215977 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a0a3f-a503-4ea3-82aa-d57a8bcc747c None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:58:49.228389 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a0a3f-a503-4ea3-82aa-d57a8bcc747c None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:58:49.234537 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc45b5e-a28c-4aba-9518-2b2a1f0e9a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:58:49.235173 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc45b5e-a28c-4aba-9518-2b2a1f0e9a26 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:49.235484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc45b5e-a28c-4aba-9518-2b2a1f0e9a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:49.235757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc45b5e-a28c-4aba-9518-2b2a1f0e9a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:49.245044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc45b5e-a28c-4aba-9518-2b2a1f0e9a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:58:49.246536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc45b5e-a28c-4aba-9518-2b2a1f0e9a26 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:58:49.257445 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 747/1490] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:58:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:58:51.507205 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4db881-e9b2-4883-a0fd-a57e9374aacf None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:51.508138 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4db881-e9b2-4883-a0fd-a57e9374aacf None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:51.508138 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4db881-e9b2-4883-a0fd-a57e9374aacf None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:51.513426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 744/1491] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 23 01:58:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 01:58:51.515146 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb6103-665b-4839-8bd8-9e1604cd7af5 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:51.515606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb6103-665b-4839-8bd8-9e1604cd7af5 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:51.515760 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb6103-665b-4839-8bd8-9e1604cd7af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:51.534426 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-09cb6103-665b-4839-8bd8-9e1604cd7af5 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 01:58:51.535665 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-09cb6103-665b-4839-8bd8-9e1604cd7af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 01:58:51.544688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 748/1492] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 23 01:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 01:58:51.587758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4db881-e9b2-4883-a0fd-a57e9374aacf None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 01:58:51.600607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4db881-e9b2-4883-a0fd-a57e9374aacf None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 01:58:51.604858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705c263-07de-4db4-ba3f-3f10cceb3884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 01:58:51.605528 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705c263-07de-4db4-ba3f-3f10cceb3884 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 01:58:51.605812 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705c263-07de-4db4-ba3f-3f10cceb3884 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 01:58:51.606084 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705c263-07de-4db4-ba3f-3f10cceb3884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 01:58:51.616149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705c263-07de-4db4-ba3f-3f10cceb3884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 01:58:51.617584 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705c263-07de-4db4-ba3f-3f10cceb3884 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 01:58:51.627798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 745/1493] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 01:58:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 01:59:01.528942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=33 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 01:59:01.623472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=33 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:00:17.500052 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0646209-c780-44ce-afde-ef8fc40b6eb0 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:00:17.500978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0646209-c780-44ce-afde-ef8fc40b6eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:00:17.500978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0646209-c780-44ce-afde-ef8fc40b6eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:00:17.524120 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-c0646209-c780-44ce-afde-ef8fc40b6eb0 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:00:17.525321 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-c0646209-c780-44ce-afde-ef8fc40b6eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:00:17.534689 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 749/1494] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:00:17.544816 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340dcfd-edfd-49ed-b352-2ebb935b8e6c None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:00:17.545355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340dcfd-edfd-49ed-b352-2ebb935b8e6c None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:00:17.545355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340dcfd-edfd-49ed-b352-2ebb935b8e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:00:17.564567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-9340dcfd-edfd-49ed-b352-2ebb935b8e6c None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:00:17.565760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-9340dcfd-edfd-49ed-b352-2ebb935b8e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:00:17.574556 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 746/1495] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:00:17.579489 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0646209-c780-44ce-afde-ef8fc40b6eb0 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:00:17.590747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0646209-c780-44ce-afde-ef8fc40b6eb0 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:00:17.599916 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4746b3-1b77-4a4d-8111-7099e867a613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:00:17.601084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4746b3-1b77-4a4d-8111-7099e867a613 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:00:17.601449 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4746b3-1b77-4a4d-8111-7099e867a613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:00:17.601723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4746b3-1b77-4a4d-8111-7099e867a613 admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:00:17.602435 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4746b3-1b77-4a4d-8111-7099e867a613 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:00:17.602740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4746b3-1b77-4a4d-8111-7099e867a613 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:00:17.603791 dv-cinder-815582-9-smb devstack@keystone.service[80430]: WARNING py.warnings [None req-bd4746b3-1b77-4a4d-8111-7099e867a613 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 02:00:17.603791 dv-cinder-815582-9-smb devstack@keystone.service[80430]: warnings.warn(msg) Jun 23 02:00:17.603791 dv-cinder-815582-9-smb devstack@keystone.service[80430]: Jun 23 02:00:17.604697 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4746b3-1b77-4a4d-8111-7099e867a613 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:00:17.617129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 750/1496] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:00:17.625420 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340dcfd-edfd-49ed-b352-2ebb935b8e6c None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:00:17.635459 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340dcfd-edfd-49ed-b352-2ebb935b8e6c None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:00:17.641249 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e21b5-bdcf-45f9-b8d9-9c6b7756837f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:00:17.642043 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e21b5-bdcf-45f9-b8d9-9c6b7756837f admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:00:17.642327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e21b5-bdcf-45f9-b8d9-9c6b7756837f admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:00:17.642603 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e21b5-bdcf-45f9-b8d9-9c6b7756837f admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:00:17.643277 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e21b5-bdcf-45f9-b8d9-9c6b7756837f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:00:17.645133 dv-cinder-815582-9-smb devstack@keystone.service[80431]: WARNING py.warnings [None req-d93e21b5-bdcf-45f9-b8d9-9c6b7756837f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 02:00:17.645133 dv-cinder-815582-9-smb devstack@keystone.service[80431]: warnings.warn(msg) Jun 23 02:00:17.645133 dv-cinder-815582-9-smb devstack@keystone.service[80431]: Jun 23 02:00:17.646350 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e21b5-bdcf-45f9-b8d9-9c6b7756837f admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:00:17.687954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 747/1497] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:00:17 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:00:17.693925 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4746b3-1b77-4a4d-8111-7099e867a613 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:00:17.704529 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4746b3-1b77-4a4d-8111-7099e867a613 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:00:17.762908 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0068a-aa00-4e2f-b526-59bce1760186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:00:17.763506 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0068a-aa00-4e2f-b526-59bce1760186 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:00:17.763791 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0068a-aa00-4e2f-b526-59bce1760186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:00:17.764087 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0068a-aa00-4e2f-b526-59bce1760186 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:00:17.764770 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da0068a-aa00-4e2f-b526-59bce1760186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:00:17.765822 dv-cinder-815582-9-smb devstack@keystone.service[80430]: WARNING py.warnings [None req-3da0068a-aa00-4e2f-b526-59bce1760186 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 02:00:17.765822 dv-cinder-815582-9-smb devstack@keystone.service[80430]: warnings.warn(msg) Jun 23 02:00:17.765822 dv-cinder-815582-9-smb devstack@keystone.service[80430]: Jun 23 02:00:17.767041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da0068a-aa00-4e2f-b526-59bce1760186 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:00:17.788523 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 751/1498] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:00:17 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:00:17.792668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e21b5-bdcf-45f9-b8d9-9c6b7756837f admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:00:17.803733 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e21b5-bdcf-45f9-b8d9-9c6b7756837f admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:00:17.809285 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7be9f2-11c9-450a-85ae-3f8825898263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:00:17.809961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7be9f2-11c9-450a-85ae-3f8825898263 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:00:17.810247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7be9f2-11c9-450a-85ae-3f8825898263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:00:17.810520 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7be9f2-11c9-450a-85ae-3f8825898263 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:00:17.811265 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7be9f2-11c9-450a-85ae-3f8825898263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:00:17.812351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: WARNING py.warnings [None req-dc7be9f2-11c9-450a-85ae-3f8825898263 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 02:00:17.812351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: warnings.warn(msg) Jun 23 02:00:17.812351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: Jun 23 02:00:17.813246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7be9f2-11c9-450a-85ae-3f8825898263 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:00:17.826553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 748/1499] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:00:17.830859 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0068a-aa00-4e2f-b526-59bce1760186 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:00:17.841567 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0068a-aa00-4e2f-b526-59bce1760186 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:00:17.847729 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea89f5-c383-4ca7-9ea2-31588949a77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:00:17.848389 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea89f5-c383-4ca7-9ea2-31588949a77f admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:00:17.848668 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea89f5-c383-4ca7-9ea2-31588949a77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:00:17.848934 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea89f5-c383-4ca7-9ea2-31588949a77f admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:00:17.849660 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea89f5-c383-4ca7-9ea2-31588949a77f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:00:17.850673 dv-cinder-815582-9-smb devstack@keystone.service[80430]: WARNING py.warnings [None req-2bea89f5-c383-4ca7-9ea2-31588949a77f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 02:00:17.850673 dv-cinder-815582-9-smb devstack@keystone.service[80430]: warnings.warn(msg) Jun 23 02:00:17.850673 dv-cinder-815582-9-smb devstack@keystone.service[80430]: Jun 23 02:00:17.851875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea89f5-c383-4ca7-9ea2-31588949a77f admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:00:17.865759 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 752/1500] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:00:17.871922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7be9f2-11c9-450a-85ae-3f8825898263 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:00:17.882879 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7be9f2-11c9-450a-85ae-3f8825898263 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:00:17.888476 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777e5b2-e14e-48dd-8df0-38f8dfed79e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:00:17.889390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777e5b2-e14e-48dd-8df0-38f8dfed79e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:00:17.889682 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777e5b2-e14e-48dd-8df0-38f8dfed79e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:00:17.889960 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777e5b2-e14e-48dd-8df0-38f8dfed79e4 admin admin] PATH_INFO: `/v3/projects/60bfcefdcf3943689df69c6737599f9b/users/b8126f43af4b46a085c4bbddee96a32e/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:00:17.906405 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777e5b2-e14e-48dd-8df0-38f8dfed79e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60bfcefdcf3943689df69c6737599f9b, user_id=b8126f43af4b46a085c4bbddee96a32e, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:00:17.907443 dv-cinder-815582-9-smb devstack@keystone.service[80431]: WARNING py.warnings [None req-f777e5b2-e14e-48dd-8df0-38f8dfed79e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 02:00:17.907443 dv-cinder-815582-9-smb devstack@keystone.service[80431]: warnings.warn(msg) Jun 23 02:00:17.907443 dv-cinder-815582-9-smb devstack@keystone.service[80431]: Jun 23 02:00:17.909458 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777e5b2-e14e-48dd-8df0-38f8dfed79e4 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:00:17.928661 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 749/1501] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:00:17 2022] PUT /identity/v3/projects/60bfcefdcf3943689df69c6737599f9b/users/b8126f43af4b46a085c4bbddee96a32e/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:00:17.939925 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fbba6-bca3-4ade-9e9f-fb5cfefacea5 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:00:17.940204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fbba6-bca3-4ade-9e9f-fb5cfefacea5 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:00:17.940479 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fbba6-bca3-4ade-9e9f-fb5cfefacea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:00:17.967501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-b60fbba6-bca3-4ade-9e9f-fb5cfefacea5 None None] MFA Rules not processed for user `b8126f43af4b46a085c4bbddee96a32e`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:00:17.968818 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-b60fbba6-bca3-4ade-9e9f-fb5cfefacea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:00:18.038223 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 753/1502] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:00:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:00:18.055932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73f661-1651-4bb7-abed-6ffc12067683 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:00:18.056423 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73f661-1651-4bb7-abed-6ffc12067683 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:00:18.056688 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73f661-1651-4bb7-abed-6ffc12067683 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:00:18.058684 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 750/1503] 10.222.0.13 () {54 vars in 963 bytes} [Thu Jun 23 02:00:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 02:00:18.064570 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b61b4-f231-4017-b5b5-4f96bfa108d0 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:00:18.064993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b61b4-f231-4017-b5b5-4f96bfa108d0 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:00:18.065405 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b61b4-f231-4017-b5b5-4f96bfa108d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:00:18.086011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-7b4b61b4-f231-4017-b5b5-4f96bfa108d0 None None] MFA Rules not processed for user `883b947de43d4779b5f95103775430c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:00:18.087250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-7b4b61b4-f231-4017-b5b5-4f96bfa108d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:00:18.132141 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:00:18.141372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 754/1504] 10.222.0.13 () {58 vars in 1060 bytes} [Thu Jun 23 02:00:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:00:18.149692 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73f661-1651-4bb7-abed-6ffc12067683 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:00:18.160990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73f661-1651-4bb7-abed-6ffc12067683 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:00:18.164912 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec29e28-d135-498f-819f-5500f593c46b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:00:18.165534 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec29e28-d135-498f-819f-5500f593c46b service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:00:18.165820 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec29e28-d135-498f-819f-5500f593c46b service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:00:18.166101 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec29e28-d135-498f-819f-5500f593c46b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:00:18.174388 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec29e28-d135-498f-819f-5500f593c46b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:00:18.175860 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec29e28-d135-498f-819f-5500f593c46b service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:00:18.184976 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 751/1505] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:00:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:00:18.226649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cc69f-a5f1-485d-88db-92912da4cd26 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:00:18.226920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cc69f-a5f1-485d-88db-92912da4cd26 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:00:18.227198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cc69f-a5f1-485d-88db-92912da4cd26 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:00:18.228585 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 755/1506] 10.222.0.13 () {52 vars in 829 bytes} [Thu Jun 23 02:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 02:00:18.232364 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec29e28-d135-498f-819f-5500f593c46b service cinder] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:00:18.295004 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec29e28-d135-498f-819f-5500f593c46b service cinder] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:00:18.300736 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659430e-9089-4a62-b0ff-b8c9a5f51eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:00:18.301648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659430e-9089-4a62-b0ff-b8c9a5f51eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:00:18.301926 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659430e-9089-4a62-b0ff-b8c9a5f51eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:00:18.302196 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659430e-9089-4a62-b0ff-b8c9a5f51eca admin admin] PATH_INFO: `/v3/users/b8126f43af4b46a085c4bbddee96a32e` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:00:18.304013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659430e-9089-4a62-b0ff-b8c9a5f51eca admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8126f43af4b46a085c4bbddee96a32e)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:00:18.305100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: WARNING py.warnings [None req-0659430e-9089-4a62-b0ff-b8c9a5f51eca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 02:00:18.305100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: warnings.warn(msg) Jun 23 02:00:18.305100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: Jun 23 02:00:18.306331 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659430e-9089-4a62-b0ff-b8c9a5f51eca admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:00:18.388186 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-0659430e-9089-4a62-b0ff-b8c9a5f51eca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8126f43af4b46a085c4bbddee96a32e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:00:18.408095 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-0659430e-9089-4a62-b0ff-b8c9a5f51eca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8126f43af4b46a085c4bbddee96a32e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:00:18.423712 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-0659430e-9089-4a62-b0ff-b8c9a5f51eca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8126f43af4b46a085c4bbddee96a32e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:00:18.424539 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-0659430e-9089-4a62-b0ff-b8c9a5f51eca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8126f43af4b46a085c4bbddee96a32e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:00:18.429673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:00:18.439264 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-0659430e-9089-4a62-b0ff-b8c9a5f51eca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8126f43af4b46a085c4bbddee96a32e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:00:18.447102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 752/1507] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:00:18 2022] DELETE /identity/v3/users/b8126f43af4b46a085c4bbddee96a32e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:00:18.451755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34890cd7-c9c5-4eb1-8dad-331b2565864d None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:00:18.452047 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34890cd7-c9c5-4eb1-8dad-331b2565864d None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:00:18.452325 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34890cd7-c9c5-4eb1-8dad-331b2565864d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:00:18.469906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-34890cd7-c9c5-4eb1-8dad-331b2565864d None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:00:18.471123 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-34890cd7-c9c5-4eb1-8dad-331b2565864d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:00:18.533262 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 756/1508] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:00:18.545208 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659430e-9089-4a62-b0ff-b8c9a5f51eca admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:00:18.547363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-0659430e-9089-4a62-b0ff-b8c9a5f51eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:00:18.733750 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659430e-9089-4a62-b0ff-b8c9a5f51eca admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:00:18.738311 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88bd52-7da0-4847-9f2f-4e3565185582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:00:18.739263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88bd52-7da0-4847-9f2f-4e3565185582 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:00:18.739665 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88bd52-7da0-4847-9f2f-4e3565185582 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:00:18.740021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88bd52-7da0-4847-9f2f-4e3565185582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:00:18.750705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88bd52-7da0-4847-9f2f-4e3565185582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:00:18.752230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88bd52-7da0-4847-9f2f-4e3565185582 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:00:18.761950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 753/1509] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:00:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:00:19.200127 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34890cd7-c9c5-4eb1-8dad-331b2565864d None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:00:19.201577 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-34890cd7-c9c5-4eb1-8dad-331b2565864d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:00:19.213844 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34890cd7-c9c5-4eb1-8dad-331b2565864d None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:00:19.218472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def370f-f8ea-4daf-a178-f207ffa7b76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:00:19.220572 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def370f-f8ea-4daf-a178-f207ffa7b76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:00:19.220853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def370f-f8ea-4daf-a178-f207ffa7b76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:00:19.221297 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def370f-f8ea-4daf-a178-f207ffa7b76f admin admin] PATH_INFO: `/v3/projects/60bfcefdcf3943689df69c6737599f9b` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:00:19.222501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def370f-f8ea-4daf-a178-f207ffa7b76f admin admin] RBAC: Authorizing `identity:delete_project(project_id=60bfcefdcf3943689df69c6737599f9b)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:00:19.223563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: WARNING py.warnings [None req-6def370f-f8ea-4daf-a178-f207ffa7b76f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 02:00:19.223563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: warnings.warn(msg) Jun 23 02:00:19.223563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: Jun 23 02:00:19.224795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def370f-f8ea-4daf-a178-f207ffa7b76f admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:00:19.289314 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-6def370f-f8ea-4daf-a178-f207ffa7b76f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60bfcefdcf3943689df69c6737599f9b', 'request_id': 'req-6def370f-f8ea-4daf-a178-f207ffa7b76f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:00:19.303387 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-6def370f-f8ea-4daf-a178-f207ffa7b76f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60bfcefdcf3943689df69c6737599f9b', 'request_id': 'req-6def370f-f8ea-4daf-a178-f207ffa7b76f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:00:19.313990 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-6def370f-f8ea-4daf-a178-f207ffa7b76f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60bfcefdcf3943689df69c6737599f9b', 'request_id': 'req-6def370f-f8ea-4daf-a178-f207ffa7b76f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:00:19.325441 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-6def370f-f8ea-4daf-a178-f207ffa7b76f admin admin] The token cache is being invalidate because project 60bfcefdcf3943689df69c6737599f9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:00:19.325723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-6def370f-f8ea-4daf-a178-f207ffa7b76f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:00:19.326372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-6def370f-f8ea-4daf-a178-f207ffa7b76f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:00:19.328101 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 757/1510] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:00:19 2022] DELETE /identity/v3/projects/60bfcefdcf3943689df69c6737599f9b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:00:28.757572 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:00:29.322181 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:02:00.551024 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841f2af-6a59-4683-bac7-65e86a04421a None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:00.552242 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841f2af-6a59-4683-bac7-65e86a04421a None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:00.552242 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841f2af-6a59-4683-bac7-65e86a04421a None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:00.554401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 02:02:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 02:02:00.561041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc087f-aebc-489a-a3ad-c9477250d6be None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:00.561531 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc087f-aebc-489a-a3ad-c9477250d6be None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:00.561736 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc087f-aebc-489a-a3ad-c9477250d6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:00.581543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-23cc087f-aebc-489a-a3ad-c9477250d6be None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:02:00.582769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-23cc087f-aebc-489a-a3ad-c9477250d6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:02:00.644659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 02:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:02:00.800640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841f2af-6a59-4683-bac7-65e86a04421a None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:02:00.802876 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-0841f2af-6a59-4683-bac7-65e86a04421a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:02:00.903910 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841f2af-6a59-4683-bac7-65e86a04421a None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:02:00.909402 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a046a-2007-4f42-9106-7222b2cebcab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:02:00.910070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a046a-2007-4f42-9106-7222b2cebcab service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:00.910348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a046a-2007-4f42-9106-7222b2cebcab service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:00.910622 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a046a-2007-4f42-9106-7222b2cebcab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:00.919071 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a046a-2007-4f42-9106-7222b2cebcab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:02:00.920764 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a046a-2007-4f42-9106-7222b2cebcab service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:02:00.932403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 755/1513] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:02:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:02:01.753090 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadbf5f-b12f-4b6c-9688-e70bf2c8b1e2 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:01.753706 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadbf5f-b12f-4b6c-9688-e70bf2c8b1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:01.753706 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadbf5f-b12f-4b6c-9688-e70bf2c8b1e2 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:01.755038 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 02:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 02:02:01.760132 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb96a52-26f7-4b9c-8282-62c09289ca99 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:01.760587 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb96a52-26f7-4b9c-8282-62c09289ca99 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:01.760691 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb96a52-26f7-4b9c-8282-62c09289ca99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:01.780802 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-7eb96a52-26f7-4b9c-8282-62c09289ca99 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:02:01.782019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-7eb96a52-26f7-4b9c-8282-62c09289ca99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:02:01.790751 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 02:02:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:02:01.943479 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadbf5f-b12f-4b6c-9688-e70bf2c8b1e2 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:02:01.967351 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadbf5f-b12f-4b6c-9688-e70bf2c8b1e2 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:02:01.976074 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d2562-0764-4213-83c8-ddbfd4c4f2dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:02:01.977025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d2562-0764-4213-83c8-ddbfd4c4f2dd service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:01.977377 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d2562-0764-4213-83c8-ddbfd4c4f2dd service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:01.977700 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d2562-0764-4213-83c8-ddbfd4c4f2dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:01.992003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d2562-0764-4213-83c8-ddbfd4c4f2dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:02:01.994785 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d2562-0764-4213-83c8-ddbfd4c4f2dd service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:02:02.006427 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 760/1516] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:02:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:02:02.989704 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844eef7-5371-459d-83bd-b3018c1f13d5 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:02.990280 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844eef7-5371-459d-83bd-b3018c1f13d5 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:02.990280 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844eef7-5371-459d-83bd-b3018c1f13d5 None None] PATH_INFO: `/v3` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:02.991607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 757/1517] 10.222.0.27 () {54 vars in 925 bytes} [Thu Jun 23 02:02:02 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:02:02.998601 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e606c-ad5b-4743-971b-478c98027cdb None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:02.999052 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e606c-ad5b-4743-971b-478c98027cdb None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:02.999159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e606c-ad5b-4743-971b-478c98027cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:03.019486 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-394e606c-ad5b-4743-971b-478c98027cdb None None] MFA Rules not processed for user `9756f5b9de8a4f23b365a96d309d86ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:02:03.021363 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-394e606c-ad5b-4743-971b-478c98027cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:02:03.090420 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 761/1518] 10.222.0.27 () {58 vars in 1015 bytes} [Thu Jun 23 02:02:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:02:06.987218 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a2688-711d-4e06-90fe-b414c0ee3a1e None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:06.987890 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a2688-711d-4e06-90fe-b414c0ee3a1e None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:06.987890 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a2688-711d-4e06-90fe-b414c0ee3a1e None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:06.989200 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 758/1519] 10.222.0.13 () {54 vars in 960 bytes} [Thu Jun 23 02:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 02:02:06.995078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b10e4-db23-4c94-aa12-e4ef4a0730c3 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:06.995568 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b10e4-db23-4c94-aa12-e4ef4a0730c3 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:06.995671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b10e4-db23-4c94-aa12-e4ef4a0730c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:07.015190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-786b10e4-db23-4c94-aa12-e4ef4a0730c3 None None] MFA Rules not processed for user `9756f5b9de8a4f23b365a96d309d86ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:02:07.016417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-786b10e4-db23-4c94-aa12-e4ef4a0730c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:02:07.025971 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 762/1520] 10.222.0.13 () {58 vars in 1057 bytes} [Thu Jun 23 02:02:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:02:07.033682 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a2688-711d-4e06-90fe-b414c0ee3a1e None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:02:07.047673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a2688-711d-4e06-90fe-b414c0ee3a1e None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:02:07.053332 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf21dd-227b-4ba0-bb41-e767f257bc8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9756f5b9de8a4f23b365a96d309d86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:02:07.053981 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf21dd-227b-4ba0-bb41-e767f257bc8f service placement] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:07.054265 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf21dd-227b-4ba0-bb41-e767f257bc8f service placement] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:07.054549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf21dd-227b-4ba0-bb41-e767f257bc8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:07.063123 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf21dd-227b-4ba0-bb41-e767f257bc8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:02:07.064796 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf21dd-227b-4ba0-bb41-e767f257bc8f service placement] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:02:07.074671 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 759/1521] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:02:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:02:13.291007 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d02b3-86f0-4bd7-81b3-e662b5e9165e None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:13.291993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d02b3-86f0-4bd7-81b3-e662b5e9165e None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:13.291993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d02b3-86f0-4bd7-81b3-e662b5e9165e None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:13.294207 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 02:02:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 02:02:13.300293 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458db83-40f9-46ad-a5c4-3438978b3fde None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:13.301347 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458db83-40f9-46ad-a5c4-3438978b3fde None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:13.301491 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458db83-40f9-46ad-a5c4-3438978b3fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:13.336067 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-2458db83-40f9-46ad-a5c4-3438978b3fde None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:02:13.337459 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-2458db83-40f9-46ad-a5c4-3438978b3fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:02:13.346784 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 02:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:02:13.511086 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d02b3-86f0-4bd7-81b3-e662b5e9165e None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:02:13.528643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d02b3-86f0-4bd7-81b3-e662b5e9165e None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:02:13.534773 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68265832-8487-48c2-a82f-3fd518eeda08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:02:13.535444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68265832-8487-48c2-a82f-3fd518eeda08 service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:13.535734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68265832-8487-48c2-a82f-3fd518eeda08 service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:13.536006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68265832-8487-48c2-a82f-3fd518eeda08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:13.545242 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68265832-8487-48c2-a82f-3fd518eeda08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:02:13.546816 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68265832-8487-48c2-a82f-3fd518eeda08 service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:02:13.557677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 764/1524] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:02:14.427063 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192be9c-babd-416f-ba33-2f630fe07d31 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:14.427677 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192be9c-babd-416f-ba33-2f630fe07d31 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:14.427677 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192be9c-babd-416f-ba33-2f630fe07d31 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:14.429041 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 02:02:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 02:02:14.436513 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76d19d-b504-47cb-9154-d6624004d0c7 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:14.437349 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76d19d-b504-47cb-9154-d6624004d0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:14.437531 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76d19d-b504-47cb-9154-d6624004d0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:14.464359 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-ec76d19d-b504-47cb-9154-d6624004d0c7 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:02:14.465634 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-ec76d19d-b504-47cb-9154-d6624004d0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:02:14.475862 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 02:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:02:14.628620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192be9c-babd-416f-ba33-2f630fe07d31 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:02:14.653429 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192be9c-babd-416f-ba33-2f630fe07d31 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:02:14.661339 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc54174-4d35-4067-9c58-c590b9706dd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:02:14.662019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc54174-4d35-4067-9c58-c590b9706dd0 service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:14.662300 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc54174-4d35-4067-9c58-c590b9706dd0 service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:14.662575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc54174-4d35-4067-9c58-c590b9706dd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:14.672563 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc54174-4d35-4067-9c58-c590b9706dd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:02:14.674256 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc54174-4d35-4067-9c58-c590b9706dd0 service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:02:14.684957 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 762/1527] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:02:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:02:18.434509 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ef4b0-5f56-4952-bb1d-3c2df02fb5de None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:18.435086 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ef4b0-5f56-4952-bb1d-3c2df02fb5de None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:18.435086 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ef4b0-5f56-4952-bb1d-3c2df02fb5de None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:18.436658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 02:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 02:02:18.442810 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b36380-89ea-41a2-a36a-528bf042a39b None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:18.443255 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b36380-89ea-41a2-a36a-528bf042a39b None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:18.443351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b36380-89ea-41a2-a36a-528bf042a39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:18.463565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-15b36380-89ea-41a2-a36a-528bf042a39b None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:02:18.464792 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-15b36380-89ea-41a2-a36a-528bf042a39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:02:18.475100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 02:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:02:18.515202 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ef4b0-5f56-4952-bb1d-3c2df02fb5de None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:02:18.517750 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-159ef4b0-5f56-4952-bb1d-3c2df02fb5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:02:18.586750 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ef4b0-5f56-4952-bb1d-3c2df02fb5de None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:02:18.590778 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91573b1d-8062-48d3-8056-dc725de87769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:02:18.591460 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91573b1d-8062-48d3-8056-dc725de87769 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:18.591771 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91573b1d-8062-48d3-8056-dc725de87769 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:18.592035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91573b1d-8062-48d3-8056-dc725de87769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:18.601968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91573b1d-8062-48d3-8056-dc725de87769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:02:18.603426 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91573b1d-8062-48d3-8056-dc725de87769 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:02:18.608369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:02:18.613440 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 767/1530] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:02:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:02:20.629786 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f00db8-bcf3-4c5d-be67-9ab9b9878bf4 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:20.630723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f00db8-bcf3-4c5d-be67-9ab9b9878bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:20.630723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f00db8-bcf3-4c5d-be67-9ab9b9878bf4 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:20.633257 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 02:02:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 02:02:20.639571 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22a7c5-f515-4d01-9a62-93abc715d822 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:20.640517 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22a7c5-f515-4d01-9a62-93abc715d822 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:20.640517 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22a7c5-f515-4d01-9a62-93abc715d822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:20.666034 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-9c22a7c5-f515-4d01-9a62-93abc715d822 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:02:20.667261 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-9c22a7c5-f515-4d01-9a62-93abc715d822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:02:20.675833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 02:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:02:20.712495 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f00db8-bcf3-4c5d-be67-9ab9b9878bf4 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:02:20.725524 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f00db8-bcf3-4c5d-be67-9ab9b9878bf4 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:02:20.729592 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b47eaa-d30a-4a20-a347-bc6186201a80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:02:20.730250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b47eaa-d30a-4a20-a347-bc6186201a80 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:20.730535 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b47eaa-d30a-4a20-a347-bc6186201a80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:20.730816 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b47eaa-d30a-4a20-a347-bc6186201a80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:20.741179 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b47eaa-d30a-4a20-a347-bc6186201a80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:02:20.742765 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b47eaa-d30a-4a20-a347-bc6186201a80 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:02:20.753152 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 765/1533] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:02:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:02:24.253596 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f654dc7-a2f7-4385-9927-fa4ba9615d96 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:24.254177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f654dc7-a2f7-4385-9927-fa4ba9615d96 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:24.254177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f654dc7-a2f7-4385-9927-fa4ba9615d96 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:24.255561 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 02:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 02:02:24.260923 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d42b8c-f88d-4909-8f28-d63cd6014c1d None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:24.261347 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d42b8c-f88d-4909-8f28-d63cd6014c1d None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:24.261460 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d42b8c-f88d-4909-8f28-d63cd6014c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:24.281624 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-63d42b8c-f88d-4909-8f28-d63cd6014c1d None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:02:24.282854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-63d42b8c-f88d-4909-8f28-d63cd6014c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:02:24.291223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 02:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:02:24.592114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f654dc7-a2f7-4385-9927-fa4ba9615d96 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:02:24.595857 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-1f654dc7-a2f7-4385-9927-fa4ba9615d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:02:24.659572 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f654dc7-a2f7-4385-9927-fa4ba9615d96 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:02:24.663689 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2a420-729c-45ee-8d94-a37447a9e066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:02:24.664352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2a420-729c-45ee-8d94-a37447a9e066 service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:24.664612 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2a420-729c-45ee-8d94-a37447a9e066 service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:24.664927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2a420-729c-45ee-8d94-a37447a9e066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:24.674766 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2a420-729c-45ee-8d94-a37447a9e066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:02:24.676609 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2a420-729c-45ee-8d94-a37447a9e066 service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:02:24.686057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 770/1536] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:02:26.712350 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbd0f4-3a47-4fe1-a0ae-b5f40a2468ff None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:26.713387 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbd0f4-3a47-4fe1-a0ae-b5f40a2468ff None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:26.713387 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbd0f4-3a47-4fe1-a0ae-b5f40a2468ff None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:26.714668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 02:02:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 02:02:26.720954 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8a6a3-203a-480a-bb98-603fce2662b4 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:26.721485 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8a6a3-203a-480a-bb98-603fce2662b4 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:26.721596 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8a6a3-203a-480a-bb98-603fce2662b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:26.740320 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-b4c8a6a3-203a-480a-bb98-603fce2662b4 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:02:26.741515 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-b4c8a6a3-203a-480a-bb98-603fce2662b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:02:26.749550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 02:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:02:27.053213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbd0f4-3a47-4fe1-a0ae-b5f40a2468ff None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:02:27.055233 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-c4fbd0f4-3a47-4fe1-a0ae-b5f40a2468ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:02:27.071912 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbd0f4-3a47-4fe1-a0ae-b5f40a2468ff None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:02:27.076667 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dc024-ff2d-4785-ad52-27086eb142f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:02:27.077320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dc024-ff2d-4785-ad52-27086eb142f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:02:27.077606 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dc024-ff2d-4785-ad52-27086eb142f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:02:27.077887 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dc024-ff2d-4785-ad52-27086eb142f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:02:27.088232 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7dc024-ff2d-4785-ad52-27086eb142f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:02:27.089715 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7dc024-ff2d-4785-ad52-27086eb142f6 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:02:27.102733 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 768/1539] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:02:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:02:36.734772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=32 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:02:37.095721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=70 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:00.575736 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155cf49-ca85-4e1f-a63d-0045b9417aae None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:00.576387 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155cf49-ca85-4e1f-a63d-0045b9417aae None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:00.576387 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155cf49-ca85-4e1f-a63d-0045b9417aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:00.600571 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-c155cf49-ca85-4e1f-a63d-0045b9417aae None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:00.602526 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-c155cf49-ca85-4e1f-a63d-0045b9417aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:00.614296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 772/1540] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:04:00.625370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5afb3-fab0-43ec-b85f-ea5776f74bc7 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:00.625947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5afb3-fab0-43ec-b85f-ea5776f74bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:00.625947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5afb3-fab0-43ec-b85f-ea5776f74bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:00.651196 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-02a5afb3-fab0-43ec-b85f-ea5776f74bc7 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:00.652873 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-02a5afb3-fab0-43ec-b85f-ea5776f74bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:00.665851 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 769/1541] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:00.670795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155cf49-ca85-4e1f-a63d-0045b9417aae None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:00.682241 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155cf49-ca85-4e1f-a63d-0045b9417aae None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:00.692098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68806b-cea5-448b-8cbe-ea97640e99e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:00.693022 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68806b-cea5-448b-8cbe-ea97640e99e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:00.693148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68806b-cea5-448b-8cbe-ea97640e99e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:00.693333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68806b-cea5-448b-8cbe-ea97640e99e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:00.694143 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68806b-cea5-448b-8cbe-ea97640e99e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:04:00.694456 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68806b-cea5-448b-8cbe-ea97640e99e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:00.696912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68806b-cea5-448b-8cbe-ea97640e99e2 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:00.716588 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 773/1542] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:04:00.725225 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5afb3-fab0-43ec-b85f-ea5776f74bc7 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:00.741887 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5afb3-fab0-43ec-b85f-ea5776f74bc7 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:00.750675 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c8760-dd2b-41e2-9687-f3865e03718c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:00.751790 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c8760-dd2b-41e2-9687-f3865e03718c admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:00.752300 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c8760-dd2b-41e2-9687-f3865e03718c admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:00.752796 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c8760-dd2b-41e2-9687-f3865e03718c admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:00.753722 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c8760-dd2b-41e2-9687-f3865e03718c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:00.755916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c8760-dd2b-41e2-9687-f3865e03718c admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:00.802411 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 770/1543] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:00 2022] POST /identity/v3/projects => generated 393 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:00.807062 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68806b-cea5-448b-8cbe-ea97640e99e2 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:00.823840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68806b-cea5-448b-8cbe-ea97640e99e2 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:00.928380 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b5b9a-6655-4fd4-b647-b910947f162c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:00.928706 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b5b9a-6655-4fd4-b647-b910947f162c admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:00.928999 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b5b9a-6655-4fd4-b647-b910947f162c admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:00.929282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b5b9a-6655-4fd4-b647-b910947f162c admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:00.930769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b5b9a-6655-4fd4-b647-b910947f162c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:00.932868 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b5b9a-6655-4fd4-b647-b910947f162c admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:00.966970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 774/1544] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:00 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:00.972261 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c8760-dd2b-41e2-9687-f3865e03718c admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:00.990382 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c8760-dd2b-41e2-9687-f3865e03718c admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:00.995392 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225ef65-d2cf-4d99-bf4c-825b0de5b5c6 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:00.995782 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225ef65-d2cf-4d99-bf4c-825b0de5b5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:00.996013 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225ef65-d2cf-4d99-bf4c-825b0de5b5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.002014 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f63971-c70b-4ed1-a4da-d4eb045fa877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:01.003114 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f63971-c70b-4ed1-a4da-d4eb045fa877 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.003661 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f63971-c70b-4ed1-a4da-d4eb045fa877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.004264 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f63971-c70b-4ed1-a4da-d4eb045fa877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.005541 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f63971-c70b-4ed1-a4da-d4eb045fa877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:01.007397 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f63971-c70b-4ed1-a4da-d4eb045fa877 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:01.019778 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-7225ef65-d2cf-4d99-bf4c-825b0de5b5c6 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:01.021025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-7225ef65-d2cf-4d99-bf4c-825b0de5b5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:01.029043 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 771/1545] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:01.033419 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f63971-c70b-4ed1-a4da-d4eb045fa877 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:01.036357 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 775/1546] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:04:01.046754 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24154419-b3d6-43fe-9bcf-d6fc5b265227 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.047115 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24154419-b3d6-43fe-9bcf-d6fc5b265227 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.047310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24154419-b3d6-43fe-9bcf-d6fc5b265227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.049214 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f63971-c70b-4ed1-a4da-d4eb045fa877 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:01.060057 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458ac77-b39d-4b1c-80f4-b2665a3c851e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:01.061099 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458ac77-b39d-4b1c-80f4-b2665a3c851e admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.061609 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458ac77-b39d-4b1c-80f4-b2665a3c851e admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.062146 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458ac77-b39d-4b1c-80f4-b2665a3c851e admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.065504 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458ac77-b39d-4b1c-80f4-b2665a3c851e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:01.067861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458ac77-b39d-4b1c-80f4-b2665a3c851e admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:01.074058 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-24154419-b3d6-43fe-9bcf-d6fc5b265227 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:01.079514 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-24154419-b3d6-43fe-9bcf-d6fc5b265227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:01.084624 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 772/1547] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:04:01.089581 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458ac77-b39d-4b1c-80f4-b2665a3c851e admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:01.097745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 776/1548] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:01.102968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24154419-b3d6-43fe-9bcf-d6fc5b265227 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:01.110397 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458ac77-b39d-4b1c-80f4-b2665a3c851e admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:01.120220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ac166-257e-489d-9fc0-c78a42394087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:01.120431 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24154419-b3d6-43fe-9bcf-d6fc5b265227 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:01.121600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ac166-257e-489d-9fc0-c78a42394087 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.122103 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ac166-257e-489d-9fc0-c78a42394087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.122597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ac166-257e-489d-9fc0-c78a42394087 admin admin] PATH_INFO: `/v3/projects/1f860c81407e44f697340c74e0f20473/users/0c3ad28388a84ebd9d386fa466c65ba9/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.129251 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c439c5-85cb-4d3b-9c97-06348f3de2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:01.129953 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c439c5-85cb-4d3b-9c97-06348f3de2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.130394 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c439c5-85cb-4d3b-9c97-06348f3de2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.130505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c439c5-85cb-4d3b-9c97-06348f3de2c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.131235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c439c5-85cb-4d3b-9c97-06348f3de2c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:04:01.131646 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c439c5-85cb-4d3b-9c97-06348f3de2c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:01.134041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c439c5-85cb-4d3b-9c97-06348f3de2c1 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:01.150193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ac166-257e-489d-9fc0-c78a42394087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f860c81407e44f697340c74e0f20473, user_id=0c3ad28388a84ebd9d386fa466c65ba9, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:01.152948 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 777/1549] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:04:01.153977 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ac166-257e-489d-9fc0-c78a42394087 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:01.154306 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f7d05-f689-461e-9262-4d9778bf1a23 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.154606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f7d05-f689-461e-9262-4d9778bf1a23 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.154885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f7d05-f689-461e-9262-4d9778bf1a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.173194 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 773/1550] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:01 2022] PUT /identity/v3/projects/1f860c81407e44f697340c74e0f20473/users/0c3ad28388a84ebd9d386fa466c65ba9/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:04:01.179700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc371af-21ef-4b60-9417-120394d05797 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.180689 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc371af-21ef-4b60-9417-120394d05797 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.181196 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc371af-21ef-4b60-9417-120394d05797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.188816 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-b94f7d05-f689-461e-9262-4d9778bf1a23 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:01.192027 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-b94f7d05-f689-461e-9262-4d9778bf1a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:01.222120 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-9cc371af-21ef-4b60-9417-120394d05797 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:01.225880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-9cc371af-21ef-4b60-9417-120394d05797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:01.287114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 778/1551] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:01.287993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f7d05-f689-461e-9262-4d9778bf1a23 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:01.299166 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f7d05-f689-461e-9262-4d9778bf1a23 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:01.304410 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc314026-c153-4409-ac5a-5a2ba3236707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:01.305264 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc314026-c153-4409-ac5a-5a2ba3236707 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.305466 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc314026-c153-4409-ac5a-5a2ba3236707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.305849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc314026-c153-4409-ac5a-5a2ba3236707 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.306550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc314026-c153-4409-ac5a-5a2ba3236707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:01.307823 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 774/1552] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:01.308981 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1b950-4939-4f6c-a447-8bcdfe29725f None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.309276 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1b950-4939-4f6c-a447-8bcdfe29725f None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.309850 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1b950-4939-4f6c-a447-8bcdfe29725f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.313922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: WARNING py.warnings [None req-cc314026-c153-4409-ac5a-5a2ba3236707 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 02:04:01.313922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: warnings.warn(msg) Jun 23 02:04:01.313922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: Jun 23 02:04:01.315521 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc314026-c153-4409-ac5a-5a2ba3236707 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:01.333865 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-baf1b950-4939-4f6c-a447-8bcdfe29725f None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:01.335397 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-baf1b950-4939-4f6c-a447-8bcdfe29725f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:01.344877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 775/1553] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:01.347467 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 779/1554] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:01 2022] POST /identity/v3/projects => generated 401 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:01.348933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccb191-27a6-49da-bec6-20cb7a8fa11b None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.348933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccb191-27a6-49da-bec6-20cb7a8fa11b None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.349213 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccb191-27a6-49da-bec6-20cb7a8fa11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.349324 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184b41c-bdf7-4b9c-b46b-0ef5e1b56315 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.349594 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184b41c-bdf7-4b9c-b46b-0ef5e1b56315 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.350099 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184b41c-bdf7-4b9c-b46b-0ef5e1b56315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.368504 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-6184b41c-bdf7-4b9c-b46b-0ef5e1b56315 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:01.368826 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-17ccb191-27a6-49da-bec6-20cb7a8fa11b None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:01.369705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-6184b41c-bdf7-4b9c-b46b-0ef5e1b56315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:01.369820 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-17ccb191-27a6-49da-bec6-20cb7a8fa11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:01.388850 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:01.429976 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 776/1555] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:01.431390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd3027-2aaa-468a-8da8-a0173b2c7a0b None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.431706 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd3027-2aaa-468a-8da8-a0173b2c7a0b None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.431980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd3027-2aaa-468a-8da8-a0173b2c7a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.437014 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 780/1556] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:01.438233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488c75a-718d-4062-a179-9298dcd12f95 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.438589 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488c75a-718d-4062-a179-9298dcd12f95 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.438868 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488c75a-718d-4062-a179-9298dcd12f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.453134 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-38bd3027-2aaa-468a-8da8-a0173b2c7a0b None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:01.454349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-38bd3027-2aaa-468a-8da8-a0173b2c7a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:01.457531 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-5488c75a-718d-4062-a179-9298dcd12f95 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:01.458701 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5488c75a-718d-4062-a179-9298dcd12f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:01.467988 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 777/1557] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:01.467988 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526120f-3e59-4c4a-85f3-bb2e26b4e0b4 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.467988 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526120f-3e59-4c4a-85f3-bb2e26b4e0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.467988 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526120f-3e59-4c4a-85f3-bb2e26b4e0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.472516 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 781/1558] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:01.473732 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a55573-0861-46f2-9e3a-d9c51ae58f48 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.474020 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a55573-0861-46f2-9e3a-d9c51ae58f48 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.474297 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a55573-0861-46f2-9e3a-d9c51ae58f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.486469 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-c526120f-3e59-4c4a-85f3-bb2e26b4e0b4 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:01.487858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-c526120f-3e59-4c4a-85f3-bb2e26b4e0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:01.492454 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-f2a55573-0861-46f2-9e3a-d9c51ae58f48 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:01.493704 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-f2a55573-0861-46f2-9e3a-d9c51ae58f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:01.497003 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 778/1559] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:01.497828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526120f-3e59-4c4a-85f3-bb2e26b4e0b4 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:01.505592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 782/1560] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:01.505592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a55573-0861-46f2-9e3a-d9c51ae58f48 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:01.507397 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526120f-3e59-4c4a-85f3-bb2e26b4e0b4 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:01.512225 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc453939-37bb-4343-89ab-7707fb6d1401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:01.512897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc453939-37bb-4343-89ab-7707fb6d1401 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.513177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc453939-37bb-4343-89ab-7707fb6d1401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.513448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc453939-37bb-4343-89ab-7707fb6d1401 admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.514137 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc453939-37bb-4343-89ab-7707fb6d1401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:01.515164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: WARNING py.warnings [None req-cc453939-37bb-4343-89ab-7707fb6d1401 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 02:04:01.515164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: warnings.warn(msg) Jun 23 02:04:01.515164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: Jun 23 02:04:01.516417 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc453939-37bb-4343-89ab-7707fb6d1401 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:01.523087 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:01.539357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 779/1561] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:01 2022] POST /identity/v3/users => generated 301 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:01.540679 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3420dd9-0164-4468-b77e-e61ae573501c None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.541040 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3420dd9-0164-4468-b77e-e61ae573501c None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.541224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3420dd9-0164-4468-b77e-e61ae573501c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.559697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-a3420dd9-0164-4468-b77e-e61ae573501c None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:01.560998 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a3420dd9-0164-4468-b77e-e61ae573501c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:01.565505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a55573-0861-46f2-9e3a-d9c51ae58f48 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:01.569065 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651071a-0a52-4cbf-b173-8c357abd3c54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:01.569624 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 780/1562] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:01.569875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651071a-0a52-4cbf-b173-8c357abd3c54 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.570221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651071a-0a52-4cbf-b173-8c357abd3c54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.570870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651071a-0a52-4cbf-b173-8c357abd3c54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.571007 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e27d23-ad53-4345-8d5a-71bbc7347528 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.571295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e27d23-ad53-4345-8d5a-71bbc7347528 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.571598 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e27d23-ad53-4345-8d5a-71bbc7347528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.582309 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651071a-0a52-4cbf-b173-8c357abd3c54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:01.583844 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651071a-0a52-4cbf-b173-8c357abd3c54 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:01.589802 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-97e27d23-ad53-4345-8d5a-71bbc7347528 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:01.591012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-97e27d23-ad53-4345-8d5a-71bbc7347528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:01.593911 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 783/1563] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:01.595209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c46eaf-3f69-4ac3-8df9-90463665a604 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.595449 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c46eaf-3f69-4ac3-8df9-90463665a604 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.595890 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c46eaf-3f69-4ac3-8df9-90463665a604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.599614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 781/1564] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:01.604000 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e27d23-ad53-4345-8d5a-71bbc7347528 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:01.614122 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e27d23-ad53-4345-8d5a-71bbc7347528 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:01.614945 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-62c46eaf-3f69-4ac3-8df9-90463665a604 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:01.616252 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-62c46eaf-3f69-4ac3-8df9-90463665a604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:01.620669 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31236ca-9126-46b4-8279-83700ba507d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:01.621570 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31236ca-9126-46b4-8279-83700ba507d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.621852 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31236ca-9126-46b4-8279-83700ba507d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.622249 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31236ca-9126-46b4-8279-83700ba507d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.622856 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31236ca-9126-46b4-8279-83700ba507d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:04:01.623161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31236ca-9126-46b4-8279-83700ba507d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:01.624211 dv-cinder-815582-9-smb devstack@keystone.service[80431]: WARNING py.warnings [None req-b31236ca-9126-46b4-8279-83700ba507d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 02:04:01.624211 dv-cinder-815582-9-smb devstack@keystone.service[80431]: warnings.warn(msg) Jun 23 02:04:01.624211 dv-cinder-815582-9-smb devstack@keystone.service[80431]: Jun 23 02:04:01.625167 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31236ca-9126-46b4-8279-83700ba507d8 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:01.629243 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 784/1565] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:01.629243 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22099f-d4b9-4c78-8c2a-d9d3d5a1d8af None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.629243 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22099f-d4b9-4c78-8c2a-d9d3d5a1d8af None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.629243 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22099f-d4b9-4c78-8c2a-d9d3d5a1d8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.640980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 782/1566] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:04:01.641841 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31236ca-9126-46b4-8279-83700ba507d8 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:01.649180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-db22099f-d4b9-4c78-8c2a-d9d3d5a1d8af None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:01.650450 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-db22099f-d4b9-4c78-8c2a-d9d3d5a1d8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:01.659083 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31236ca-9126-46b4-8279-83700ba507d8 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:01.659728 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 785/1567] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:01.660572 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22099f-d4b9-4c78-8c2a-d9d3d5a1d8af None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:01.667997 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbced98f-8585-4851-87ee-3d4cfaa22b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:01.668847 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbced98f-8585-4851-87ee-3d4cfaa22b38 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.669388 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbced98f-8585-4851-87ee-3d4cfaa22b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.670135 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbced98f-8585-4851-87ee-3d4cfaa22b38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.670955 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbced98f-8585-4851-87ee-3d4cfaa22b38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:04:01.671349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbced98f-8585-4851-87ee-3d4cfaa22b38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:01.671727 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22099f-d4b9-4c78-8c2a-d9d3d5a1d8af None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:01.673517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbced98f-8585-4851-87ee-3d4cfaa22b38 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:01.679433 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76567444-9aea-466b-95fd-22ebf5c3d1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:01.680325 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76567444-9aea-466b-95fd-22ebf5c3d1fa admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.680768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76567444-9aea-466b-95fd-22ebf5c3d1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.681211 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76567444-9aea-466b-95fd-22ebf5c3d1fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.682106 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76567444-9aea-466b-95fd-22ebf5c3d1fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:01.684107 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76567444-9aea-466b-95fd-22ebf5c3d1fa admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:01.695555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 783/1568] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:04:01.695555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbced98f-8585-4851-87ee-3d4cfaa22b38 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:01.703304 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 786/1569] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:01.707059 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76567444-9aea-466b-95fd-22ebf5c3d1fa admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:01.708570 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbced98f-8585-4851-87ee-3d4cfaa22b38 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:01.714799 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4cd2f-cbf1-4f68-8f12-e13ca51410aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:01.715529 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4cd2f-cbf1-4f68-8f12-e13ca51410aa admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.715813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4cd2f-cbf1-4f68-8f12-e13ca51410aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.716088 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4cd2f-cbf1-4f68-8f12-e13ca51410aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.717016 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76567444-9aea-466b-95fd-22ebf5c3d1fa admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:01.717616 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4cd2f-cbf1-4f68-8f12-e13ca51410aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:04:01.717879 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4cd2f-cbf1-4f68-8f12-e13ca51410aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:01.719809 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4cd2f-cbf1-4f68-8f12-e13ca51410aa admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:01.722443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902b25f-268b-47c6-b261-bf32929741d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:01.723284 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902b25f-268b-47c6-b261-bf32929741d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.723689 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902b25f-268b-47c6-b261-bf32929741d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.723992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902b25f-268b-47c6-b261-bf32929741d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.724875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902b25f-268b-47c6-b261-bf32929741d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:04:01.725258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902b25f-268b-47c6-b261-bf32929741d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:01.727258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902b25f-268b-47c6-b261-bf32929741d5 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:01.733425 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 784/1570] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:04:01.737738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4cd2f-cbf1-4f68-8f12-e13ca51410aa admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:01.742367 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 787/1571] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:04:01.743451 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902b25f-268b-47c6-b261-bf32929741d5 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:01.754304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4cd2f-cbf1-4f68-8f12-e13ca51410aa admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:01.755524 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902b25f-268b-47c6-b261-bf32929741d5 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:01.760968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55623359-de92-4c25-896e-a6a562468f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:01.761672 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55623359-de92-4c25-896e-a6a562468f85 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.761950 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55623359-de92-4c25-896e-a6a562468f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.762220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55623359-de92-4c25-896e-a6a562468f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.762832 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504393cb-712d-474d-9690-200eb675eaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:01.762959 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55623359-de92-4c25-896e-a6a562468f85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:01.764130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504393cb-712d-474d-9690-200eb675eaf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.764651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504393cb-712d-474d-9690-200eb675eaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.764835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55623359-de92-4c25-896e-a6a562468f85 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:01.765307 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504393cb-712d-474d-9690-200eb675eaf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.766564 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504393cb-712d-474d-9690-200eb675eaf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:04:01.767094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504393cb-712d-474d-9690-200eb675eaf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:01.770409 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504393cb-712d-474d-9690-200eb675eaf6 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:01.792308 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 785/1572] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:04:01.793276 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504393cb-712d-474d-9690-200eb675eaf6 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:01.805766 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504393cb-712d-474d-9690-200eb675eaf6 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:01.809019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 788/1573] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:01 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:01.811228 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173508c-2351-45da-ab88-835259433c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:01.812071 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173508c-2351-45da-ab88-835259433c06 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.813088 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173508c-2351-45da-ab88-835259433c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.813175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173508c-2351-45da-ab88-835259433c06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.813387 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55623359-de92-4c25-896e-a6a562468f85 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:01.816106 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173508c-2351-45da-ab88-835259433c06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:04:01.816438 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173508c-2351-45da-ab88-835259433c06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:01.818362 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173508c-2351-45da-ab88-835259433c06 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:01.832955 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 786/1574] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:04:01.833750 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173508c-2351-45da-ab88-835259433c06 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:01.844347 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173508c-2351-45da-ab88-835259433c06 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:01.875683 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:01.890434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55623359-de92-4c25-896e-a6a562468f85 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:01.901933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddbd35-80ec-43b7-ab48-87322ef8f10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:01.902836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddbd35-80ec-43b7-ab48-87322ef8f10f admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.903135 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddbd35-80ec-43b7-ab48-87322ef8f10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.903486 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddbd35-80ec-43b7-ab48-87322ef8f10f admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.904621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddbd35-80ec-43b7-ab48-87322ef8f10f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:01.906951 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddbd35-80ec-43b7-ab48-87322ef8f10f admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:01.916842 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bf722-34c0-4bd8-9c3f-feab187b5c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:01.917902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bf722-34c0-4bd8-9c3f-feab187b5c67 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:01.918025 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bf722-34c0-4bd8-9c3f-feab187b5c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:01.918336 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bf722-34c0-4bd8-9c3f-feab187b5c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:01.919286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231bf722-34c0-4bd8-9c3f-feab187b5c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:01.921072 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231bf722-34c0-4bd8-9c3f-feab187b5c67 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:01.939434 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 787/1575] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:01.940789 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bf722-34c0-4bd8-9c3f-feab187b5c67 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:01.958762 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bf722-34c0-4bd8-9c3f-feab187b5c67 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:01.958932 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 789/1576] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:01 2022] POST /identity/v3/projects => generated 389 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:01.963149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddbd35-80ec-43b7-ab48-87322ef8f10f admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:02.030416 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53639694-1d34-4c69-97ed-317dfb014ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:02.031246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53639694-1d34-4c69-97ed-317dfb014ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:02.032301 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53639694-1d34-4c69-97ed-317dfb014ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:02.032670 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53639694-1d34-4c69-97ed-317dfb014ad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:02.033456 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53639694-1d34-4c69-97ed-317dfb014ad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:02.036145 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53639694-1d34-4c69-97ed-317dfb014ad9 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:02.038380 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddbd35-80ec-43b7-ab48-87322ef8f10f admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:02.045442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496083c-cf8e-4a8c-8656-3cdca4383c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:02.046130 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496083c-cf8e-4a8c-8656-3cdca4383c0c admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:02.046416 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496083c-cf8e-4a8c-8656-3cdca4383c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:02.047065 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496083c-cf8e-4a8c-8656-3cdca4383c0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:02.047563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496083c-cf8e-4a8c-8656-3cdca4383c0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:02.050104 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496083c-cf8e-4a8c-8656-3cdca4383c0c admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:02.052352 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:02.075532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 788/1577] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:01 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:02.076444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53639694-1d34-4c69-97ed-317dfb014ad9 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:02.080361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 790/1578] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:01 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:02.081568 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496083c-cf8e-4a8c-8656-3cdca4383c0c admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:02.155614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53639694-1d34-4c69-97ed-317dfb014ad9 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:02.160372 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d8b4d-2a37-415a-8298-f3787e4ee043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:02.161126 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d8b4d-2a37-415a-8298-f3787e4ee043 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:02.161464 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d8b4d-2a37-415a-8298-f3787e4ee043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:02.161655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496083c-cf8e-4a8c-8656-3cdca4383c0c admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:02.161762 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d8b4d-2a37-415a-8298-f3787e4ee043 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:02.162432 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d8b4d-2a37-415a-8298-f3787e4ee043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:02.164459 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d8b4d-2a37-415a-8298-f3787e4ee043 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:02.167175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2051f8c-deb9-40a9-9771-e67623dbf753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:02.168327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2051f8c-deb9-40a9-9771-e67623dbf753 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:02.168617 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2051f8c-deb9-40a9-9771-e67623dbf753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:02.168889 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2051f8c-deb9-40a9-9771-e67623dbf753 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:02.169629 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2051f8c-deb9-40a9-9771-e67623dbf753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:02.171651 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2051f8c-deb9-40a9-9771-e67623dbf753 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:02.194417 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 789/1579] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:02 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:02.195605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d8b4d-2a37-415a-8298-f3787e4ee043 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:02.197409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 791/1580] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:02 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:02.198888 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2051f8c-deb9-40a9-9771-e67623dbf753 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:02.213785 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2051f8c-deb9-40a9-9771-e67623dbf753 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:02.276609 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:02.278567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d8b4d-2a37-415a-8298-f3787e4ee043 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:02.286576 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13e9e8-b622-4a3c-a6c2-4cfe2f8a4398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:02.287187 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5211c5c-8a51-4e69-9a0c-f6b0b12d38aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:02.287399 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13e9e8-b622-4a3c-a6c2-4cfe2f8a4398 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:02.287704 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13e9e8-b622-4a3c-a6c2-4cfe2f8a4398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:02.287976 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13e9e8-b622-4a3c-a6c2-4cfe2f8a4398 admin admin] PATH_INFO: `/v3/projects/bebe60c7451b4b57a3eb6a0dd6430573/users/af5a68ce4f6747bb9895508286de2a74/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:02.288654 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5211c5c-8a51-4e69-9a0c-f6b0b12d38aa admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:02.289288 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5211c5c-8a51-4e69-9a0c-f6b0b12d38aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:02.289819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5211c5c-8a51-4e69-9a0c-f6b0b12d38aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:02.290734 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5211c5c-8a51-4e69-9a0c-f6b0b12d38aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:02.292839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5211c5c-8a51-4e69-9a0c-f6b0b12d38aa admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:02.317620 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13e9e8-b622-4a3c-a6c2-4cfe2f8a4398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bebe60c7451b4b57a3eb6a0dd6430573, user_id=af5a68ce4f6747bb9895508286de2a74, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:02.318764 dv-cinder-815582-9-smb devstack@keystone.service[80430]: WARNING py.warnings [None req-fe13e9e8-b622-4a3c-a6c2-4cfe2f8a4398 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 02:04:02.318764 dv-cinder-815582-9-smb devstack@keystone.service[80430]: warnings.warn(msg) Jun 23 02:04:02.318764 dv-cinder-815582-9-smb devstack@keystone.service[80430]: Jun 23 02:04:02.321403 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13e9e8-b622-4a3c-a6c2-4cfe2f8a4398 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:02.330002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 790/1581] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:02 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:02.333500 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5211c5c-8a51-4e69-9a0c-f6b0b12d38aa admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:02.343565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 792/1582] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:02 2022] PUT /identity/v3/projects/bebe60c7451b4b57a3eb6a0dd6430573/users/af5a68ce4f6747bb9895508286de2a74/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:02.343565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13e9e8-b622-4a3c-a6c2-4cfe2f8a4398 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:02.422236 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5211c5c-8a51-4e69-9a0c-f6b0b12d38aa admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:02.427867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac1620-f686-444f-b701-1a75b6d3bf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:02.428745 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac1620-f686-444f-b701-1a75b6d3bf49 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:02.429064 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac1620-f686-444f-b701-1a75b6d3bf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:02.429373 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac1620-f686-444f-b701-1a75b6d3bf49 admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:02.430819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac1620-f686-444f-b701-1a75b6d3bf49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:02.432884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac1620-f686-444f-b701-1a75b6d3bf49 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:02.434429 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13e9e8-b622-4a3c-a6c2-4cfe2f8a4398 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:02.439488 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5615b-c20b-47c5-93a0-ec1906adf85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:02.440986 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5615b-c20b-47c5-93a0-ec1906adf85a admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:02.441469 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:02.442325 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5615b-c20b-47c5-93a0-ec1906adf85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:02.442822 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5615b-c20b-47c5-93a0-ec1906adf85a admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:02.444187 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5615b-c20b-47c5-93a0-ec1906adf85a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:02.453187 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5615b-c20b-47c5-93a0-ec1906adf85a admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:02.469693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 791/1583] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:02 2022] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:02.470997 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac1620-f686-444f-b701-1a75b6d3bf49 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:02.484828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac1620-f686-444f-b701-1a75b6d3bf49 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:02.489809 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 793/1584] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:02 2022] POST /identity/v3/users => generated 284 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:02.490230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65de253-3b56-45c2-b903-8b20cd02e932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:02.490885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5615b-c20b-47c5-93a0-ec1906adf85a admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:02.491257 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65de253-3b56-45c2-b903-8b20cd02e932 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:02.491668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65de253-3b56-45c2-b903-8b20cd02e932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:02.492066 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65de253-3b56-45c2-b903-8b20cd02e932 admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:02.494354 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65de253-3b56-45c2-b903-8b20cd02e932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:02.496510 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65de253-3b56-45c2-b903-8b20cd02e932 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:02.502922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5615b-c20b-47c5-93a0-ec1906adf85a admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:02.508733 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38178f-1c52-4927-a01a-dbace46fcc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:02.509557 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38178f-1c52-4927-a01a-dbace46fcc08 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:02.509842 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38178f-1c52-4927-a01a-dbace46fcc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:02.510116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38178f-1c52-4927-a01a-dbace46fcc08 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:02.510833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38178f-1c52-4927-a01a-dbace46fcc08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:02.513006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38178f-1c52-4927-a01a-dbace46fcc08 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:02.525267 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 792/1585] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:02 2022] POST /identity/v3/users => generated 293 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:02.526354 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65de253-3b56-45c2-b903-8b20cd02e932 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:02.541165 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 794/1586] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:02 2022] POST /identity/v3/users => generated 287 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:02.542398 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38178f-1c52-4927-a01a-dbace46fcc08 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:02.555348 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38178f-1c52-4927-a01a-dbace46fcc08 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:02.557794 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65de253-3b56-45c2-b903-8b20cd02e932 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:02.561261 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490d8e4-a10d-48d6-986a-2d3aade4b821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:02.562299 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490d8e4-a10d-48d6-986a-2d3aade4b821 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:02.562671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490d8e4-a10d-48d6-986a-2d3aade4b821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:02.563025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490d8e4-a10d-48d6-986a-2d3aade4b821 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:02.563799 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490d8e4-a10d-48d6-986a-2d3aade4b821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:02.565874 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490d8e4-a10d-48d6-986a-2d3aade4b821 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:02.571778 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b985a4-aedb-44ba-baa1-ae850200cfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:02.572510 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b985a4-aedb-44ba-baa1-ae850200cfad admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:02.572806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b985a4-aedb-44ba-baa1-ae850200cfad admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:02.573095 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b985a4-aedb-44ba-baa1-ae850200cfad admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:02.573922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b985a4-aedb-44ba-baa1-ae850200cfad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:02.576310 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b985a4-aedb-44ba-baa1-ae850200cfad admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:02.594861 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 795/1587] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:02 2022] POST /identity/v3/users => generated 289 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:02.595453 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 793/1588] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:02.595545 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66b38e-a01d-4dfb-a647-7d9d09c714c3 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:02.595545 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66b38e-a01d-4dfb-a647-7d9d09c714c3 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:02.595728 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b985a4-aedb-44ba-baa1-ae850200cfad admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:02.595832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66b38e-a01d-4dfb-a647-7d9d09c714c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:02.605309 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b985a4-aedb-44ba-baa1-ae850200cfad admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:02.610990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ffbb0-3e38-45e8-ba5a-fbbb3d29a95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:02.612413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ffbb0-3e38-45e8-ba5a-fbbb3d29a95a admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:02.612413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ffbb0-3e38-45e8-ba5a-fbbb3d29a95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:02.612413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ffbb0-3e38-45e8-ba5a-fbbb3d29a95a admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:02.613022 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ffbb0-3e38-45e8-ba5a-fbbb3d29a95a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:02.615126 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ffbb0-3e38-45e8-ba5a-fbbb3d29a95a admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:02.627863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-3f66b38e-a01d-4dfb-a647-7d9d09c714c3 None None] MFA Rules not processed for user `af5a68ce4f6747bb9895508286de2a74`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:02.629117 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-3f66b38e-a01d-4dfb-a647-7d9d09c714c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:02.629588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 794/1589] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:02.630598 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ffbb0-3e38-45e8-ba5a-fbbb3d29a95a admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:02.648066 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ffbb0-3e38-45e8-ba5a-fbbb3d29a95a admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:02.666569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b379d9-781d-41e9-b523-c61c07006492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:02.668283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b379d9-781d-41e9-b523-c61c07006492 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:02.668794 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b379d9-781d-41e9-b523-c61c07006492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:02.670089 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b379d9-781d-41e9-b523-c61c07006492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:02.672223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b379d9-781d-41e9-b523-c61c07006492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:02.675900 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b379d9-781d-41e9-b523-c61c07006492 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:02.695024 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 795/1590] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:02.695024 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b379d9-781d-41e9-b523-c61c07006492 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:02.711297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b379d9-781d-41e9-b523-c61c07006492 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:02.718724 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563564a-d12f-4f67-88e3-e8f44b4c0ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:02.720049 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563564a-d12f-4f67-88e3-e8f44b4c0ffc admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:02.720452 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563564a-d12f-4f67-88e3-e8f44b4c0ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:02.720744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563564a-d12f-4f67-88e3-e8f44b4c0ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:02.722119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563564a-d12f-4f67-88e3-e8f44b4c0ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:02.724117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563564a-d12f-4f67-88e3-e8f44b4c0ffc admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:02.730584 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 796/1591] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:02.731659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66b38e-a01d-4dfb-a647-7d9d09c714c3 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:02.739500 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 796/1592] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:02.739500 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563564a-d12f-4f67-88e3-e8f44b4c0ffc admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:02.750134 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66b38e-a01d-4dfb-a647-7d9d09c714c3 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:02.752198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563564a-d12f-4f67-88e3-e8f44b4c0ffc admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:02.758488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07bce5-2058-4a6f-b75b-c3343755ae82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:02.758658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8189ffd-9f3b-4c9a-bdac-a53e87ae4345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:02.759222 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8189ffd-9f3b-4c9a-bdac-a53e87ae4345 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:02.759547 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8189ffd-9f3b-4c9a-bdac-a53e87ae4345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:02.759823 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8189ffd-9f3b-4c9a-bdac-a53e87ae4345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:02.760074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07bce5-2058-4a6f-b75b-c3343755ae82 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:02.760492 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07bce5-2058-4a6f-b75b-c3343755ae82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:02.760638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8189ffd-9f3b-4c9a-bdac-a53e87ae4345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:02.761208 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07bce5-2058-4a6f-b75b-c3343755ae82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:02.762101 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07bce5-2058-4a6f-b75b-c3343755ae82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:02.762815 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8189ffd-9f3b-4c9a-bdac-a53e87ae4345 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:02.764152 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07bce5-2058-4a6f-b75b-c3343755ae82 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:02.779233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 797/1593] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:02.779233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8189ffd-9f3b-4c9a-bdac-a53e87ae4345 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:02.780044 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 797/1594] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:02.781331 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07bce5-2058-4a6f-b75b-c3343755ae82 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:02.787753 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8189ffd-9f3b-4c9a-bdac-a53e87ae4345 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:02.794632 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84627ae-4ec6-4d6f-b1ea-ee66e5a02e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:02.795075 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07bce5-2058-4a6f-b75b-c3343755ae82 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:02.795513 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84627ae-4ec6-4d6f-b1ea-ee66e5a02e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:02.795840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84627ae-4ec6-4d6f-b1ea-ee66e5a02e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:02.796119 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84627ae-4ec6-4d6f-b1ea-ee66e5a02e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:02.796870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84627ae-4ec6-4d6f-b1ea-ee66e5a02e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:02.798615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84627ae-4ec6-4d6f-b1ea-ee66e5a02e0d admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:02.801570 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:02.801938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524eb56c-52d2-48bc-863b-97b2bd6cc73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:02.802825 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524eb56c-52d2-48bc-863b-97b2bd6cc73d admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:02.803310 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524eb56c-52d2-48bc-863b-97b2bd6cc73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:02.803930 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524eb56c-52d2-48bc-863b-97b2bd6cc73d admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:02.804967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524eb56c-52d2-48bc-863b-97b2bd6cc73d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:02.806859 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524eb56c-52d2-48bc-863b-97b2bd6cc73d admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:02.822727 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 798/1595] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:02.822727 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84627ae-4ec6-4d6f-b1ea-ee66e5a02e0d admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:02.823050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 798/1596] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:02.823050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524eb56c-52d2-48bc-863b-97b2bd6cc73d admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:02.838743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524eb56c-52d2-48bc-863b-97b2bd6cc73d admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:02.843844 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84627ae-4ec6-4d6f-b1ea-ee66e5a02e0d admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:02.844521 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23404ff2-2dcd-456a-995d-70af5b336b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:02.845251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23404ff2-2dcd-456a-995d-70af5b336b93 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:02.845536 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23404ff2-2dcd-456a-995d-70af5b336b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:02.845817 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23404ff2-2dcd-456a-995d-70af5b336b93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:02.846564 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23404ff2-2dcd-456a-995d-70af5b336b93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:02.848771 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23404ff2-2dcd-456a-995d-70af5b336b93 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:02.853287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960d9a2-184f-4037-9c2e-5aea445d63c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:02.854623 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960d9a2-184f-4037-9c2e-5aea445d63c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:02.854913 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960d9a2-184f-4037-9c2e-5aea445d63c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:02.855187 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960d9a2-184f-4037-9c2e-5aea445d63c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:02.856103 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960d9a2-184f-4037-9c2e-5aea445d63c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:02.858301 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960d9a2-184f-4037-9c2e-5aea445d63c7 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:02.875077 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 799/1597] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:02.876473 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960d9a2-184f-4037-9c2e-5aea445d63c7 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:02.892615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 799/1598] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:02 2022] POST /identity/v3/projects => generated 405 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:02.893436 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23404ff2-2dcd-456a-995d-70af5b336b93 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:02.893758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960d9a2-184f-4037-9c2e-5aea445d63c7 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:02.977555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23404ff2-2dcd-456a-995d-70af5b336b93 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:02.984369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec681f8b-de6b-4498-9c7b-8660a78773d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:02.985617 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec681f8b-de6b-4498-9c7b-8660a78773d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:02.985922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec681f8b-de6b-4498-9c7b-8660a78773d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:02.986268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec681f8b-de6b-4498-9c7b-8660a78773d9 admin admin] PATH_INFO: `/v3/projects/5abd2e32df72475caa91467e2f131d50/users/976a75d631554ef2974c6ee763015635/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:03.014455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49de03a-d31d-4226-bd71-2b25d1372809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:03.016218 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49de03a-d31d-4226-bd71-2b25d1372809 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:03.016749 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49de03a-d31d-4226-bd71-2b25d1372809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:03.017167 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49de03a-d31d-4226-bd71-2b25d1372809 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:03.018028 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49de03a-d31d-4226-bd71-2b25d1372809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:03.018605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec681f8b-de6b-4498-9c7b-8660a78773d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5abd2e32df72475caa91467e2f131d50, user_id=976a75d631554ef2974c6ee763015635, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:03.019742 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49de03a-d31d-4226-bd71-2b25d1372809 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:03.021800 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec681f8b-de6b-4498-9c7b-8660a78773d9 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:03.035876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 800/1599] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:03.035876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49de03a-d31d-4226-bd71-2b25d1372809 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:03.050968 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 800/1600] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:02 2022] PUT /identity/v3/projects/5abd2e32df72475caa91467e2f131d50/users/976a75d631554ef2974c6ee763015635/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:03.051764 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec681f8b-de6b-4498-9c7b-8660a78773d9 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:03.058324 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49de03a-d31d-4226-bd71-2b25d1372809 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:03.092887 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:03.137478 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec681f8b-de6b-4498-9c7b-8660a78773d9 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:03.144169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e10b9a-0c97-4124-b322-e1ebdc76d741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:03.144937 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e10b9a-0c97-4124-b322-e1ebdc76d741 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:03.145457 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e10b9a-0c97-4124-b322-e1ebdc76d741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:03.145820 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e10b9a-0c97-4124-b322-e1ebdc76d741 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:03.146871 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e10b9a-0c97-4124-b322-e1ebdc76d741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:03.149646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e10b9a-0c97-4124-b322-e1ebdc76d741 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:03.156537 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba61407-6398-44a9-a8ce-f1ffc0db91f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:03.157636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba61407-6398-44a9-a8ce-f1ffc0db91f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:03.158057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba61407-6398-44a9-a8ce-f1ffc0db91f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:03.158576 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba61407-6398-44a9-a8ce-f1ffc0db91f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:03.159372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba61407-6398-44a9-a8ce-f1ffc0db91f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:03.161871 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba61407-6398-44a9-a8ce-f1ffc0db91f5 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:03.163312 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 801/1601] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:03.164808 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e10b9a-0c97-4124-b322-e1ebdc76d741 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:03.176993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e10b9a-0c97-4124-b322-e1ebdc76d741 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:03.177446 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 801/1602] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:03.178408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba61407-6398-44a9-a8ce-f1ffc0db91f5 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:03.185515 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbba97-8bd4-487e-b3c5-fdff510fd8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:03.186250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbba97-8bd4-487e-b3c5-fdff510fd8d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:03.186703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbba97-8bd4-487e-b3c5-fdff510fd8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:03.186989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbba97-8bd4-487e-b3c5-fdff510fd8d2 admin admin] PATH_INFO: `/v3/projects/259b7f5f62fa47ee90a4fce1bd6459c6/users/ee036a5188e8459989184fa216cc79e9/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:03.191998 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba61407-6398-44a9-a8ce-f1ffc0db91f5 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:03.198552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be74d24-3daa-4fab-a480-1eddcd217717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:03.199749 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be74d24-3daa-4fab-a480-1eddcd217717 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:03.200111 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be74d24-3daa-4fab-a480-1eddcd217717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:03.200463 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be74d24-3daa-4fab-a480-1eddcd217717 admin admin] PATH_INFO: `/v3/projects/ce61a689ef65408eb11a04131f1f25e8/users/e187fb3327204bf8b38246678a3d7a5d/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:03.209380 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbba97-8bd4-487e-b3c5-fdff510fd8d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=259b7f5f62fa47ee90a4fce1bd6459c6, user_id=ee036a5188e8459989184fa216cc79e9, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:03.213766 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbba97-8bd4-487e-b3c5-fdff510fd8d2 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:03.220388 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be74d24-3daa-4fab-a480-1eddcd217717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce61a689ef65408eb11a04131f1f25e8, user_id=e187fb3327204bf8b38246678a3d7a5d, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:03.224821 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be74d24-3daa-4fab-a480-1eddcd217717 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:03.242202 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 802/1603] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:03 2022] PUT /identity/v3/projects/259b7f5f62fa47ee90a4fce1bd6459c6/users/ee036a5188e8459989184fa216cc79e9/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:03.243617 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbba97-8bd4-487e-b3c5-fdff510fd8d2 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:03.266832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 802/1604] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:03 2022] PUT /identity/v3/projects/ce61a689ef65408eb11a04131f1f25e8/users/e187fb3327204bf8b38246678a3d7a5d/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:03.266832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be74d24-3daa-4fab-a480-1eddcd217717 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:03.331746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbba97-8bd4-487e-b3c5-fdff510fd8d2 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:03.333542 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:03.338937 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0b823-b4ee-44f4-9217-3775057251f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:03.339818 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0b823-b4ee-44f4-9217-3775057251f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:03.340204 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0b823-b4ee-44f4-9217-3775057251f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:03.340581 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0b823-b4ee-44f4-9217-3775057251f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:03.340848 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be74d24-3daa-4fab-a480-1eddcd217717 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:03.341865 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0b823-b4ee-44f4-9217-3775057251f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:03.345274 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0b823-b4ee-44f4-9217-3775057251f6 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:03.349402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdb20b-1d7c-45dc-a0b0-37da71407d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:03.351272 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdb20b-1d7c-45dc-a0b0-37da71407d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:03.353760 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdb20b-1d7c-45dc-a0b0-37da71407d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:03.353760 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdb20b-1d7c-45dc-a0b0-37da71407d66 admin admin] PATH_INFO: `/v3/projects/0566f537289246a4811c9dd0c28d1da3/users/c7b20f943bc44bd0987439414a85b7ee/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:03.375718 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 803/1605] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:03 2022] POST /identity/v3/users => generated 309 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:03.376003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bdb20b-1d7c-45dc-a0b0-37da71407d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0566f537289246a4811c9dd0c28d1da3, user_id=c7b20f943bc44bd0987439414a85b7ee, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:03.377137 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cea08-428a-4543-b54d-bae2e9ae770e None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:03.377431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cea08-428a-4543-b54d-bae2e9ae770e None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:03.377709 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cea08-428a-4543-b54d-bae2e9ae770e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:03.378980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bdb20b-1d7c-45dc-a0b0-37da71407d66 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:03.399524 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 803/1606] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:03 2022] PUT /identity/v3/projects/0566f537289246a4811c9dd0c28d1da3/users/c7b20f943bc44bd0987439414a85b7ee/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:03.400495 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdb20b-1d7c-45dc-a0b0-37da71407d66 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:03.401902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-629cea08-428a-4543-b54d-bae2e9ae770e None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:03.404647 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-629cea08-428a-4543-b54d-bae2e9ae770e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:03.483274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdb20b-1d7c-45dc-a0b0-37da71407d66 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:03.488585 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9be276-9e8d-41ac-850e-7b47afe02abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:03.489809 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9be276-9e8d-41ac-850e-7b47afe02abe admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:03.490193 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9be276-9e8d-41ac-850e-7b47afe02abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:03.490653 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9be276-9e8d-41ac-850e-7b47afe02abe admin admin] PATH_INFO: `/v3/projects/1768c8ce529f4c8abe6158f67088ba35/users/042853e4abce41f9a3e8263d1fc8ac00/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:03.494619 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 804/1607] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:03.495189 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cea08-428a-4543-b54d-bae2e9ae770e None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:03.511665 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cea08-428a-4543-b54d-bae2e9ae770e None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:03.516652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9be276-9e8d-41ac-850e-7b47afe02abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1768c8ce529f4c8abe6158f67088ba35, user_id=042853e4abce41f9a3e8263d1fc8ac00, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:03.520927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9be276-9e8d-41ac-850e-7b47afe02abe admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:03.592564 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc7a57-7cda-4848-a45d-7924352f34f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:03.592564 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc7a57-7cda-4848-a45d-7924352f34f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:03.592564 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc7a57-7cda-4848-a45d-7924352f34f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:03.592564 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc7a57-7cda-4848-a45d-7924352f34f7 admin admin] PATH_INFO: `/v3/projects/f054582b90c0473891c6cf766e8cd532/users/7f8dbfbf2f60449281439ee187f35dca/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:03.612001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 804/1608] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:03 2022] PUT /identity/v3/projects/1768c8ce529f4c8abe6158f67088ba35/users/042853e4abce41f9a3e8263d1fc8ac00/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:03.612001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b53ff-6136-42eb-937a-fd5c0ce86cc4 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:03.612001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b53ff-6136-42eb-937a-fd5c0ce86cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:03.612001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b53ff-6136-42eb-937a-fd5c0ce86cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:03.612966 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc7a57-7cda-4848-a45d-7924352f34f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f054582b90c0473891c6cf766e8cd532, user_id=7f8dbfbf2f60449281439ee187f35dca, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:03.612966 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc7a57-7cda-4848-a45d-7924352f34f7 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:03.613257 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-e27b53ff-6136-42eb-937a-fd5c0ce86cc4 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:03.613257 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-e27b53ff-6136-42eb-937a-fd5c0ce86cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:03.613415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 805/1609] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:03 2022] PUT /identity/v3/projects/f054582b90c0473891c6cf766e8cd532/users/7f8dbfbf2f60449281439ee187f35dca/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:03.613415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ac631-9096-4036-aeed-5601487cc804 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:03.613415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ac631-9096-4036-aeed-5601487cc804 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:03.613415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ac631-9096-4036-aeed-5601487cc804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:03.634581 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:03.669693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-692ac631-9096-4036-aeed-5601487cc804 None None] MFA Rules not processed for user `e187fb3327204bf8b38246678a3d7a5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:03.671957 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-692ac631-9096-4036-aeed-5601487cc804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:03.698103 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 805/1610] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:03.698678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b53ff-6136-42eb-937a-fd5c0ce86cc4 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:03.722751 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b53ff-6136-42eb-937a-fd5c0ce86cc4 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:03.730484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af21c87-7038-46b8-92a3-70ff1dd396c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:03.731465 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af21c87-7038-46b8-92a3-70ff1dd396c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:03.731903 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af21c87-7038-46b8-92a3-70ff1dd396c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:03.732304 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af21c87-7038-46b8-92a3-70ff1dd396c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:03.733759 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af21c87-7038-46b8-92a3-70ff1dd396c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:03.735575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af21c87-7038-46b8-92a3-70ff1dd396c4 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:03.750660 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 806/1611] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:03.752437 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f84755-f892-4e6a-9015-e27ed2f49a8f None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:03.752937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f84755-f892-4e6a-9015-e27ed2f49a8f None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:03.753467 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f84755-f892-4e6a-9015-e27ed2f49a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:03.772956 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 806/1612] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:03.772956 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ac631-9096-4036-aeed-5601487cc804 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:03.772956 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-692ac631-9096-4036-aeed-5601487cc804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:03.786146 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-b3f84755-f892-4e6a-9015-e27ed2f49a8f None None] MFA Rules not processed for user `c7b20f943bc44bd0987439414a85b7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:03.787536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-b3f84755-f892-4e6a-9015-e27ed2f49a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:03.834095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:03.841195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ac631-9096-4036-aeed-5601487cc804 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:03.846995 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a5e46-f4a8-4a51-bb30-58b0f2937eba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:03.847639 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a5e46-f4a8-4a51-bb30-58b0f2937eba service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:03.848083 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a5e46-f4a8-4a51-bb30-58b0f2937eba service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:03.848504 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a5e46-f4a8-4a51-bb30-58b0f2937eba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:03.864403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a5e46-f4a8-4a51-bb30-58b0f2937eba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:03.866131 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a5e46-f4a8-4a51-bb30-58b0f2937eba service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:03.879972 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 807/1613] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:03.881250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098e8ff-54b7-411d-8f78-6b7729c15923 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:03.881630 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098e8ff-54b7-411d-8f78-6b7729c15923 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:03.882416 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098e8ff-54b7-411d-8f78-6b7729c15923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:03.889542 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 807/1614] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:03.893075 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9708d-440e-4453-888d-9386becdd22d None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:03.893575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9708d-440e-4453-888d-9386becdd22d None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:03.894114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9708d-440e-4453-888d-9386becdd22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:03.904039 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-0098e8ff-54b7-411d-8f78-6b7729c15923 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:03.905361 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-0098e8ff-54b7-411d-8f78-6b7729c15923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:03.932123 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 808/1615] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:03.933669 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098e8ff-54b7-411d-8f78-6b7729c15923 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:03.952919 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098e8ff-54b7-411d-8f78-6b7729c15923 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:03.959672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ac143-ed61-4aba-a858-e0e5a1a8b26e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:03.960521 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-a0d9708d-440e-4453-888d-9386becdd22d None None] MFA Rules not processed for user `7f8dbfbf2f60449281439ee187f35dca`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:03.960691 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ac143-ed61-4aba-a858-e0e5a1a8b26e service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:03.961132 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ac143-ed61-4aba-a858-e0e5a1a8b26e service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:03.961501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ac143-ed61-4aba-a858-e0e5a1a8b26e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:03.962468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-a0d9708d-440e-4453-888d-9386becdd22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:03.972086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ac143-ed61-4aba-a858-e0e5a1a8b26e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:03.973862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ac143-ed61-4aba-a858-e0e5a1a8b26e service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:03.985715 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 809/1616] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:03.986227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ac143-ed61-4aba-a858-e0e5a1a8b26e service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:03.999088 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ac143-ed61-4aba-a858-e0e5a1a8b26e service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:04.004720 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911dc4b-3441-417d-9664-065a619bf3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:04.005514 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911dc4b-3441-417d-9664-065a619bf3a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:04.005964 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911dc4b-3441-417d-9664-065a619bf3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:04.006246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911dc4b-3441-417d-9664-065a619bf3a4 admin admin] PATH_INFO: `/v3/projects/6a55c2a84c634c20b3c91faae45244cd/users/5edf399fadc34d369530947a56b87a5c/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:04.026000 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911dc4b-3441-417d-9664-065a619bf3a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a55c2a84c634c20b3c91faae45244cd, user_id=5edf399fadc34d369530947a56b87a5c, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:04.029068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911dc4b-3441-417d-9664-065a619bf3a4 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:04.056276 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 810/1617] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:03 2022] PUT /identity/v3/projects/6a55c2a84c634c20b3c91faae45244cd/users/5edf399fadc34d369530947a56b87a5c/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:04.057594 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911dc4b-3441-417d-9664-065a619bf3a4 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:04.081146 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 808/1618] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:04.082113 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9708d-440e-4453-888d-9386becdd22d None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:04.100406 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9708d-440e-4453-888d-9386becdd22d None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:04.147069 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911dc4b-3441-417d-9664-065a619bf3a4 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:04.151402 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e21f9-a36f-4c28-86b8-fae73f6f8cf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:04.152413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e21f9-a36f-4c28-86b8-fae73f6f8cf1 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:04.152667 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e21f9-a36f-4c28-86b8-fae73f6f8cf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:04.153137 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e21f9-a36f-4c28-86b8-fae73f6f8cf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:04.171158 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:04.246028 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31e48c-dc0f-4a10-9429-87f640a04fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:04.248230 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31e48c-dc0f-4a10-9429-87f640a04fbd admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:04.251128 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31e48c-dc0f-4a10-9429-87f640a04fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:04.252639 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31e48c-dc0f-4a10-9429-87f640a04fbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:04.254261 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e21f9-a36f-4c28-86b8-fae73f6f8cf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:04.256726 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e21f9-a36f-4c28-86b8-fae73f6f8cf1 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:04.269904 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31e48c-dc0f-4a10-9429-87f640a04fbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:04.272711 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 811/1619] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:04.273997 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e21f9-a36f-4c28-86b8-fae73f6f8cf1 service cinder] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:04.280784 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31e48c-dc0f-4a10-9429-87f640a04fbd admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:04.342988 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 809/1620] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:04 2022] POST /identity/v3/projects => generated 385 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:04.344538 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31e48c-dc0f-4a10-9429-87f640a04fbd admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:04.376409 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e21f9-a36f-4c28-86b8-fae73f6f8cf1 service cinder] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:04.462705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48bb8f-6c94-4d8a-a8c9-4a7000d88565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:04.463481 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48bb8f-6c94-4d8a-a8c9-4a7000d88565 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:04.463867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48bb8f-6c94-4d8a-a8c9-4a7000d88565 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:04.464040 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48bb8f-6c94-4d8a-a8c9-4a7000d88565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:04.503285 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:04.511359 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31e48c-dc0f-4a10-9429-87f640a04fbd admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:04.531319 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea376814-a406-40c8-9e29-a08d57077eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:04.534043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea376814-a406-40c8-9e29-a08d57077eba admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:04.534043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea376814-a406-40c8-9e29-a08d57077eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:04.534043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea376814-a406-40c8-9e29-a08d57077eba admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:04.534043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea376814-a406-40c8-9e29-a08d57077eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:04.535860 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea376814-a406-40c8-9e29-a08d57077eba admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:04.567921 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 810/1621] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:04.569808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c0e88-619b-4782-b289-adf733444c84 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:04.570302 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c0e88-619b-4782-b289-adf733444c84 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:04.570741 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c0e88-619b-4782-b289-adf733444c84 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:04.572736 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 811/1622] 10.222.0.13 () {54 vars in 961 bytes} [Thu Jun 23 02:04:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 02:04:04.573682 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c0e88-619b-4782-b289-adf733444c84 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:04.589026 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c0e88-619b-4782-b289-adf733444c84 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:04.628645 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a1c6f-8eb1-4614-9908-912f755d3923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:04.629398 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a1c6f-8eb1-4614-9908-912f755d3923 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:04.629678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a1c6f-8eb1-4614-9908-912f755d3923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:04.629956 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a1c6f-8eb1-4614-9908-912f755d3923 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:04.634091 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a1c6f-8eb1-4614-9908-912f755d3923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:04.636357 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a1c6f-8eb1-4614-9908-912f755d3923 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:04.672506 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48bb8f-6c94-4d8a-a8c9-4a7000d88565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:04.678163 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48bb8f-6c94-4d8a-a8c9-4a7000d88565 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:04.705306 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 812/1623] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:04.705880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48bb8f-6c94-4d8a-a8c9-4a7000d88565 service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:04.713007 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 812/1624] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:04 2022] POST /identity/v3/users => generated 299 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:04.713007 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5cd3d-7ef0-4870-9e02-f5e44b4b8591 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:04.713007 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5cd3d-7ef0-4870-9e02-f5e44b4b8591 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:04.713007 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5cd3d-7ef0-4870-9e02-f5e44b4b8591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:04.730749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48bb8f-6c94-4d8a-a8c9-4a7000d88565 service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:04.746047 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca3b72-4ce0-48ee-b5af-b68e7b6e27a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:04.746964 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca3b72-4ce0-48ee-b5af-b68e7b6e27a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:04.747241 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca3b72-4ce0-48ee-b5af-b68e7b6e27a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:04.747541 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca3b72-4ce0-48ee-b5af-b68e7b6e27a2 admin admin] PATH_INFO: `/v3/projects/6a55c2a84c634c20b3c91faae45244cd/users/5edf399fadc34d369530947a56b87a5c/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:04.754687 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca3b72-4ce0-48ee-b5af-b68e7b6e27a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a55c2a84c634c20b3c91faae45244cd, user_id=5edf399fadc34d369530947a56b87a5c, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:04.755355 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-66f5cd3d-7ef0-4870-9e02-f5e44b4b8591 None None] MFA Rules not processed for user `9d3b5180fb7144c394c39d4db28713b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:04.758196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-66f5cd3d-7ef0-4870-9e02-f5e44b4b8591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:04.766522 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca3b72-4ce0-48ee-b5af-b68e7b6e27a2 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:04.802103 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 813/1625] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:04 2022] PUT /identity/v3/projects/6a55c2a84c634c20b3c91faae45244cd/users/5edf399fadc34d369530947a56b87a5c/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:04.813217 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca3b72-4ce0-48ee-b5af-b68e7b6e27a2 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:04.833062 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:04.983426 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 813/1626] 10.222.0.13 () {58 vars in 1058 bytes} [Thu Jun 23 02:04:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:04.996643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33267d63-5aec-40b3-8792-42fa18370bfc None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:04.996961 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33267d63-5aec-40b3-8792-42fa18370bfc None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:04.997444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33267d63-5aec-40b3-8792-42fa18370bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:05.041196 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca3b72-4ce0-48ee-b5af-b68e7b6e27a2 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:05.062029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c63c4-271d-4517-85c5-8bbdec436018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:05.062751 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c63c4-271d-4517-85c5-8bbdec436018 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:05.063107 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c63c4-271d-4517-85c5-8bbdec436018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:05.063463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c63c4-271d-4517-85c5-8bbdec436018 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:05.064273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c63c4-271d-4517-85c5-8bbdec436018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:05.066796 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c63c4-271d-4517-85c5-8bbdec436018 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:05.068577 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-33267d63-5aec-40b3-8792-42fa18370bfc None None] MFA Rules not processed for user `5edf399fadc34d369530947a56b87a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:05.073864 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-33267d63-5aec-40b3-8792-42fa18370bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:05.106669 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 814/1627] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:05.109863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c63c4-271d-4517-85c5-8bbdec436018 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:05.233605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c63c4-271d-4517-85c5-8bbdec436018 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:05.240767 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07598a7c-5d9b-4181-9afe-e1b765ef3b9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:05.241551 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07598a7c-5d9b-4181-9afe-e1b765ef3b9c service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:05.241950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07598a7c-5d9b-4181-9afe-e1b765ef3b9c service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:05.242232 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07598a7c-5d9b-4181-9afe-e1b765ef3b9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:05.299972 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 814/1628] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:04 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:05.303897 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33267d63-5aec-40b3-8792-42fa18370bfc None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:05.352462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33267d63-5aec-40b3-8792-42fa18370bfc None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:05.381926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c67558-cd19-47af-adc2-e0d17c2c387b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:05.382948 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c67558-cd19-47af-adc2-e0d17c2c387b admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:05.383228 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c67558-cd19-47af-adc2-e0d17c2c387b admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:05.383533 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c67558-cd19-47af-adc2-e0d17c2c387b admin admin] PATH_INFO: `/v3/projects/c97ff81c019e47c9aceab5e0c27c10f3/users/252627d3301948f3a03eb6fc7c2bcf5f/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:05.410896 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07598a7c-5d9b-4181-9afe-e1b765ef3b9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:05.412682 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07598a7c-5d9b-4181-9afe-e1b765ef3b9c service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:05.418036 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c67558-cd19-47af-adc2-e0d17c2c387b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c97ff81c019e47c9aceab5e0c27c10f3, user_id=252627d3301948f3a03eb6fc7c2bcf5f, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:05.420840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c67558-cd19-47af-adc2-e0d17c2c387b admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:05.458340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 815/1629] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:05.459367 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07598a7c-5d9b-4181-9afe-e1b765ef3b9c service nova] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:05.464131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 815/1630] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:05 2022] PUT /identity/v3/projects/c97ff81c019e47c9aceab5e0c27c10f3/users/252627d3301948f3a03eb6fc7c2bcf5f/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:05.465280 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c67558-cd19-47af-adc2-e0d17c2c387b admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:05.553206 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:05.590298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:05.627055 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c67558-cd19-47af-adc2-e0d17c2c387b admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:05.634721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07598a7c-5d9b-4181-9afe-e1b765ef3b9c service nova] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:05.635701 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547bc69-455f-48e5-bdd4-3437dbe5e622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:05.636516 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547bc69-455f-48e5-bdd4-3437dbe5e622 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:05.636893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547bc69-455f-48e5-bdd4-3437dbe5e622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:05.637306 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547bc69-455f-48e5-bdd4-3437dbe5e622 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:05.639677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547bc69-455f-48e5-bdd4-3437dbe5e622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:05.643096 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547bc69-455f-48e5-bdd4-3437dbe5e622 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:05.669262 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 816/1631] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:05.670322 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547bc69-455f-48e5-bdd4-3437dbe5e622 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:05.693672 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547bc69-455f-48e5-bdd4-3437dbe5e622 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:05.711455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d91f7-78dd-4a73-860a-af81cd99978a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:05.712614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d91f7-78dd-4a73-860a-af81cd99978a admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:05.716717 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d91f7-78dd-4a73-860a-af81cd99978a admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:05.717104 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d91f7-78dd-4a73-860a-af81cd99978a admin admin] PATH_INFO: `/v3/projects/c97ff81c019e47c9aceab5e0c27c10f3/users/252627d3301948f3a03eb6fc7c2bcf5f/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:05.729267 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d91f7-78dd-4a73-860a-af81cd99978a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c97ff81c019e47c9aceab5e0c27c10f3, user_id=252627d3301948f3a03eb6fc7c2bcf5f, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:05.732503 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d91f7-78dd-4a73-860a-af81cd99978a admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:05.758510 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 817/1632] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:05 2022] PUT /identity/v3/projects/c97ff81c019e47c9aceab5e0c27c10f3/users/252627d3301948f3a03eb6fc7c2bcf5f/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:05.768986 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb06de-1125-4a72-8e82-e833e8fe1014 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:05.769375 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb06de-1125-4a72-8e82-e833e8fe1014 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:05.769746 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb06de-1125-4a72-8e82-e833e8fe1014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:05.796544 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535accf2-b3b7-47e4-89fb-32bbc63d66b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:05.799235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535accf2-b3b7-47e4-89fb-32bbc63d66b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:05.800042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535accf2-b3b7-47e4-89fb-32bbc63d66b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:05.800332 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535accf2-b3b7-47e4-89fb-32bbc63d66b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:05.835716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-ddbb06de-1125-4a72-8e82-e833e8fe1014 None None] MFA Rules not processed for user `252627d3301948f3a03eb6fc7c2bcf5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:05.837195 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-ddbb06de-1125-4a72-8e82-e833e8fe1014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:05.973558 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535accf2-b3b7-47e4-89fb-32bbc63d66b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:05.978374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535accf2-b3b7-47e4-89fb-32bbc63d66b9 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:06.019789 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 816/1633] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:05 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:06.021563 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a787643-9d30-4655-a1c0-a6215a79ba0a None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:06.021869 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a787643-9d30-4655-a1c0-a6215a79ba0a None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:06.022153 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a787643-9d30-4655-a1c0-a6215a79ba0a None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:06.026595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 818/1634] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:06.027800 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 817/1635] 10.222.0.13 () {54 vars in 912 bytes} [Thu Jun 23 02:04:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 02:04:06.036825 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d817694-0008-49fc-a9fc-70645e05d494 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:06.037278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d817694-0008-49fc-a9fc-70645e05d494 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:06.037655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d817694-0008-49fc-a9fc-70645e05d494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:06.041559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a787643-9d30-4655-a1c0-a6215a79ba0a None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:06.076411 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-3d817694-0008-49fc-a9fc-70645e05d494 None None] MFA Rules not processed for user `9d3b5180fb7144c394c39d4db28713b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:06.077777 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-3d817694-0008-49fc-a9fc-70645e05d494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:06.252930 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a787643-9d30-4655-a1c0-a6215a79ba0a None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:06.253992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 819/1636] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 02:04:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:06.263871 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e1ae0-3ce4-4344-9b5e-4590256d2930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:06.264655 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e1ae0-3ce4-4344-9b5e-4590256d2930 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:06.266640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e1ae0-3ce4-4344-9b5e-4590256d2930 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:06.266989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e1ae0-3ce4-4344-9b5e-4590256d2930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:06.295064 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e1ae0-3ce4-4344-9b5e-4590256d2930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:06.305481 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e1ae0-3ce4-4344-9b5e-4590256d2930 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:06.334440 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d817694-0008-49fc-a9fc-70645e05d494 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:06.351700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 818/1637] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:06.368719 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e1ae0-3ce4-4344-9b5e-4590256d2930 service cinder] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:06.383246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e1ae0-3ce4-4344-9b5e-4590256d2930 service cinder] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:06.388176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015941b0-a70c-40aa-8f31-a96474c20bd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:06.388890 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015941b0-a70c-40aa-8f31-a96474c20bd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:06.389390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015941b0-a70c-40aa-8f31-a96474c20bd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:06.389708 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015941b0-a70c-40aa-8f31-a96474c20bd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:06.400014 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:06.404474 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015941b0-a70c-40aa-8f31-a96474c20bd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:06.406405 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015941b0-a70c-40aa-8f31-a96474c20bd7 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:06.440446 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 819/1638] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:04:06.467344 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d817694-0008-49fc-a9fc-70645e05d494 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:06.480005 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e2cfa-df8b-4d33-bb6c-24a1d5fdf75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:06.480937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e2cfa-df8b-4d33-bb6c-24a1d5fdf75d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:06.481217 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e2cfa-df8b-4d33-bb6c-24a1d5fdf75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:06.481541 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e2cfa-df8b-4d33-bb6c-24a1d5fdf75d admin admin] PATH_INFO: `/v3/users/af5a68ce4f6747bb9895508286de2a74` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:06.485503 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e2cfa-df8b-4d33-bb6c-24a1d5fdf75d admin admin] RBAC: Authorizing `identity:delete_user(user_id=af5a68ce4f6747bb9895508286de2a74)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:06.488867 dv-cinder-815582-9-smb devstack@keystone.service[80430]: WARNING py.warnings [None req-900e2cfa-df8b-4d33-bb6c-24a1d5fdf75d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 02:04:06.488867 dv-cinder-815582-9-smb devstack@keystone.service[80430]: warnings.warn(msg) Jun 23 02:04:06.488867 dv-cinder-815582-9-smb devstack@keystone.service[80430]: Jun 23 02:04:06.492480 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e2cfa-df8b-4d33-bb6c-24a1d5fdf75d admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:06.630560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015941b0-a70c-40aa-8f31-a96474c20bd7 service cinder] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:06.643266 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015941b0-a70c-40aa-8f31-a96474c20bd7 service cinder] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:06.652531 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-900e2cfa-df8b-4d33-bb6c-24a1d5fdf75d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af5a68ce4f6747bb9895508286de2a74'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:06.654063 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42d1fc-f386-4dd2-8fe1-b4666714e115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:06.654972 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42d1fc-f386-4dd2-8fe1-b4666714e115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:06.655249 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42d1fc-f386-4dd2-8fe1-b4666714e115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:06.655547 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42d1fc-f386-4dd2-8fe1-b4666714e115 admin admin] PATH_INFO: `/v3/users/c7b20f943bc44bd0987439414a85b7ee` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:06.657810 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42d1fc-f386-4dd2-8fe1-b4666714e115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7b20f943bc44bd0987439414a85b7ee)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:06.659812 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42d1fc-f386-4dd2-8fe1-b4666714e115 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:06.671621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-900e2cfa-df8b-4d33-bb6c-24a1d5fdf75d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af5a68ce4f6747bb9895508286de2a74'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:06.673293 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-900e2cfa-df8b-4d33-bb6c-24a1d5fdf75d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af5a68ce4f6747bb9895508286de2a74'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:06.673618 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-900e2cfa-df8b-4d33-bb6c-24a1d5fdf75d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af5a68ce4f6747bb9895508286de2a74'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:06.716137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-900e2cfa-df8b-4d33-bb6c-24a1d5fdf75d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af5a68ce4f6747bb9895508286de2a74'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:06.725855 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:06.767285 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-fd42d1fc-f386-4dd2-8fe1-b4666714e115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7b20f943bc44bd0987439414a85b7ee'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:06.780857 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 820/1639] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:04:06 2022] DELETE /identity/v3/users/af5a68ce4f6747bb9895508286de2a74 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:06.785982 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7efe1-bef9-45d7-8870-50a52f5031c5 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:06.786333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7efe1-bef9-45d7-8870-50a52f5031c5 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:06.786625 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7efe1-bef9-45d7-8870-50a52f5031c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:06.801038 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-fd42d1fc-f386-4dd2-8fe1-b4666714e115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7b20f943bc44bd0987439414a85b7ee'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:06.818891 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-fd42d1fc-f386-4dd2-8fe1-b4666714e115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7b20f943bc44bd0987439414a85b7ee'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:06.820655 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-fd42d1fc-f386-4dd2-8fe1-b4666714e115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7b20f943bc44bd0987439414a85b7ee'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:06.834644 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-02e7efe1-bef9-45d7-8870-50a52f5031c5 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:06.837533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-fd42d1fc-f386-4dd2-8fe1-b4666714e115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7b20f943bc44bd0987439414a85b7ee'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:06.842257 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-02e7efe1-bef9-45d7-8870-50a52f5031c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:06.854460 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 820/1640] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:04:06 2022] DELETE /identity/v3/users/c7b20f943bc44bd0987439414a85b7ee => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:06.857660 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674ab18-df89-4eed-81a6-f6234edda60a None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:06.857941 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674ab18-df89-4eed-81a6-f6234edda60a None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:06.858711 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674ab18-df89-4eed-81a6-f6234edda60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:06.910118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-7674ab18-df89-4eed-81a6-f6234edda60a None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:06.910118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-7674ab18-df89-4eed-81a6-f6234edda60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:07.056449 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 821/1641] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:07.072426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674ab18-df89-4eed-81a6-f6234edda60a None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:07.074254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-7674ab18-df89-4eed-81a6-f6234edda60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:07.095898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 821/1642] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:07.182178 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674ab18-df89-4eed-81a6-f6234edda60a None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:07.194393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7b18a-ce84-48f3-87f1-1f2f37748875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:07.195188 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7b18a-ce84-48f3-87f1-1f2f37748875 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:07.195490 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7b18a-ce84-48f3-87f1-1f2f37748875 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:07.195764 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7b18a-ce84-48f3-87f1-1f2f37748875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:07.212299 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7efe1-bef9-45d7-8870-50a52f5031c5 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:07.215240 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7b18a-ce84-48f3-87f1-1f2f37748875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:07.216956 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7b18a-ce84-48f3-87f1-1f2f37748875 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:07.238189 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 822/1643] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:04:07.341316 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970bdab-961e-41ce-b141-8f2e2911cdb5 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:07.341823 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970bdab-961e-41ce-b141-8f2e2911cdb5 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:07.342250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970bdab-961e-41ce-b141-8f2e2911cdb5 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:07.344325 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 823/1644] 10.222.0.13 () {54 vars in 961 bytes} [Thu Jun 23 02:04:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 02:04:07.355078 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6cd87-caf4-4596-b5e5-716682b6a166 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:07.355873 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6cd87-caf4-4596-b5e5-716682b6a166 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:07.356333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6cd87-caf4-4596-b5e5-716682b6a166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:07.376626 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:07.389031 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7efe1-bef9-45d7-8870-50a52f5031c5 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:07.396371 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ff4f8-1623-4077-b914-c1c7ea509a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:07.397810 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ff4f8-1623-4077-b914-c1c7ea509a6f service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:07.398759 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ff4f8-1623-4077-b914-c1c7ea509a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:07.399643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ff4f8-1623-4077-b914-c1c7ea509a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:07.405430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-4cf6cd87-caf4-4596-b5e5-716682b6a166 None None] MFA Rules not processed for user `9d3b5180fb7144c394c39d4db28713b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:07.406409 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-4cf6cd87-caf4-4596-b5e5-716682b6a166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:07.419928 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ff4f8-1623-4077-b914-c1c7ea509a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:07.422708 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ff4f8-1623-4077-b914-c1c7ea509a6f service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:07.459232 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 822/1645] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:07.480587 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:07.515632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 824/1646] 10.222.0.13 () {58 vars in 1058 bytes} [Thu Jun 23 02:04:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:07.522731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d509ef-4ce0-4337-9f2d-c33b2bcde658 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:07.523156 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d509ef-4ce0-4337-9f2d-c33b2bcde658 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:07.523333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d509ef-4ce0-4337-9f2d-c33b2bcde658 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:07.524821 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 823/1647] 10.222.0.13 () {54 vars in 912 bytes} [Thu Jun 23 02:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 02:04:07.535252 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bdf1d-4ef0-4ad8-a9ea-adede6a4d957 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:07.535628 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bdf1d-4ef0-4ad8-a9ea-adede6a4d957 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:07.535863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bdf1d-4ef0-4ad8-a9ea-adede6a4d957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:07.580474 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-2a1bdf1d-4ef0-4ad8-a9ea-adede6a4d957 None None] MFA Rules not processed for user `9d3b5180fb7144c394c39d4db28713b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:07.584057 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-2a1bdf1d-4ef0-4ad8-a9ea-adede6a4d957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:07.608251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 825/1648] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 02:04:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:07.626780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d509ef-4ce0-4337-9f2d-c33b2bcde658 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:07.630136 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-e5d509ef-4ce0-4337-9f2d-c33b2bcde658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:07.774556 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d509ef-4ce0-4337-9f2d-c33b2bcde658 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:07.785447 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88a69b-bbb5-4321-94de-7ca4c5051525 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:07.787249 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88a69b-bbb5-4321-94de-7ca4c5051525 service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:07.788458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88a69b-bbb5-4321-94de-7ca4c5051525 service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:07.789092 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88a69b-bbb5-4321-94de-7ca4c5051525 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:07.811226 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88a69b-bbb5-4321-94de-7ca4c5051525 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:07.813599 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88a69b-bbb5-4321-94de-7ca4c5051525 service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:07.831189 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 824/1649] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:08.247123 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bdf1d-4ef0-4ad8-a9ea-adede6a4d957 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:08.261349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-2a1bdf1d-4ef0-4ad8-a9ea-adede6a4d957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:08.307649 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bdf1d-4ef0-4ad8-a9ea-adede6a4d957 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:08.320006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cca59-047d-410a-bf3c-07443f02c12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:08.321810 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cca59-047d-410a-bf3c-07443f02c12f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:08.322330 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cca59-047d-410a-bf3c-07443f02c12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:08.323084 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cca59-047d-410a-bf3c-07443f02c12f admin admin] PATH_INFO: `/v3/projects/bebe60c7451b4b57a3eb6a0dd6430573` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:08.324979 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cca59-047d-410a-bf3c-07443f02c12f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bebe60c7451b4b57a3eb6a0dd6430573)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:08.326527 dv-cinder-815582-9-smb devstack@keystone.service[80431]: WARNING py.warnings [None req-907cca59-047d-410a-bf3c-07443f02c12f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 02:04:08.326527 dv-cinder-815582-9-smb devstack@keystone.service[80431]: warnings.warn(msg) Jun 23 02:04:08.326527 dv-cinder-815582-9-smb devstack@keystone.service[80431]: Jun 23 02:04:08.329100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cca59-047d-410a-bf3c-07443f02c12f admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:08.420677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88a69b-bbb5-4321-94de-7ca4c5051525 service cinder] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:08.422323 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-1a88a69b-bbb5-4321-94de-7ca4c5051525 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:08.459055 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88a69b-bbb5-4321-94de-7ca4c5051525 service cinder] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:08.464575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-907cca59-047d-410a-bf3c-07443f02c12f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bebe60c7451b4b57a3eb6a0dd6430573', 'request_id': 'req-907cca59-047d-410a-bf3c-07443f02c12f'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:08.499737 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-907cca59-047d-410a-bf3c-07443f02c12f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bebe60c7451b4b57a3eb6a0dd6430573', 'request_id': 'req-907cca59-047d-410a-bf3c-07443f02c12f'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:08.510107 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-907cca59-047d-410a-bf3c-07443f02c12f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bebe60c7451b4b57a3eb6a0dd6430573', 'request_id': 'req-907cca59-047d-410a-bf3c-07443f02c12f'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:08.540602 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-907cca59-047d-410a-bf3c-07443f02c12f admin admin] The token cache is being invalidate because project bebe60c7451b4b57a3eb6a0dd6430573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:04:08.541033 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-907cca59-047d-410a-bf3c-07443f02c12f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:08.541994 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-907cca59-047d-410a-bf3c-07443f02c12f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:08.544045 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 826/1650] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:04:08 2022] DELETE /identity/v3/projects/bebe60c7451b4b57a3eb6a0dd6430573 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:08.552116 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cca59-047d-410a-bf3c-07443f02c12f admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:08.555582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-907cca59-047d-410a-bf3c-07443f02c12f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:08.634086 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485c9eb-b0ee-448e-a497-0e77071e413e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:08.635323 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485c9eb-b0ee-448e-a497-0e77071e413e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:08.635922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485c9eb-b0ee-448e-a497-0e77071e413e admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:08.636379 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485c9eb-b0ee-448e-a497-0e77071e413e admin admin] PATH_INFO: `/v3/projects/0566f537289246a4811c9dd0c28d1da3` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:08.638212 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485c9eb-b0ee-448e-a497-0e77071e413e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0566f537289246a4811c9dd0c28d1da3)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:08.641685 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485c9eb-b0ee-448e-a497-0e77071e413e admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:08.746247 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-4485c9eb-b0ee-448e-a497-0e77071e413e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0566f537289246a4811c9dd0c28d1da3', 'request_id': 'req-4485c9eb-b0ee-448e-a497-0e77071e413e'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:08.751615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-4485c9eb-b0ee-448e-a497-0e77071e413e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0566f537289246a4811c9dd0c28d1da3', 'request_id': 'req-4485c9eb-b0ee-448e-a497-0e77071e413e'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:08.771641 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-4485c9eb-b0ee-448e-a497-0e77071e413e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0566f537289246a4811c9dd0c28d1da3', 'request_id': 'req-4485c9eb-b0ee-448e-a497-0e77071e413e'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:08.815454 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-4485c9eb-b0ee-448e-a497-0e77071e413e admin admin] The token cache is being invalidate because project 0566f537289246a4811c9dd0c28d1da3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:04:08.815454 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-4485c9eb-b0ee-448e-a497-0e77071e413e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:08.816169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-4485c9eb-b0ee-448e-a497-0e77071e413e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:08.821728 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 825/1651] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:04:08 2022] DELETE /identity/v3/projects/0566f537289246a4811c9dd0c28d1da3 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:08.822883 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485c9eb-b0ee-448e-a497-0e77071e413e admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:08.824414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-4485c9eb-b0ee-448e-a497-0e77071e413e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:08.841621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cca59-047d-410a-bf3c-07443f02c12f admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:08.868420 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:08.974804 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485c9eb-b0ee-448e-a497-0e77071e413e admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:08.983867 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc4093-bd37-42e0-ad4c-2829e8f6e2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:08.985268 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc4093-bd37-42e0-ad4c-2829e8f6e2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:08.985616 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc4093-bd37-42e0-ad4c-2829e8f6e2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:08.985902 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc4093-bd37-42e0-ad4c-2829e8f6e2c1 admin admin] PATH_INFO: `/v3/users/252627d3301948f3a03eb6fc7c2bcf5f` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:08.987219 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc4093-bd37-42e0-ad4c-2829e8f6e2c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=252627d3301948f3a03eb6fc7c2bcf5f)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:08.989721 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc4093-bd37-42e0-ad4c-2829e8f6e2c1 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:08.999507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192ad11-a73f-4f7c-bd89-678cf4c281d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:09.002812 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192ad11-a73f-4f7c-bd89-678cf4c281d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:09.003172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192ad11-a73f-4f7c-bd89-678cf4c281d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:09.003587 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192ad11-a73f-4f7c-bd89-678cf4c281d4 admin admin] PATH_INFO: `/v3/users/5edf399fadc34d369530947a56b87a5c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:09.006646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192ad11-a73f-4f7c-bd89-678cf4c281d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5edf399fadc34d369530947a56b87a5c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:09.009319 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192ad11-a73f-4f7c-bd89-678cf4c281d4 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:09.015999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:09.116588 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e9fc4093-bd37-42e0-ad4c-2829e8f6e2c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '252627d3301948f3a03eb6fc7c2bcf5f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:09.135344 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e9fc4093-bd37-42e0-ad4c-2829e8f6e2c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '252627d3301948f3a03eb6fc7c2bcf5f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:09.136316 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-4192ad11-a73f-4f7c-bd89-678cf4c281d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5edf399fadc34d369530947a56b87a5c'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:09.137892 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e9fc4093-bd37-42e0-ad4c-2829e8f6e2c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '252627d3301948f3a03eb6fc7c2bcf5f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:09.139225 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e9fc4093-bd37-42e0-ad4c-2829e8f6e2c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '252627d3301948f3a03eb6fc7c2bcf5f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:09.175017 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-4192ad11-a73f-4f7c-bd89-678cf4c281d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5edf399fadc34d369530947a56b87a5c'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:09.191178 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-4192ad11-a73f-4f7c-bd89-678cf4c281d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5edf399fadc34d369530947a56b87a5c'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:09.192173 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-4192ad11-a73f-4f7c-bd89-678cf4c281d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5edf399fadc34d369530947a56b87a5c'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:09.192522 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e9fc4093-bd37-42e0-ad4c-2829e8f6e2c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '252627d3301948f3a03eb6fc7c2bcf5f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:09.215514 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 826/1652] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:04:08 2022] DELETE /identity/v3/users/252627d3301948f3a03eb6fc7c2bcf5f => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:09.231653 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-4192ad11-a73f-4f7c-bd89-678cf4c281d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5edf399fadc34d369530947a56b87a5c'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:09.239869 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 827/1653] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:04:08 2022] DELETE /identity/v3/users/5edf399fadc34d369530947a56b87a5c => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:09.811743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc4093-bd37-42e0-ad4c-2829e8f6e2c1 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:09.813291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-e9fc4093-bd37-42e0-ad4c-2829e8f6e2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:09.820137 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192ad11-a73f-4f7c-bd89-678cf4c281d4 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:09.821596 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-4192ad11-a73f-4f7c-bd89-678cf4c281d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:09.949692 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc4093-bd37-42e0-ad4c-2829e8f6e2c1 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:09.969063 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192ad11-a73f-4f7c-bd89-678cf4c281d4 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:09.972376 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4b4f8-d061-4dcd-bf58-cdd66db6834b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:09.973298 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4b4f8-d061-4dcd-bf58-cdd66db6834b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:09.973587 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4b4f8-d061-4dcd-bf58-cdd66db6834b admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:09.973871 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4b4f8-d061-4dcd-bf58-cdd66db6834b admin admin] PATH_INFO: `/v3/projects/c97ff81c019e47c9aceab5e0c27c10f3` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:09.976356 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4b4f8-d061-4dcd-bf58-cdd66db6834b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c97ff81c019e47c9aceab5e0c27c10f3)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:09.983216 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4b4f8-d061-4dcd-bf58-cdd66db6834b admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:09.984906 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e79fc-90a6-4f02-88d3-f34381629c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:09.985817 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e79fc-90a6-4f02-88d3-f34381629c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:09.986095 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e79fc-90a6-4f02-88d3-f34381629c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:09.986371 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e79fc-90a6-4f02-88d3-f34381629c14 admin admin] PATH_INFO: `/v3/projects/6a55c2a84c634c20b3c91faae45244cd` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:09.989220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e79fc-90a6-4f02-88d3-f34381629c14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a55c2a84c634c20b3c91faae45244cd)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:09.991203 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e79fc-90a6-4f02-88d3-f34381629c14 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:10.079049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:10.086437 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-09c4b4f8-d061-4dcd-bf58-cdd66db6834b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c97ff81c019e47c9aceab5e0c27c10f3', 'request_id': 'req-09c4b4f8-d061-4dcd-bf58-cdd66db6834b'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:10.109171 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-09c4b4f8-d061-4dcd-bf58-cdd66db6834b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c97ff81c019e47c9aceab5e0c27c10f3', 'request_id': 'req-09c4b4f8-d061-4dcd-bf58-cdd66db6834b'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:10.130564 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-09c4b4f8-d061-4dcd-bf58-cdd66db6834b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c97ff81c019e47c9aceab5e0c27c10f3', 'request_id': 'req-09c4b4f8-d061-4dcd-bf58-cdd66db6834b'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:10.149081 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-c23e79fc-90a6-4f02-88d3-f34381629c14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a55c2a84c634c20b3c91faae45244cd', 'request_id': 'req-c23e79fc-90a6-4f02-88d3-f34381629c14'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:10.165812 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-09c4b4f8-d061-4dcd-bf58-cdd66db6834b admin admin] The token cache is being invalidate because project c97ff81c019e47c9aceab5e0c27c10f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:04:10.166717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-c23e79fc-90a6-4f02-88d3-f34381629c14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a55c2a84c634c20b3c91faae45244cd', 'request_id': 'req-c23e79fc-90a6-4f02-88d3-f34381629c14'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:10.168176 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-09c4b4f8-d061-4dcd-bf58-cdd66db6834b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:10.170408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-09c4b4f8-d061-4dcd-bf58-cdd66db6834b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:10.174666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 827/1654] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:04:09 2022] DELETE /identity/v3/projects/c97ff81c019e47c9aceab5e0c27c10f3 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:10.175511 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4b4f8-d061-4dcd-bf58-cdd66db6834b admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:10.179459 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-09c4b4f8-d061-4dcd-bf58-cdd66db6834b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:10.181387 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-c23e79fc-90a6-4f02-88d3-f34381629c14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a55c2a84c634c20b3c91faae45244cd', 'request_id': 'req-c23e79fc-90a6-4f02-88d3-f34381629c14'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:10.213186 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-c23e79fc-90a6-4f02-88d3-f34381629c14 admin admin] The token cache is being invalidate because project 6a55c2a84c634c20b3c91faae45244cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:04:10.213186 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-c23e79fc-90a6-4f02-88d3-f34381629c14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:10.214579 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-c23e79fc-90a6-4f02-88d3-f34381629c14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:10.228484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 828/1655] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:04:09 2022] DELETE /identity/v3/projects/6a55c2a84c634c20b3c91faae45244cd => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:10.228484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68846466-bf44-42af-b7de-55053ba1c695 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:10.230397 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68846466-bf44-42af-b7de-55053ba1c695 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:10.230691 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68846466-bf44-42af-b7de-55053ba1c695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:10.298548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-68846466-bf44-42af-b7de-55053ba1c695 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:10.300689 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-68846466-bf44-42af-b7de-55053ba1c695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:10.316767 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:10.408926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4b4f8-d061-4dcd-bf58-cdd66db6834b admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:10.490272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 829/1656] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:10.491718 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b521a2-b2e5-496e-9982-d99331dca831 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:10.492000 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b521a2-b2e5-496e-9982-d99331dca831 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:10.492279 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b521a2-b2e5-496e-9982-d99331dca831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:10.533395 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-a8b521a2-b2e5-496e-9982-d99331dca831 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:10.535567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a8b521a2-b2e5-496e-9982-d99331dca831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:10.571849 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 830/1657] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:10.589146 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc4879-7364-482c-aa65-7a35b3dab793 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:10.589441 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc4879-7364-482c-aa65-7a35b3dab793 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:10.589698 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc4879-7364-482c-aa65-7a35b3dab793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:10.597311 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becdb5c6-da76-4325-9867-8bb07f3c67c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:10.599275 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdb5c6-da76-4325-9867-8bb07f3c67c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:10.599275 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdb5c6-da76-4325-9867-8bb07f3c67c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:10.601195 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdb5c6-da76-4325-9867-8bb07f3c67c7 admin admin] PATH_INFO: `/v3/users/7f8dbfbf2f60449281439ee187f35dca` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:10.602731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becdb5c6-da76-4325-9867-8bb07f3c67c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f8dbfbf2f60449281439ee187f35dca)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:10.607794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becdb5c6-da76-4325-9867-8bb07f3c67c7 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:10.632105 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-75fc4879-7364-482c-aa65-7a35b3dab793 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:10.635724 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-75fc4879-7364-482c-aa65-7a35b3dab793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:10.655605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 831/1658] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:10.656853 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849e88f-8371-4b13-97c7-664e5449b6c1 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:10.657150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849e88f-8371-4b13-97c7-664e5449b6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:10.657426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849e88f-8371-4b13-97c7-664e5449b6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:10.723649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-becdb5c6-da76-4325-9867-8bb07f3c67c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f8dbfbf2f60449281439ee187f35dca'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:10.724331 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-b849e88f-8371-4b13-97c7-664e5449b6c1 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:10.727107 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-b849e88f-8371-4b13-97c7-664e5449b6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:10.743592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-becdb5c6-da76-4325-9867-8bb07f3c67c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f8dbfbf2f60449281439ee187f35dca'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:10.750950 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-becdb5c6-da76-4325-9867-8bb07f3c67c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f8dbfbf2f60449281439ee187f35dca'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:10.755943 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 832/1659] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:10.757017 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849e88f-8371-4b13-97c7-664e5449b6c1 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:10.757451 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-becdb5c6-da76-4325-9867-8bb07f3c67c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f8dbfbf2f60449281439ee187f35dca'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:10.772138 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849e88f-8371-4b13-97c7-664e5449b6c1 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:10.775901 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-becdb5c6-da76-4325-9867-8bb07f3c67c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f8dbfbf2f60449281439ee187f35dca'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:10.778645 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea87b25-d1c9-4f14-b02c-1323b71c2ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:10.779566 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87b25-d1c9-4f14-b02c-1323b71c2ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:10.780137 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87b25-d1c9-4f14-b02c-1323b71c2ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:10.780672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87b25-d1c9-4f14-b02c-1323b71c2ef0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:10.781523 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea87b25-d1c9-4f14-b02c-1323b71c2ef0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:04:10.781944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea87b25-d1c9-4f14-b02c-1323b71c2ef0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:10.786537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea87b25-d1c9-4f14-b02c-1323b71c2ef0 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:10.798102 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:10.811332 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 828/1660] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:04:10 2022] DELETE /identity/v3/users/7f8dbfbf2f60449281439ee187f35dca => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:10.813108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becdb5c6-da76-4325-9867-8bb07f3c67c7 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:10.818256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-becdb5c6-da76-4325-9867-8bb07f3c67c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:10.823240 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 833/1661] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:04:10.825460 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c23003-c6ec-45a8-8633-9a3112fc34b8 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:10.826132 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c23003-c6ec-45a8-8633-9a3112fc34b8 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:10.827046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c23003-c6ec-45a8-8633-9a3112fc34b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:10.869787 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-b5c23003-c6ec-45a8-8633-9a3112fc34b8 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:10.873867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-b5c23003-c6ec-45a8-8633-9a3112fc34b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:10.966912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becdb5c6-da76-4325-9867-8bb07f3c67c7 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:10.972493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaab9a-b0f5-4662-93cf-3b6e0f361f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:10.973281 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaab9a-b0f5-4662-93cf-3b6e0f361f88 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:10.973635 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaab9a-b0f5-4662-93cf-3b6e0f361f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:10.973927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaab9a-b0f5-4662-93cf-3b6e0f361f88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:10.974862 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eaab9a-b0f5-4662-93cf-3b6e0f361f88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:04:10.975274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eaab9a-b0f5-4662-93cf-3b6e0f361f88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:10.977416 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eaab9a-b0f5-4662-93cf-3b6e0f361f88 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:10.991531 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 829/1662] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:04:10.992585 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaab9a-b0f5-4662-93cf-3b6e0f361f88 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:10.994399 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-51eaab9a-b0f5-4662-93cf-3b6e0f361f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:11.000220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 834/1663] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:11.001193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c23003-c6ec-45a8-8633-9a3112fc34b8 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:11.008911 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaab9a-b0f5-4662-93cf-3b6e0f361f88 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:11.013940 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c951996-5c20-45bd-b6b9-dce516c808ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:11.014914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c951996-5c20-45bd-b6b9-dce516c808ea admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:11.015296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c951996-5c20-45bd-b6b9-dce516c808ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:11.015809 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c951996-5c20-45bd-b6b9-dce516c808ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:11.016610 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c951996-5c20-45bd-b6b9-dce516c808ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:11.018703 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c951996-5c20-45bd-b6b9-dce516c808ea admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:11.020849 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c23003-c6ec-45a8-8633-9a3112fc34b8 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:11.032675 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e751c-4b47-4c85-a538-3f7df0ac9245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:11.034940 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e751c-4b47-4c85-a538-3f7df0ac9245 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:11.035692 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e751c-4b47-4c85-a538-3f7df0ac9245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:11.036547 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e751c-4b47-4c85-a538-3f7df0ac9245 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:11.038251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e751c-4b47-4c85-a538-3f7df0ac9245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:11.068920 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e751c-4b47-4c85-a538-3f7df0ac9245 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:11.073105 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 830/1664] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:10 2022] POST /identity/v3/projects => generated 367 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:11.075814 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c951996-5c20-45bd-b6b9-dce516c808ea admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:11.079739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-6c951996-5c20-45bd-b6b9-dce516c808ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:11.172247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 835/1665] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:11 2022] POST /identity/v3/projects => generated 405 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:11.190928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e751c-4b47-4c85-a538-3f7df0ac9245 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:11.240327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c951996-5c20-45bd-b6b9-dce516c808ea admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:11.321842 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11035100-2603-44e8-aaec-4a800f454ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:11.321842 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11035100-2603-44e8-aaec-4a800f454ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:11.321842 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11035100-2603-44e8-aaec-4a800f454ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:11.321842 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11035100-2603-44e8-aaec-4a800f454ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:11.369770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:11.394610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e751c-4b47-4c85-a538-3f7df0ac9245 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:11.396671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:11.419733 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a45ff2-13d5-4e8b-9909-758831b6ff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:11.421456 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a45ff2-13d5-4e8b-9909-758831b6ff8f admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:11.421456 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a45ff2-13d5-4e8b-9909-758831b6ff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:11.421456 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a45ff2-13d5-4e8b-9909-758831b6ff8f admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:11.421809 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a45ff2-13d5-4e8b-9909-758831b6ff8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:11.423722 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a45ff2-13d5-4e8b-9909-758831b6ff8f admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:11.476483 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 836/1666] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:11 2022] POST /identity/v3/users => generated 284 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:11.476483 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a45ff2-13d5-4e8b-9909-758831b6ff8f admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:11.485522 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11035100-2603-44e8-aaec-4a800f454ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:11.490145 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11035100-2603-44e8-aaec-4a800f454ec2 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:11.510192 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a45ff2-13d5-4e8b-9909-758831b6ff8f admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:11.517879 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063c5bb-20e6-4b3d-bf1c-ddf1b095ccff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:11.518587 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063c5bb-20e6-4b3d-bf1c-ddf1b095ccff admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:11.518859 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063c5bb-20e6-4b3d-bf1c-ddf1b095ccff admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:11.519226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063c5bb-20e6-4b3d-bf1c-ddf1b095ccff admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:11.520152 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063c5bb-20e6-4b3d-bf1c-ddf1b095ccff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:11.522373 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063c5bb-20e6-4b3d-bf1c-ddf1b095ccff admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:11.524714 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 831/1667] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:11.527462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11035100-2603-44e8-aaec-4a800f454ec2 service neutron] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:11.565737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11035100-2603-44e8-aaec-4a800f454ec2 service neutron] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:11.582701 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3dccd9-fb47-4db3-bb6a-f4cdade33451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:11.583759 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3dccd9-fb47-4db3-bb6a-f4cdade33451 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:11.584199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3dccd9-fb47-4db3-bb6a-f4cdade33451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:11.584623 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3dccd9-fb47-4db3-bb6a-f4cdade33451 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:11.585651 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3dccd9-fb47-4db3-bb6a-f4cdade33451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:11.590743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3dccd9-fb47-4db3-bb6a-f4cdade33451 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:11.618952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 837/1668] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:11 2022] POST /identity/v3/users => generated 303 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:11.620653 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063c5bb-20e6-4b3d-bf1c-ddf1b095ccff admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:11.626496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 832/1669] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:11.630888 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3dccd9-fb47-4db3-bb6a-f4cdade33451 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:11.676383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063c5bb-20e6-4b3d-bf1c-ddf1b095ccff admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:11.690146 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2e8d9-5f19-47a5-9283-4031200fd065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:11.690934 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2e8d9-5f19-47a5-9283-4031200fd065 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:11.691298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2e8d9-5f19-47a5-9283-4031200fd065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:11.691817 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2e8d9-5f19-47a5-9283-4031200fd065 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:11.692699 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2e8d9-5f19-47a5-9283-4031200fd065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:11.696977 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2e8d9-5f19-47a5-9283-4031200fd065 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:11.723760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 838/1670] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:11.724874 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2e8d9-5f19-47a5-9283-4031200fd065 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:11.735287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3dccd9-fb47-4db3-bb6a-f4cdade33451 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:11.746173 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2e8d9-5f19-47a5-9283-4031200fd065 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:11.750856 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd6083-9810-45f4-8290-ea43a9b34ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:11.751892 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd6083-9810-45f4-8290-ea43a9b34ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:11.752481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd6083-9810-45f4-8290-ea43a9b34ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:11.753117 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd6083-9810-45f4-8290-ea43a9b34ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:11.754099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd6083-9810-45f4-8290-ea43a9b34ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:11.756471 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd6083-9810-45f4-8290-ea43a9b34ca6 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:11.767379 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eca498-29f7-4dce-abc9-52b3ab15a38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:11.771791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eca498-29f7-4dce-abc9-52b3ab15a38a admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:11.771791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eca498-29f7-4dce-abc9-52b3ab15a38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:11.771980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eca498-29f7-4dce-abc9-52b3ab15a38a admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:11.773462 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eca498-29f7-4dce-abc9-52b3ab15a38a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:11.775117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eca498-29f7-4dce-abc9-52b3ab15a38a admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:11.786038 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 833/1671] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:11.787213 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd6083-9810-45f4-8290-ea43a9b34ca6 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:11.805046 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd6083-9810-45f4-8290-ea43a9b34ca6 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:11.822226 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb5a51-4c74-4646-8cd5-a34b563f73cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:11.823258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb5a51-4c74-4646-8cd5-a34b563f73cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:11.825960 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb5a51-4c74-4646-8cd5-a34b563f73cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:11.826444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb5a51-4c74-4646-8cd5-a34b563f73cd admin admin] PATH_INFO: `/v3/projects/2daec9a8f0f5448487329a754bdf7a30/users/2ec8904396e442a5b0f6aefb1a182bc8/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:11.848444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 839/1672] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:11.849064 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eca498-29f7-4dce-abc9-52b3ab15a38a admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:11.858427 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb5a51-4c74-4646-8cd5-a34b563f73cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2daec9a8f0f5448487329a754bdf7a30, user_id=2ec8904396e442a5b0f6aefb1a182bc8, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:11.862594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb5a51-4c74-4646-8cd5-a34b563f73cd admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:11.886388 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eca498-29f7-4dce-abc9-52b3ab15a38a admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:11.892814 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 834/1673] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:11 2022] PUT /identity/v3/projects/2daec9a8f0f5448487329a754bdf7a30/users/2ec8904396e442a5b0f6aefb1a182bc8/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:11.910089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73303e-8259-4252-be77-a4efe918315e None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:11.910089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73303e-8259-4252-be77-a4efe918315e None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:11.910089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73303e-8259-4252-be77-a4efe918315e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:11.959078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-6f73303e-8259-4252-be77-a4efe918315e None None] MFA Rules not processed for user `2ec8904396e442a5b0f6aefb1a182bc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:11.960631 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-6f73303e-8259-4252-be77-a4efe918315e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:12.065366 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476530bc-50a1-4e05-982c-29a12cda201c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:12.066633 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476530bc-50a1-4e05-982c-29a12cda201c admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:12.066633 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476530bc-50a1-4e05-982c-29a12cda201c admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:12.066816 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476530bc-50a1-4e05-982c-29a12cda201c admin admin] PATH_INFO: `/v3/projects/af81bbf5f1994b1dbdf6110e8eeaf81c/users/5c881959a8094f77a0100c9023e75228/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:12.108691 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476530bc-50a1-4e05-982c-29a12cda201c admin admin] RBAC: Authorizing `identity:create_grant(project_id=af81bbf5f1994b1dbdf6110e8eeaf81c, user_id=5c881959a8094f77a0100c9023e75228, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:12.111643 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476530bc-50a1-4e05-982c-29a12cda201c admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:12.116136 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 835/1674] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:12.120939 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73303e-8259-4252-be77-a4efe918315e None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:12.138050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73303e-8259-4252-be77-a4efe918315e None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:12.152127 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 840/1675] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:11 2022] PUT /identity/v3/projects/af81bbf5f1994b1dbdf6110e8eeaf81c/users/5c881959a8094f77a0100c9023e75228/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:12.153238 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78001d-4832-4455-8d8f-c241a69d0c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:12.157086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9988af9-d783-4a6a-b165-bb3323783889 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:12.157375 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9988af9-d783-4a6a-b165-bb3323783889 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:12.157650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9988af9-d783-4a6a-b165-bb3323783889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:12.157750 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78001d-4832-4455-8d8f-c241a69d0c14 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:12.158169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78001d-4832-4455-8d8f-c241a69d0c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:12.158548 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78001d-4832-4455-8d8f-c241a69d0c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:12.159371 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78001d-4832-4455-8d8f-c241a69d0c14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:12.164114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78001d-4832-4455-8d8f-c241a69d0c14 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:12.228152 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-c9988af9-d783-4a6a-b165-bb3323783889 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:12.230781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-c9988af9-d783-4a6a-b165-bb3323783889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:12.238369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 836/1676] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:12 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:12.241825 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78001d-4832-4455-8d8f-c241a69d0c14 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:12.366796 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:12.385622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78001d-4832-4455-8d8f-c241a69d0c14 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:12.393315 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fc626-5ed7-4fe0-879a-d4c1c7b6c42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:12.394185 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fc626-5ed7-4fe0-879a-d4c1c7b6c42a admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:12.394499 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fc626-5ed7-4fe0-879a-d4c1c7b6c42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:12.395738 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fc626-5ed7-4fe0-879a-d4c1c7b6c42a admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:12.396571 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fc626-5ed7-4fe0-879a-d4c1c7b6c42a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:12.398808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fc626-5ed7-4fe0-879a-d4c1c7b6c42a admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:12.441513 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 837/1677] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:12 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:12.442548 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fc626-5ed7-4fe0-879a-d4c1c7b6c42a admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:12.444237 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 841/1678] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:12.444672 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-fb1fc626-5ed7-4fe0-879a-d4c1c7b6c42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:12.448389 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9988af9-d783-4a6a-b165-bb3323783889 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:12.468838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fc626-5ed7-4fe0-879a-d4c1c7b6c42a admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:12.476041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96bd1b-dd1a-4f62-b28d-3cc6a24894bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:12.478919 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96bd1b-dd1a-4f62-b28d-3cc6a24894bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:12.479260 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96bd1b-dd1a-4f62-b28d-3cc6a24894bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:12.480035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96bd1b-dd1a-4f62-b28d-3cc6a24894bb admin admin] PATH_INFO: `/v3/projects/f054582b90c0473891c6cf766e8cd532` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:12.482160 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96bd1b-dd1a-4f62-b28d-3cc6a24894bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f054582b90c0473891c6cf766e8cd532)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:12.485452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96bd1b-dd1a-4f62-b28d-3cc6a24894bb admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:12.493176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9988af9-d783-4a6a-b165-bb3323783889 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:12.510625 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cff06b-01dc-48c7-a695-dd6fa67abeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:12.513847 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cff06b-01dc-48c7-a695-dd6fa67abeae admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:12.514347 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cff06b-01dc-48c7-a695-dd6fa67abeae admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:12.514810 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cff06b-01dc-48c7-a695-dd6fa67abeae admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:12.515726 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cff06b-01dc-48c7-a695-dd6fa67abeae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:12.525973 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cff06b-01dc-48c7-a695-dd6fa67abeae admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:12.561006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 842/1679] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:12.568684 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cff06b-01dc-48c7-a695-dd6fa67abeae admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:12.592056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-9b96bd1b-dd1a-4f62-b28d-3cc6a24894bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f054582b90c0473891c6cf766e8cd532', 'request_id': 'req-9b96bd1b-dd1a-4f62-b28d-3cc6a24894bb'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:12.612426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:12.616051 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-9b96bd1b-dd1a-4f62-b28d-3cc6a24894bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f054582b90c0473891c6cf766e8cd532', 'request_id': 'req-9b96bd1b-dd1a-4f62-b28d-3cc6a24894bb'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:12.633646 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-9b96bd1b-dd1a-4f62-b28d-3cc6a24894bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f054582b90c0473891c6cf766e8cd532', 'request_id': 'req-9b96bd1b-dd1a-4f62-b28d-3cc6a24894bb'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:12.661483 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-9b96bd1b-dd1a-4f62-b28d-3cc6a24894bb admin admin] The token cache is being invalidate because project f054582b90c0473891c6cf766e8cd532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:04:12.661774 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-9b96bd1b-dd1a-4f62-b28d-3cc6a24894bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:12.665243 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-9b96bd1b-dd1a-4f62-b28d-3cc6a24894bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:12.669114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 838/1680] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:04:12 2022] DELETE /identity/v3/projects/f054582b90c0473891c6cf766e8cd532 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:12.669710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96bd1b-dd1a-4f62-b28d-3cc6a24894bb admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:12.673897 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-9b96bd1b-dd1a-4f62-b28d-3cc6a24894bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:12.708674 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cff06b-01dc-48c7-a695-dd6fa67abeae admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:12.951756 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96bd1b-dd1a-4f62-b28d-3cc6a24894bb admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:12.965452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee385192-12c6-4330-9842-a26b48416527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:12.968503 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee385192-12c6-4330-9842-a26b48416527 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:12.970071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee385192-12c6-4330-9842-a26b48416527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:12.970503 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee385192-12c6-4330-9842-a26b48416527 admin admin] PATH_INFO: `/v3/projects/58ff16d4ca004601b5ed4b7b3c5eea30/users/ea0107206bb8447db378704781e8e7bd/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:13.009946 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee385192-12c6-4330-9842-a26b48416527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58ff16d4ca004601b5ed4b7b3c5eea30, user_id=ea0107206bb8447db378704781e8e7bd, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:13.011634 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47877c93-8e28-4a80-b826-59767c4d8ee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:13.012287 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47877c93-8e28-4a80-b826-59767c4d8ee4 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:13.012572 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47877c93-8e28-4a80-b826-59767c4d8ee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:13.012849 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47877c93-8e28-4a80-b826-59767c4d8ee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:13.014566 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee385192-12c6-4330-9842-a26b48416527 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:13.027093 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-47877c93-8e28-4a80-b826-59767c4d8ee4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:13.050823 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 839/1681] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:12 2022] PUT /identity/v3/projects/58ff16d4ca004601b5ed4b7b3c5eea30/users/ea0107206bb8447db378704781e8e7bd/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:13.052639 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77faff61-6592-44eb-bbe4-9a3a2d8069ff None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:13.054678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77faff61-6592-44eb-bbe4-9a3a2d8069ff None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:13.055901 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77faff61-6592-44eb-bbe4-9a3a2d8069ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:13.100689 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-77faff61-6592-44eb-bbe4-9a3a2d8069ff None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:13.105217 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-77faff61-6592-44eb-bbe4-9a3a2d8069ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:13.141211 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47877c93-8e28-4a80-b826-59767c4d8ee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:13.147490 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47877c93-8e28-4a80-b826-59767c4d8ee4 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:13.215943 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 843/1682] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:13.217067 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47877c93-8e28-4a80-b826-59767c4d8ee4 service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:13.243144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47877c93-8e28-4a80-b826-59767c4d8ee4 service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:13.255161 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:13.280894 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 840/1683] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:13.288457 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a27e15-bb79-4879-86ca-10367a8faecf None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:13.288819 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a27e15-bb79-4879-86ca-10367a8faecf None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:13.289384 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a27e15-bb79-4879-86ca-10367a8faecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:13.349339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-f1a27e15-bb79-4879-86ca-10367a8faecf None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:13.353545 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-f1a27e15-bb79-4879-86ca-10367a8faecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:13.374553 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 841/1684] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:13.378651 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a27e15-bb79-4879-86ca-10367a8faecf None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:13.395964 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e6a02-d54e-41b7-bae5-49644b5ee5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:13.396348 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a27e15-bb79-4879-86ca-10367a8faecf None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:13.396636 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e6a02-d54e-41b7-bae5-49644b5ee5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:13.400200 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e6a02-d54e-41b7-bae5-49644b5ee5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:13.400557 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e6a02-d54e-41b7-bae5-49644b5ee5f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:13.401475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e6a02-d54e-41b7-bae5-49644b5ee5f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:13.402253 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9c25e-f37d-40c3-abd9-41d532c34b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:13.403273 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9c25e-f37d-40c3-abd9-41d532c34b1a admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:13.403765 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9c25e-f37d-40c3-abd9-41d532c34b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:13.404045 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9c25e-f37d-40c3-abd9-41d532c34b1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:13.404790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9c25e-f37d-40c3-abd9-41d532c34b1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:04:13.407266 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9c25e-f37d-40c3-abd9-41d532c34b1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:13.410829 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9c25e-f37d-40c3-abd9-41d532c34b1a admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:13.411629 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e6a02-d54e-41b7-bae5-49644b5ee5f8 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:13.430983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 842/1685] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 02:04:13.435563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9c25e-f37d-40c3-abd9-41d532c34b1a admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:13.451470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 844/1686] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:13.452500 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e6a02-d54e-41b7-bae5-49644b5ee5f8 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:13.458856 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9c25e-f37d-40c3-abd9-41d532c34b1a admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:13.466036 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb38430-1261-4473-9a86-a2b689504a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:13.466262 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e6a02-d54e-41b7-bae5-49644b5ee5f8 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:13.466966 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb38430-1261-4473-9a86-a2b689504a51 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:13.467511 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb38430-1261-4473-9a86-a2b689504a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:13.467888 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb38430-1261-4473-9a86-a2b689504a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:13.468808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb38430-1261-4473-9a86-a2b689504a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:13.470893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb38430-1261-4473-9a86-a2b689504a51 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:13.472454 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25770e6-de7b-4d5c-9766-adcbab424d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:13.473372 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25770e6-de7b-4d5c-9766-adcbab424d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:13.473948 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25770e6-de7b-4d5c-9766-adcbab424d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:13.474281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25770e6-de7b-4d5c-9766-adcbab424d66 admin admin] PATH_INFO: `/v3/projects/58ff16d4ca004601b5ed4b7b3c5eea30/users/ea0107206bb8447db378704781e8e7bd/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:13.476753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25770e6-de7b-4d5c-9766-adcbab424d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58ff16d4ca004601b5ed4b7b3c5eea30, user_id=ea0107206bb8447db378704781e8e7bd, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:13.480668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25770e6-de7b-4d5c-9766-adcbab424d66 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:13.508791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 845/1687] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:13 2022] PUT /identity/v3/projects/58ff16d4ca004601b5ed4b7b3c5eea30/users/ea0107206bb8447db378704781e8e7bd/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:13.511275 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 843/1688] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:13 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:13.512299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fc71e-9482-4e40-8e1f-a2de2044ed0d None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:13.512596 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fc71e-9482-4e40-8e1f-a2de2044ed0d None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:13.512874 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fc71e-9482-4e40-8e1f-a2de2044ed0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:13.516014 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb38430-1261-4473-9a86-a2b689504a51 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:13.549989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-597fc71e-9482-4e40-8e1f-a2de2044ed0d None None] MFA Rules not processed for user `ea0107206bb8447db378704781e8e7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:13.552375 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-597fc71e-9482-4e40-8e1f-a2de2044ed0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:13.633655 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:13.673702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb38430-1261-4473-9a86-a2b689504a51 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:13.680212 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed0a30-87e5-4b0f-a2df-ae283c1c4800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:13.681209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed0a30-87e5-4b0f-a2df-ae283c1c4800 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:13.681581 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed0a30-87e5-4b0f-a2df-ae283c1c4800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:13.681952 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed0a30-87e5-4b0f-a2df-ae283c1c4800 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:13.682764 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed0a30-87e5-4b0f-a2df-ae283c1c4800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:13.685178 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed0a30-87e5-4b0f-a2df-ae283c1c4800 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:13.705154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 846/1689] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:13 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:04:13.707491 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba76254-6bb9-4261-aec1-16193b794d31 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:13.707998 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba76254-6bb9-4261-aec1-16193b794d31 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:13.711565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba76254-6bb9-4261-aec1-16193b794d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:13.724852 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 844/1690] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:13 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:13.729353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed0a30-87e5-4b0f-a2df-ae283c1c4800 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:13.733542 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-02ed0a30-87e5-4b0f-a2df-ae283c1c4800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:13.790045 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-cba76254-6bb9-4261-aec1-16193b794d31 None None] MFA Rules not processed for user `0c3ad28388a84ebd9d386fa466c65ba9`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:13.794151 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-cba76254-6bb9-4261-aec1-16193b794d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:13.891892 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed0a30-87e5-4b0f-a2df-ae283c1c4800 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:13.904112 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3895dc-28cd-476a-b4ff-ec4e6eab6d64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:13.904855 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3895dc-28cd-476a-b4ff-ec4e6eab6d64 service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:13.905151 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3895dc-28cd-476a-b4ff-ec4e6eab6d64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:13.905421 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3895dc-28cd-476a-b4ff-ec4e6eab6d64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:13.935718 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3895dc-28cd-476a-b4ff-ec4e6eab6d64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:13.937402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3895dc-28cd-476a-b4ff-ec4e6eab6d64 service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:13.970066 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 845/1691] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:13 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:13.972309 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3895dc-28cd-476a-b4ff-ec4e6eab6d64 service cinder] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:13.989115 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 847/1692] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:14.000519 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92574f4d-fc07-4e12-8a09-8ed3266d2b1a None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:14.001161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92574f4d-fc07-4e12-8a09-8ed3266d2b1a None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:14.001595 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92574f4d-fc07-4e12-8a09-8ed3266d2b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:14.011565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3895dc-28cd-476a-b4ff-ec4e6eab6d64 service cinder] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:14.018316 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06a247-26b1-485e-85ed-2bc04ca9f7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:14.019300 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06a247-26b1-485e-85ed-2bc04ca9f7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:14.019711 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06a247-26b1-485e-85ed-2bc04ca9f7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:14.020168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06a247-26b1-485e-85ed-2bc04ca9f7d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:14.022097 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06a247-26b1-485e-85ed-2bc04ca9f7d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:14.024217 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06a247-26b1-485e-85ed-2bc04ca9f7d4 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:14.040697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-92574f4d-fc07-4e12-8a09-8ed3266d2b1a None None] MFA Rules not processed for user `0c3ad28388a84ebd9d386fa466c65ba9`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:14.043360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-92574f4d-fc07-4e12-8a09-8ed3266d2b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:14.047332 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 846/1693] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:14.060324 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06a247-26b1-485e-85ed-2bc04ca9f7d4 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:14.075691 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 848/1694] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:04:14.096151 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92574f4d-fc07-4e12-8a09-8ed3266d2b1a None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:14.097922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-92574f4d-fc07-4e12-8a09-8ed3266d2b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:14.100034 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06a247-26b1-485e-85ed-2bc04ca9f7d4 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:14.108843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004a0bf-b5ea-4cf1-ac24-dcd8b242bdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:14.109577 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004a0bf-b5ea-4cf1-ac24-dcd8b242bdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:14.109871 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004a0bf-b5ea-4cf1-ac24-dcd8b242bdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:14.110148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004a0bf-b5ea-4cf1-ac24-dcd8b242bdd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:14.121756 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004a0bf-b5ea-4cf1-ac24-dcd8b242bdd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:14.126474 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004a0bf-b5ea-4cf1-ac24-dcd8b242bdd9 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:14.158541 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 847/1695] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:14.159806 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004a0bf-b5ea-4cf1-ac24-dcd8b242bdd9 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:14.220762 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004a0bf-b5ea-4cf1-ac24-dcd8b242bdd9 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:14.226829 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86785eeb-5d4d-4d40-b310-1f87e0807621 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:14.227529 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86785eeb-5d4d-4d40-b310-1f87e0807621 service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:14.227820 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86785eeb-5d4d-4d40-b310-1f87e0807621 service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:14.228090 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86785eeb-5d4d-4d40-b310-1f87e0807621 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:14.236509 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-86785eeb-5d4d-4d40-b310-1f87e0807621 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:14.269665 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92574f4d-fc07-4e12-8a09-8ed3266d2b1a None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:14.284656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb2ba1-620f-4284-8b19-7028776c9e69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:14.286998 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb2ba1-620f-4284-8b19-7028776c9e69 service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:14.287334 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb2ba1-620f-4284-8b19-7028776c9e69 service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:14.287638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb2ba1-620f-4284-8b19-7028776c9e69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:14.290639 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:14.324156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb2ba1-620f-4284-8b19-7028776c9e69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:14.328025 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb2ba1-620f-4284-8b19-7028776c9e69 service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:14.356702 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 849/1696] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:04:14.359073 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb2ba1-620f-4284-8b19-7028776c9e69 service nova] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:14.384319 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb2ba1-620f-4284-8b19-7028776c9e69 service nova] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:14.396014 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286d0ca-d4d3-4b6c-81e1-ba9411473559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:14.398145 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286d0ca-d4d3-4b6c-81e1-ba9411473559 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:14.398712 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286d0ca-d4d3-4b6c-81e1-ba9411473559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:14.398998 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286d0ca-d4d3-4b6c-81e1-ba9411473559 admin admin] PATH_INFO: `/v3/projects/22670522d77042eca0cf981ba857a117/users/460d40753d094d7ab146e787fd90982d/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:14.400362 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86785eeb-5d4d-4d40-b310-1f87e0807621 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:14.403589 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86785eeb-5d4d-4d40-b310-1f87e0807621 service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:14.428628 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 848/1697] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:14 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:14.432531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286d0ca-d4d3-4b6c-81e1-ba9411473559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22670522d77042eca0cf981ba857a117, user_id=460d40753d094d7ab146e787fd90982d, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:14.435281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286d0ca-d4d3-4b6c-81e1-ba9411473559 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:14.464809 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 850/1698] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:14 2022] PUT /identity/v3/projects/22670522d77042eca0cf981ba857a117/users/460d40753d094d7ab146e787fd90982d/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:14.477575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b27299-453c-44d5-b8ee-fa702e46a71e None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:14.478139 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b27299-453c-44d5-b8ee-fa702e46a71e None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:14.478796 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b27299-453c-44d5-b8ee-fa702e46a71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:14.580067 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-d7b27299-453c-44d5-b8ee-fa702e46a71e None None] MFA Rules not processed for user `460d40753d094d7ab146e787fd90982d`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:14.584419 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-d7b27299-453c-44d5-b8ee-fa702e46a71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:14.733800 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 849/1699] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:14.735085 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286d0ca-d4d3-4b6c-81e1-ba9411473559 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:14.793020 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:14.874487 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286d0ca-d4d3-4b6c-81e1-ba9411473559 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:14.900318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754a17f-d9e8-438e-ad8f-1f946cb729ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:14.901012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754a17f-d9e8-438e-ad8f-1f946cb729ec admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:14.901296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754a17f-d9e8-438e-ad8f-1f946cb729ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:14.901570 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754a17f-d9e8-438e-ad8f-1f946cb729ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:14.902273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754a17f-d9e8-438e-ad8f-1f946cb729ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:14.918072 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754a17f-d9e8-438e-ad8f-1f946cb729ec admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:15.025496 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 851/1700] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:14 2022] POST /identity/v3/projects => generated 371 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:15.029475 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b27299-453c-44d5-b8ee-fa702e46a71e None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:15.046820 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b27299-453c-44d5-b8ee-fa702e46a71e None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:15.202079 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e8a48-a6b2-479f-bc9d-a5df940371c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:15.202938 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e8a48-a6b2-479f-bc9d-a5df940371c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:15.203266 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e8a48-a6b2-479f-bc9d-a5df940371c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:15.203661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e8a48-a6b2-479f-bc9d-a5df940371c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:15.204489 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e8a48-a6b2-479f-bc9d-a5df940371c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:15.214007 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e8a48-a6b2-479f-bc9d-a5df940371c0 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:15.259536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 850/1701] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:15 2022] POST /identity/v3/users => generated 292 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:15.263305 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754a17f-d9e8-438e-ad8f-1f946cb729ec admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:15.278777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754a17f-d9e8-438e-ad8f-1f946cb729ec admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:15.292368 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d2d1a-1cb0-41dd-ba74-799783385ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:15.293279 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d2d1a-1cb0-41dd-ba74-799783385ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:15.293759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d2d1a-1cb0-41dd-ba74-799783385ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:15.294037 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d2d1a-1cb0-41dd-ba74-799783385ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:15.294842 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d2d1a-1cb0-41dd-ba74-799783385ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:15.297726 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d2d1a-1cb0-41dd-ba74-799783385ef7 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:15.332661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e8a48-a6b2-479f-bc9d-a5df940371c0 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:15.333186 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 852/1702] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:15.344243 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e8a48-a6b2-479f-bc9d-a5df940371c0 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:15.356044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af10093-df2f-4d45-9559-bad6802e711d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:15.357561 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af10093-df2f-4d45-9559-bad6802e711d admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:15.357846 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af10093-df2f-4d45-9559-bad6802e711d admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:15.358119 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af10093-df2f-4d45-9559-bad6802e711d admin admin] PATH_INFO: `/v3/projects/4a035fae256048f0bb5a5c2b547fc2af/users/f3cc3356a2ed4dfcb36ec3533127d002/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:15.397108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af10093-df2f-4d45-9559-bad6802e711d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a035fae256048f0bb5a5c2b547fc2af, user_id=f3cc3356a2ed4dfcb36ec3533127d002, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:15.404767 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af10093-df2f-4d45-9559-bad6802e711d admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:15.418733 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac65bf-f764-4dbd-9ec0-e497b62b433e None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:15.419021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac65bf-f764-4dbd-9ec0-e497b62b433e None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:15.419565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac65bf-f764-4dbd-9ec0-e497b62b433e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:15.432749 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 851/1703] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:15 2022] PUT /identity/v3/projects/4a035fae256048f0bb5a5c2b547fc2af/users/f3cc3356a2ed4dfcb36ec3533127d002/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:04:15.436586 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af10093-df2f-4d45-9559-bad6802e711d admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:15.482242 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-4bac65bf-f764-4dbd-9ec0-e497b62b433e None None] MFA Rules not processed for user `5c881959a8094f77a0100c9023e75228`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:15.483535 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-4bac65bf-f764-4dbd-9ec0-e497b62b433e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:15.485689 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:15.582081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af10093-df2f-4d45-9559-bad6802e711d admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:15.593391 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98441bdd-3604-428f-8ca3-1f1a1a04f4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:15.593391 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98441bdd-3604-428f-8ca3-1f1a1a04f4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:15.593663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98441bdd-3604-428f-8ca3-1f1a1a04f4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:15.594038 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98441bdd-3604-428f-8ca3-1f1a1a04f4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:15.595802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98441bdd-3604-428f-8ca3-1f1a1a04f4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:15.597480 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98441bdd-3604-428f-8ca3-1f1a1a04f4c4 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:15.622445 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 852/1704] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:04:15.622633 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 853/1705] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:15 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:15.624081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98441bdd-3604-428f-8ca3-1f1a1a04f4c4 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:15.625472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac65bf-f764-4dbd-9ec0-e497b62b433e None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:15.626948 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-4bac65bf-f764-4dbd-9ec0-e497b62b433e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:15.652543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98441bdd-3604-428f-8ca3-1f1a1a04f4c4 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:15.653874 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac65bf-f764-4dbd-9ec0-e497b62b433e None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:15.660939 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5709f89-3e46-4521-a224-b7fa26ff1bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:15.661976 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5709f89-3e46-4521-a224-b7fa26ff1bf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:15.662305 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5709f89-3e46-4521-a224-b7fa26ff1bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:15.662642 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5709f89-3e46-4521-a224-b7fa26ff1bf0 admin admin] PATH_INFO: `/v3/projects/4a035fae256048f0bb5a5c2b547fc2af/users/f3cc3356a2ed4dfcb36ec3533127d002/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:15.664952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e7fdc-10d7-485c-b004-1b80f9952f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:15.665895 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5709f89-3e46-4521-a224-b7fa26ff1bf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a035fae256048f0bb5a5c2b547fc2af, user_id=f3cc3356a2ed4dfcb36ec3533127d002, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:15.666585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e7fdc-10d7-485c-b004-1b80f9952f01 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:15.667463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e7fdc-10d7-485c-b004-1b80f9952f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:15.668801 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5709f89-3e46-4521-a224-b7fa26ff1bf0 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:15.669191 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e7fdc-10d7-485c-b004-1b80f9952f01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:15.671007 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e7fdc-10d7-485c-b004-1b80f9952f01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:15.674705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e7fdc-10d7-485c-b004-1b80f9952f01 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:15.735136 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 853/1706] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:15 2022] PUT /identity/v3/projects/4a035fae256048f0bb5a5c2b547fc2af/users/f3cc3356a2ed4dfcb36ec3533127d002/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:15.735378 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 854/1707] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:15 2022] POST /identity/v3/projects => generated 403 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:15.737009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23beaada-457b-40af-80d8-4422213ab257 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:15.737370 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdbd50-c1e4-4252-9786-8c5c85b457df None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:15.737478 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23beaada-457b-40af-80d8-4422213ab257 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:15.737905 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23beaada-457b-40af-80d8-4422213ab257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:15.738112 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdbd50-c1e4-4252-9786-8c5c85b457df None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:15.738615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdbd50-c1e4-4252-9786-8c5c85b457df None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:15.747247 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 854/1708] 10.222.0.13 () {54 vars in 912 bytes} [Thu Jun 23 02:04:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 02:04:15.749959 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdbd50-c1e4-4252-9786-8c5c85b457df None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:15.793007 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-23beaada-457b-40af-80d8-4422213ab257 None None] MFA Rules not processed for user `f3cc3356a2ed4dfcb36ec3533127d002`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:15.794446 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-23beaada-457b-40af-80d8-4422213ab257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:15.906666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdbd50-c1e4-4252-9786-8c5c85b457df None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:15.925062 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:15.932147 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48a544-1373-49a3-905b-e9a8bb3d8137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:15.937623 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48a544-1373-49a3-905b-e9a8bb3d8137 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:15.938107 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48a544-1373-49a3-905b-e9a8bb3d8137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:15.938471 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48a544-1373-49a3-905b-e9a8bb3d8137 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:15.939747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48a544-1373-49a3-905b-e9a8bb3d8137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:15.945842 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 855/1709] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:15 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:15.950302 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48a544-1373-49a3-905b-e9a8bb3d8137 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:15.955481 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d91910-12db-4be1-89ab-2cb69931542e None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:15.956121 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d91910-12db-4be1-89ab-2cb69931542e None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:15.956589 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d91910-12db-4be1-89ab-2cb69931542e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:15.987597 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 855/1710] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:15 2022] POST /identity/v3/users => generated 308 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:15.988791 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48a544-1373-49a3-905b-e9a8bb3d8137 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:16.041300 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-f6d91910-12db-4be1-89ab-2cb69931542e None None] MFA Rules not processed for user `8cda12550db1442ab04f30b9875fdbea`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:16.045001 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-f6d91910-12db-4be1-89ab-2cb69931542e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:16.111892 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48a544-1373-49a3-905b-e9a8bb3d8137 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:16.117647 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdd162-2d41-480a-9420-3878dd2d5c7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:16.120484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdd162-2d41-480a-9420-3878dd2d5c7a service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:16.120786 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdd162-2d41-480a-9420-3878dd2d5c7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:16.121063 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdd162-2d41-480a-9420-3878dd2d5c7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:16.139355 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbdd162-2d41-480a-9420-3878dd2d5c7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:16.142633 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbdd162-2d41-480a-9420-3878dd2d5c7a service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:16.159457 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 856/1711] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:15 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:16.161038 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdd162-2d41-480a-9420-3878dd2d5c7a service cinder] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:16.178135 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 856/1712] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 02:04:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:16.188681 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdd162-2d41-480a-9420-3878dd2d5c7a service cinder] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:16.194639 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e04f4-4124-484d-8c1c-4430a9fd425d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:16.195677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e04f4-4124-484d-8c1c-4430a9fd425d admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:16.196133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e04f4-4124-484d-8c1c-4430a9fd425d admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:16.196313 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e04f4-4124-484d-8c1c-4430a9fd425d admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:16.196818 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d91910-12db-4be1-89ab-2cb69931542e None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:16.197095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e04f4-4124-484d-8c1c-4430a9fd425d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:16.198263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-f6d91910-12db-4be1-89ab-2cb69931542e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:16.199177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e04f4-4124-484d-8c1c-4430a9fd425d admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:16.213033 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 857/1713] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:16.214287 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d91910-12db-4be1-89ab-2cb69931542e None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:16.217467 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e04f4-4124-484d-8c1c-4430a9fd425d admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:16.231448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6939ea-7039-44db-ace7-e7d0579cecfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:16.232145 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6939ea-7039-44db-ace7-e7d0579cecfc service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:16.232415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6939ea-7039-44db-ace7-e7d0579cecfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:16.232689 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6939ea-7039-44db-ace7-e7d0579cecfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:16.239666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e04f4-4124-484d-8c1c-4430a9fd425d admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:16.244623 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6939ea-7039-44db-ace7-e7d0579cecfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:16.245602 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e287ddc-3782-404b-8976-9b2d0a9afeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:16.246071 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6939ea-7039-44db-ace7-e7d0579cecfc service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:16.247752 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e287ddc-3782-404b-8976-9b2d0a9afeaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:16.247752 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e287ddc-3782-404b-8976-9b2d0a9afeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:16.247752 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e287ddc-3782-404b-8976-9b2d0a9afeaf admin admin] PATH_INFO: `/v3/projects/f2cf5537ebb249f691cdd927ebddc4a2/users/e41531e528254c27ba7e0cb48a3851dd/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:16.269788 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e287ddc-3782-404b-8976-9b2d0a9afeaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2cf5537ebb249f691cdd927ebddc4a2, user_id=e41531e528254c27ba7e0cb48a3851dd, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:16.271753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 857/1714] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:16.273473 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e287ddc-3782-404b-8976-9b2d0a9afeaf admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:16.280150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:16.304761 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 858/1715] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:16 2022] PUT /identity/v3/projects/f2cf5537ebb249f691cdd927ebddc4a2/users/e41531e528254c27ba7e0cb48a3851dd/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:16.305993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6939ea-7039-44db-ace7-e7d0579cecfc service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:16.330819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6939ea-7039-44db-ace7-e7d0579cecfc service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:16.355819 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e287ddc-3782-404b-8976-9b2d0a9afeaf admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:16.500418 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e287ddc-3782-404b-8976-9b2d0a9afeaf admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:16.508987 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e84a7c-1e17-41cd-af65-7fce0e943f92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:16.509230 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e84a7c-1e17-41cd-af65-7fce0e943f92 service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:16.509453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e84a7c-1e17-41cd-af65-7fce0e943f92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:16.509608 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e84a7c-1e17-41cd-af65-7fce0e943f92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:16.512537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d8a6d-2ef1-4ada-9ecc-fae698d46908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:16.513231 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d8a6d-2ef1-4ada-9ecc-fae698d46908 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:16.513514 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d8a6d-2ef1-4ada-9ecc-fae698d46908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:16.513784 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d8a6d-2ef1-4ada-9ecc-fae698d46908 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:16.514521 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d8a6d-2ef1-4ada-9ecc-fae698d46908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:16.516192 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d8a6d-2ef1-4ada-9ecc-fae698d46908 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:16.539550 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 858/1716] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:16.542724 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d8a6d-2ef1-4ada-9ecc-fae698d46908 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:16.562836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d8a6d-2ef1-4ada-9ecc-fae698d46908 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:16.574093 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1ef4c-0522-4ee0-bd22-3bdf819604e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:16.576012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1ef4c-0522-4ee0-bd22-3bdf819604e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:16.576256 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1ef4c-0522-4ee0-bd22-3bdf819604e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:16.576835 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1ef4c-0522-4ee0-bd22-3bdf819604e9 admin admin] PATH_INFO: `/v3/projects/f2cf5537ebb249f691cdd927ebddc4a2/users/e41531e528254c27ba7e0cb48a3851dd/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:16.581614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1ef4c-0522-4ee0-bd22-3bdf819604e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2cf5537ebb249f691cdd927ebddc4a2, user_id=e41531e528254c27ba7e0cb48a3851dd, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:16.589038 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1ef4c-0522-4ee0-bd22-3bdf819604e9 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:16.610704 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 859/1717] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:16 2022] PUT /identity/v3/projects/f2cf5537ebb249f691cdd927ebddc4a2/users/e41531e528254c27ba7e0cb48a3851dd/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:16.634980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e84a7c-1e17-41cd-af65-7fce0e943f92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:16.636623 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e84a7c-1e17-41cd-af65-7fce0e943f92 service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:16.657991 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 859/1718] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:04:17.530502 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1ef4c-0522-4ee0-bd22-3bdf819604e9 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:17.533104 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-c7c1ef4c-0522-4ee0-bd22-3bdf819604e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:17.717361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6131cb-cefa-4391-ab58-67041634215b None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:17.717913 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6131cb-cefa-4391-ab58-67041634215b None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:17.717913 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6131cb-cefa-4391-ab58-67041634215b None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:17.719332 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 860/1719] 10.222.0.13 () {54 vars in 960 bytes} [Thu Jun 23 02:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 02:04:17.726254 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21957884-d514-44bc-bbce-77ec49c7b249 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:17.726542 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21957884-d514-44bc-bbce-77ec49c7b249 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:17.726921 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21957884-d514-44bc-bbce-77ec49c7b249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:17.736381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1ef4c-0522-4ee0-bd22-3bdf819604e9 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:17.769148 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750e883-5b63-47b6-9a0c-f8baefef089d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:17.770172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750e883-5b63-47b6-9a0c-f8baefef089d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:17.770357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750e883-5b63-47b6-9a0c-f8baefef089d admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:17.770633 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750e883-5b63-47b6-9a0c-f8baefef089d admin admin] PATH_INFO: `/v3/users/e187fb3327204bf8b38246678a3d7a5d` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:17.772292 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-21957884-d514-44bc-bbce-77ec49c7b249 None None] MFA Rules not processed for user `9756f5b9de8a4f23b365a96d309d86ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:17.773623 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-21957884-d514-44bc-bbce-77ec49c7b249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:17.775334 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750e883-5b63-47b6-9a0c-f8baefef089d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e187fb3327204bf8b38246678a3d7a5d)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:17.777378 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750e883-5b63-47b6-9a0c-f8baefef089d admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:17.794022 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:17.877060 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-4750e883-5b63-47b6-9a0c-f8baefef089d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e187fb3327204bf8b38246678a3d7a5d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:17.927547 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-4750e883-5b63-47b6-9a0c-f8baefef089d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e187fb3327204bf8b38246678a3d7a5d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:17.940933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 861/1720] 10.222.0.13 () {58 vars in 1057 bytes} [Thu Jun 23 02:04:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:04:17.942768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-4750e883-5b63-47b6-9a0c-f8baefef089d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e187fb3327204bf8b38246678a3d7a5d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:17.946094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-4750e883-5b63-47b6-9a0c-f8baefef089d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e187fb3327204bf8b38246678a3d7a5d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:17.953659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21957884-d514-44bc-bbce-77ec49c7b249 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:17.965021 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21957884-d514-44bc-bbce-77ec49c7b249 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:17.967227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-4750e883-5b63-47b6-9a0c-f8baefef089d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e187fb3327204bf8b38246678a3d7a5d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:17.982494 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 860/1721] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:04:17 2022] DELETE /identity/v3/users/e187fb3327204bf8b38246678a3d7a5d => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:17.987620 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39821757-76ec-4f84-b34f-2cce521d42d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9756f5b9de8a4f23b365a96d309d86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:17.988301 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39821757-76ec-4f84-b34f-2cce521d42d5 service placement] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:17.988417 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70605f5d-5468-4a3f-83b1-833220150c9a None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:17.988581 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39821757-76ec-4f84-b34f-2cce521d42d5 service placement] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:17.988713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70605f5d-5468-4a3f-83b1-833220150c9a None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:17.988838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39821757-76ec-4f84-b34f-2cce521d42d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:17.989164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70605f5d-5468-4a3f-83b1-833220150c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:17.991796 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-39821757-76ec-4f84-b34f-2cce521d42d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:18.012365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39821757-76ec-4f84-b34f-2cce521d42d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:18.013899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39821757-76ec-4f84-b34f-2cce521d42d5 service placement] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:18.046098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 862/1722] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:18.087578 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1700a0-dd00-4ee7-bf23-c38450af3dd5 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:18.088178 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1700a0-dd00-4ee7-bf23-c38450af3dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:18.088658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1700a0-dd00-4ee7-bf23-c38450af3dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:18.089127 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-70605f5d-5468-4a3f-83b1-833220150c9a None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:18.093813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-70605f5d-5468-4a3f-83b1-833220150c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:18.141808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-1d1700a0-dd00-4ee7-bf23-c38450af3dd5 None None] MFA Rules not processed for user `0c3ad28388a84ebd9d386fa466c65ba9`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:18.157849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-1d1700a0-dd00-4ee7-bf23-c38450af3dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:18.273853 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 861/1723] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:18.333836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:18.415784 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70605f5d-5468-4a3f-83b1-833220150c9a None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:18.417586 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-70605f5d-5468-4a3f-83b1-833220150c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:18.469925 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 863/1724] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:04:18.581929 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70605f5d-5468-4a3f-83b1-833220150c9a None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:18.595668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcfeb6-eedc-49c8-9de3-09a678effc10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:18.596710 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcfeb6-eedc-49c8-9de3-09a678effc10 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:18.597238 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcfeb6-eedc-49c8-9de3-09a678effc10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:18.597696 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcfeb6-eedc-49c8-9de3-09a678effc10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:18.621227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcfeb6-eedc-49c8-9de3-09a678effc10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:18.624308 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcfeb6-eedc-49c8-9de3-09a678effc10 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:18.653221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 862/1725] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:04:21.276398 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1700a0-dd00-4ee7-bf23-c38450af3dd5 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:21.283564 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-1d1700a0-dd00-4ee7-bf23-c38450af3dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:21.377893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1700a0-dd00-4ee7-bf23-c38450af3dd5 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:21.400104 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f13cb7-73f4-4c84-9a64-f81f51d2f734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:21.401664 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f13cb7-73f4-4c84-9a64-f81f51d2f734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:21.402176 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f13cb7-73f4-4c84-9a64-f81f51d2f734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:21.402688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f13cb7-73f4-4c84-9a64-f81f51d2f734 admin admin] PATH_INFO: `/v3/projects/ce61a689ef65408eb11a04131f1f25e8` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:21.407365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f13cb7-73f4-4c84-9a64-f81f51d2f734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce61a689ef65408eb11a04131f1f25e8)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:21.410399 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f13cb7-73f4-4c84-9a64-f81f51d2f734 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:21.631551 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-b8f13cb7-73f4-4c84-9a64-f81f51d2f734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce61a689ef65408eb11a04131f1f25e8', 'request_id': 'req-b8f13cb7-73f4-4c84-9a64-f81f51d2f734'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:21.663663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-b8f13cb7-73f4-4c84-9a64-f81f51d2f734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce61a689ef65408eb11a04131f1f25e8', 'request_id': 'req-b8f13cb7-73f4-4c84-9a64-f81f51d2f734'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:21.686326 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-b8f13cb7-73f4-4c84-9a64-f81f51d2f734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce61a689ef65408eb11a04131f1f25e8', 'request_id': 'req-b8f13cb7-73f4-4c84-9a64-f81f51d2f734'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:21.719224 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-b8f13cb7-73f4-4c84-9a64-f81f51d2f734 admin admin] The token cache is being invalidate because project ce61a689ef65408eb11a04131f1f25e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:04:21.719709 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-b8f13cb7-73f4-4c84-9a64-f81f51d2f734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:21.722265 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-b8f13cb7-73f4-4c84-9a64-f81f51d2f734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:21.730318 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 864/1726] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:04:21 2022] DELETE /identity/v3/projects/ce61a689ef65408eb11a04131f1f25e8 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:21.732138 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6b361-7382-4957-a233-94c3fa84e1de None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:21.732610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6b361-7382-4957-a233-94c3fa84e1de None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:21.732681 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6b361-7382-4957-a233-94c3fa84e1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:21.801405 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-21d6b361-7382-4957-a233-94c3fa84e1de None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:21.802892 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-21d6b361-7382-4957-a233-94c3fa84e1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:21.862864 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:21.970289 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 863/1727] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:21.978713 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83caff71-0b08-44a0-9482-ef308ba7b054 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:21.978997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83caff71-0b08-44a0-9482-ef308ba7b054 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:21.979274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83caff71-0b08-44a0-9482-ef308ba7b054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:22.010050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-83caff71-0b08-44a0-9482-ef308ba7b054 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:22.011705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-83caff71-0b08-44a0-9482-ef308ba7b054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:22.020733 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 865/1728] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:22.028015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6b361-7382-4957-a233-94c3fa84e1de None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:22.041068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6b361-7382-4957-a233-94c3fa84e1de None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:22.049095 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2ca0e-f480-4d4c-95e1-d17ef81c6b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:22.050126 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2ca0e-f480-4d4c-95e1-d17ef81c6b7c admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:22.050484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2ca0e-f480-4d4c-95e1-d17ef81c6b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:22.050827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2ca0e-f480-4d4c-95e1-d17ef81c6b7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:22.051672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2ca0e-f480-4d4c-95e1-d17ef81c6b7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:04:22.056868 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2ca0e-f480-4d4c-95e1-d17ef81c6b7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:22.058768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2ca0e-f480-4d4c-95e1-d17ef81c6b7c admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:22.067877 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a7ab8-175a-4eae-9560-41807f62974f None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:22.068628 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a7ab8-175a-4eae-9560-41807f62974f None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:22.069083 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a7ab8-175a-4eae-9560-41807f62974f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:22.102754 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 864/1729] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:04:22.106283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13541aa-4eb9-427b-99db-3d3c987e4663 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:22.106637 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13541aa-4eb9-427b-99db-3d3c987e4663 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:22.108084 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13541aa-4eb9-427b-99db-3d3c987e4663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:22.111462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-403a7ab8-175a-4eae-9560-41807f62974f None None] MFA Rules not processed for user `0dbf596d8f964d4695944a23dd8e4cef`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:22.113026 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-403a7ab8-175a-4eae-9560-41807f62974f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:22.171973 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-d13541aa-4eb9-427b-99db-3d3c987e4663 None None] MFA Rules not processed for user `e41531e528254c27ba7e0cb48a3851dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:22.175151 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-d13541aa-4eb9-427b-99db-3d3c987e4663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:22.260446 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 866/1730] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 02:04:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:04:22.261437 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a7ab8-175a-4eae-9560-41807f62974f None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:22.299800 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a7ab8-175a-4eae-9560-41807f62974f None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:22.318274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c30cd-a95d-48e0-abb3-a7623f869cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:22.319753 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c30cd-a95d-48e0-abb3-a7623f869cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:22.321816 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c30cd-a95d-48e0-abb3-a7623f869cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:22.322277 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c30cd-a95d-48e0-abb3-a7623f869cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:22.328750 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c30cd-a95d-48e0-abb3-a7623f869cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:22.330718 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c30cd-a95d-48e0-abb3-a7623f869cd9 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:22.383578 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 865/1731] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:22 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:22.390346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee8002-e2ce-412c-a2a1-4aa0a33bd5ff None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:22.390646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee8002-e2ce-412c-a2a1-4aa0a33bd5ff None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:22.390928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee8002-e2ce-412c-a2a1-4aa0a33bd5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:22.400902 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 867/1732] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:22 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:22.405201 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c30cd-a95d-48e0-abb3-a7623f869cd9 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:22.452375 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-a8ee8002-e2ce-412c-a2a1-4aa0a33bd5ff None None] MFA Rules not processed for user `976a75d631554ef2974c6ee763015635`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:22.455020 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a8ee8002-e2ce-412c-a2a1-4aa0a33bd5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:22.466475 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:22.489983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c30cd-a95d-48e0-abb3-a7623f869cd9 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:22.498078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ea321-1d59-40ed-8df1-54590b5ced89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:22.499107 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ea321-1d59-40ed-8df1-54590b5ced89 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:22.500337 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ea321-1d59-40ed-8df1-54590b5ced89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:22.500758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ea321-1d59-40ed-8df1-54590b5ced89 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:22.502227 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ea321-1d59-40ed-8df1-54590b5ced89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:22.504589 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ea321-1d59-40ed-8df1-54590b5ced89 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:22.551162 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 868/1733] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:22 2022] POST /identity/v3/users => generated 292 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:22.560574 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ea321-1d59-40ed-8df1-54590b5ced89 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:22.597949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ea321-1d59-40ed-8df1-54590b5ced89 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:22.612984 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3aed5-29ca-44fc-9519-9ffc6649d745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:22.613761 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3aed5-29ca-44fc-9519-9ffc6649d745 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:22.613987 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3aed5-29ca-44fc-9519-9ffc6649d745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:22.614271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3aed5-29ca-44fc-9519-9ffc6649d745 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:22.616899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3aed5-29ca-44fc-9519-9ffc6649d745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:22.620866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3aed5-29ca-44fc-9519-9ffc6649d745 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:22.645884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 869/1734] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:22.647129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3aed5-29ca-44fc-9519-9ffc6649d745 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:22.654051 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-4db3aed5-29ca-44fc-9519-9ffc6649d745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:22.679507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 866/1735] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:22.679507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee8002-e2ce-412c-a2a1-4aa0a33bd5ff None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:22.681175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a8ee8002-e2ce-412c-a2a1-4aa0a33bd5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:22.719987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee8002-e2ce-412c-a2a1-4aa0a33bd5ff None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:22.734105 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8b790-8a22-403e-ad88-501ce2432ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:22.735029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8b790-8a22-403e-ad88-501ce2432ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:22.735309 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8b790-8a22-403e-ad88-501ce2432ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:22.740752 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8b790-8a22-403e-ad88-501ce2432ae5 admin admin] PATH_INFO: `/v3/users/2ec8904396e442a5b0f6aefb1a182bc8` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:22.745372 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8b790-8a22-403e-ad88-501ce2432ae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ec8904396e442a5b0f6aefb1a182bc8)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:22.752762 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8b790-8a22-403e-ad88-501ce2432ae5 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:22.818366 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:22.862178 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-05a8b790-8a22-403e-ad88-501ce2432ae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ec8904396e442a5b0f6aefb1a182bc8'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:22.905869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3aed5-29ca-44fc-9519-9ffc6649d745 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:22.924151 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c123f21-1c02-42f3-8334-fde3b778a5a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae132c4d0b5461aa26ab929a017cb08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:22.927468 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-05a8b790-8a22-403e-ad88-501ce2432ae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ec8904396e442a5b0f6aefb1a182bc8'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:22.930829 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c123f21-1c02-42f3-8334-fde3b778a5a1 service swift] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:22.931286 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c123f21-1c02-42f3-8334-fde3b778a5a1 service swift] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:22.931688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c123f21-1c02-42f3-8334-fde3b778a5a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:22.944128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-05a8b790-8a22-403e-ad88-501ce2432ae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ec8904396e442a5b0f6aefb1a182bc8'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:22.947939 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-05a8b790-8a22-403e-ad88-501ce2432ae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ec8904396e442a5b0f6aefb1a182bc8'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:22.963983 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-05a8b790-8a22-403e-ad88-501ce2432ae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ec8904396e442a5b0f6aefb1a182bc8'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:22.971787 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 867/1736] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:04:22 2022] DELETE /identity/v3/users/2ec8904396e442a5b0f6aefb1a182bc8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:22.975750 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8b790-8a22-403e-ad88-501ce2432ae5 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:22.980882 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-05a8b790-8a22-403e-ad88-501ce2432ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:23.074152 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c123f21-1c02-42f3-8334-fde3b778a5a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:23.080978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c123f21-1c02-42f3-8334-fde3b778a5a1 service swift] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:23.096188 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 870/1737] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 02:04:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 02:04:23.099305 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958fe25-51a0-4a28-acb2-e8ab50ed364b None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:23.099783 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958fe25-51a0-4a28-acb2-e8ab50ed364b None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:23.100679 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958fe25-51a0-4a28-acb2-e8ab50ed364b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:23.123058 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-0958fe25-51a0-4a28-acb2-e8ab50ed364b None None] MFA Rules not processed for user `976a75d631554ef2974c6ee763015635`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:23.125604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-0958fe25-51a0-4a28-acb2-e8ab50ed364b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:23.141200 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8b790-8a22-403e-ad88-501ce2432ae5 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:23.159073 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baba4c9-0ff7-4911-86bf-bcae3601e459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:23.159733 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baba4c9-0ff7-4911-86bf-bcae3601e459 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:23.160017 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baba4c9-0ff7-4911-86bf-bcae3601e459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:23.160297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baba4c9-0ff7-4911-86bf-bcae3601e459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:23.161052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baba4c9-0ff7-4911-86bf-bcae3601e459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:23.189077 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baba4c9-0ff7-4911-86bf-bcae3601e459 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:23.264347 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 868/1738] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:23.271148 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617b65e-a2c4-4208-8e37-68a3519eb46a None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:23.271468 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617b65e-a2c4-4208-8e37-68a3519eb46a None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:23.271743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617b65e-a2c4-4208-8e37-68a3519eb46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:23.323480 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-8617b65e-a2c4-4208-8e37-68a3519eb46a None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:23.325057 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-8617b65e-a2c4-4208-8e37-68a3519eb46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:23.338922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 869/1739] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:23.340921 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617b65e-a2c4-4208-8e37-68a3519eb46a None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:23.358663 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617b65e-a2c4-4208-8e37-68a3519eb46a None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:23.365929 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffa51f-0894-4d31-85f4-01d6e40fa4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:23.367821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffa51f-0894-4d31-85f4-01d6e40fa4ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:23.368404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffa51f-0894-4d31-85f4-01d6e40fa4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:23.368889 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffa51f-0894-4d31-85f4-01d6e40fa4ae admin admin] PATH_INFO: `/v3/projects/efd8956234e048f6b754cd5d1dde967d/users/58911020daeb4d1e86706528fdc8b114/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:23.401009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bffa51f-0894-4d31-85f4-01d6e40fa4ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd8956234e048f6b754cd5d1dde967d, user_id=58911020daeb4d1e86706528fdc8b114, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:23.405798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bffa51f-0894-4d31-85f4-01d6e40fa4ae admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:23.423103 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 871/1740] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:23.438899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958fe25-51a0-4a28-acb2-e8ab50ed364b None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:23.438899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-0958fe25-51a0-4a28-acb2-e8ab50ed364b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:23.454621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:23.461886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 870/1741] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:23 2022] PUT /identity/v3/projects/efd8956234e048f6b754cd5d1dde967d/users/58911020daeb4d1e86706528fdc8b114/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:23.473171 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab8032-1e37-413d-9a21-ff99a6dd87ac None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:23.473466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab8032-1e37-413d-9a21-ff99a6dd87ac None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:23.475932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab8032-1e37-413d-9a21-ff99a6dd87ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:23.610348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-63ab8032-1e37-413d-9a21-ff99a6dd87ac None None] MFA Rules not processed for user `58911020daeb4d1e86706528fdc8b114`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:23.616804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-63ab8032-1e37-413d-9a21-ff99a6dd87ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:23.726733 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958fe25-51a0-4a28-acb2-e8ab50ed364b None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:23.856978 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:23.918843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 871/1742] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:23.919962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab8032-1e37-413d-9a21-ff99a6dd87ac None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:23.933448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-63ab8032-1e37-413d-9a21-ff99a6dd87ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:23.970871 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5c328-b798-4f8a-b06a-d050fe82ded1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:23.971631 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5c328-b798-4f8a-b06a-d050fe82ded1 service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:23.971916 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5c328-b798-4f8a-b06a-d050fe82ded1 service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:23.972190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5c328-b798-4f8a-b06a-d050fe82ded1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:23.979637 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-f8e5c328-b798-4f8a-b06a-d050fe82ded1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:24.160361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5c328-b798-4f8a-b06a-d050fe82ded1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:24.162241 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5c328-b798-4f8a-b06a-d050fe82ded1 service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:24.210046 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 872/1743] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 778 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:04:24.212504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5c328-b798-4f8a-b06a-d050fe82ded1 service nova] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:24.235288 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab8032-1e37-413d-9a21-ff99a6dd87ac None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:24.260415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38287cf3-5afc-4a65-a5b1-33fd6d89ae8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:24.270256 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38287cf3-5afc-4a65-a5b1-33fd6d89ae8d service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:24.270523 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38287cf3-5afc-4a65-a5b1-33fd6d89ae8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:24.270802 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38287cf3-5afc-4a65-a5b1-33fd6d89ae8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:24.346437 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:24.435321 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5c328-b798-4f8a-b06a-d050fe82ded1 service nova] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:24.447825 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79ee5c-a61b-4915-8723-63d1d1be725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:24.448867 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79ee5c-a61b-4915-8723-63d1d1be725e admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:24.449184 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79ee5c-a61b-4915-8723-63d1d1be725e admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:24.449426 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79ee5c-a61b-4915-8723-63d1d1be725e admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:24.450526 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79ee5c-a61b-4915-8723-63d1d1be725e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:24.454344 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79ee5c-a61b-4915-8723-63d1d1be725e admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:24.554532 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 873/1744] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:24 2022] POST /identity/v3/projects => generated 387 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:24.561337 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79ee5c-a61b-4915-8723-63d1d1be725e admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:24.652519 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38287cf3-5afc-4a65-a5b1-33fd6d89ae8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:24.654878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38287cf3-5afc-4a65-a5b1-33fd6d89ae8d service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:24.703341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 872/1745] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 784 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:24.818297 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79ee5c-a61b-4915-8723-63d1d1be725e admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:24.836523 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5993037-1f06-4e03-be47-9d55dbab1510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:24.837629 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5993037-1f06-4e03-be47-9d55dbab1510 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:24.838851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5993037-1f06-4e03-be47-9d55dbab1510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:24.839681 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5993037-1f06-4e03-be47-9d55dbab1510 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:24.841733 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5993037-1f06-4e03-be47-9d55dbab1510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:24.845741 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5993037-1f06-4e03-be47-9d55dbab1510 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:24.897829 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 874/1746] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:24 2022] POST /identity/v3/users => generated 294 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:24.901906 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38287cf3-5afc-4a65-a5b1-33fd6d89ae8d service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:24.945076 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38287cf3-5afc-4a65-a5b1-33fd6d89ae8d service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:24.964984 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31787d5-19df-4084-a14b-b369cc946343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:24.964984 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31787d5-19df-4084-a14b-b369cc946343 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:24.965274 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31787d5-19df-4084-a14b-b369cc946343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:24.965409 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31787d5-19df-4084-a14b-b369cc946343 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:24.966119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31787d5-19df-4084-a14b-b369cc946343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:24.994137 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31787d5-19df-4084-a14b-b369cc946343 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:25.044563 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 873/1747] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:25.047736 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5993037-1f06-4e03-be47-9d55dbab1510 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:25.065244 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5993037-1f06-4e03-be47-9d55dbab1510 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:25.082329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff321bc-24a5-489e-8afd-869caaa5cb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:25.083433 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff321bc-24a5-489e-8afd-869caaa5cb88 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:25.083845 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff321bc-24a5-489e-8afd-869caaa5cb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:25.084308 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff321bc-24a5-489e-8afd-869caaa5cb88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:25.085258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff321bc-24a5-489e-8afd-869caaa5cb88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:25.087247 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff321bc-24a5-489e-8afd-869caaa5cb88 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:25.109226 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 875/1748] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:25.115666 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31787d5-19df-4084-a14b-b369cc946343 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:25.144286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31787d5-19df-4084-a14b-b369cc946343 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:25.151632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1074f-d046-41e0-9907-04813ba618e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:25.153266 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1074f-d046-41e0-9907-04813ba618e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:25.154028 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1074f-d046-41e0-9907-04813ba618e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:25.154773 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1074f-d046-41e0-9907-04813ba618e3 admin admin] PATH_INFO: `/v3/projects/a36998b2586d4eafa239fcee1022cdb1/users/c9bf6ee4c3904f6aa54da46469ef258f/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:25.206857 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1074f-d046-41e0-9907-04813ba618e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a36998b2586d4eafa239fcee1022cdb1, user_id=c9bf6ee4c3904f6aa54da46469ef258f, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:25.209667 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1074f-d046-41e0-9907-04813ba618e3 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:25.241723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 874/1749] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:25 2022] PUT /identity/v3/projects/a36998b2586d4eafa239fcee1022cdb1/users/c9bf6ee4c3904f6aa54da46469ef258f/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:25.253249 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac4c70-f2fe-437a-bc1f-8f841e4d4c57 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:25.253581 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac4c70-f2fe-437a-bc1f-8f841e4d4c57 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:25.254079 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac4c70-f2fe-437a-bc1f-8f841e4d4c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:25.313100 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-51ac4c70-f2fe-437a-bc1f-8f841e4d4c57 None None] MFA Rules not processed for user `c9bf6ee4c3904f6aa54da46469ef258f`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:25.316868 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-51ac4c70-f2fe-437a-bc1f-8f841e4d4c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:25.520035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 876/1750] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:25.520704 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8feb2-509f-4eb7-87ad-b8e4d3ac9516 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:25.520704 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8feb2-509f-4eb7-87ad-b8e4d3ac9516 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:25.520704 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8feb2-509f-4eb7-87ad-b8e4d3ac9516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:25.525790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac4c70-f2fe-437a-bc1f-8f841e4d4c57 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:25.589558 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-58f8feb2-509f-4eb7-87ad-b8e4d3ac9516 None None] MFA Rules not processed for user `ee036a5188e8459989184fa216cc79e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:25.591202 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-58f8feb2-509f-4eb7-87ad-b8e4d3ac9516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:25.655438 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:25.753103 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:25.769822 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 875/1751] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:04:25.782489 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac4c70-f2fe-437a-bc1f-8f841e4d4c57 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:25.818646 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b2be8-fe63-4796-a0ea-a15e5ac70bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:25.825526 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b2be8-fe63-4796-a0ea-a15e5ac70bbb admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:25.825977 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b2be8-fe63-4796-a0ea-a15e5ac70bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:25.826345 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b2be8-fe63-4796-a0ea-a15e5ac70bbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:25.829721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8feb2-509f-4eb7-87ad-b8e4d3ac9516 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:25.832215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-58f8feb2-509f-4eb7-87ad-b8e4d3ac9516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:25.832551 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b2be8-fe63-4796-a0ea-a15e5ac70bbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:25.834789 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b2be8-fe63-4796-a0ea-a15e5ac70bbb admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:26.001408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 877/1752] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:25 2022] POST /identity/v3/projects => generated 387 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:26.011549 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b2be8-fe63-4796-a0ea-a15e5ac70bbb admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:26.154387 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8feb2-509f-4eb7-87ad-b8e4d3ac9516 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:26.334513 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b2be8-fe63-4796-a0ea-a15e5ac70bbb admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:26.341729 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c0857-b0b8-406c-97fe-7b2ea3244434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:26.342997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c0857-b0b8-406c-97fe-7b2ea3244434 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:26.345229 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c0857-b0b8-406c-97fe-7b2ea3244434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:26.345779 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c0857-b0b8-406c-97fe-7b2ea3244434 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:26.348557 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c0857-b0b8-406c-97fe-7b2ea3244434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:26.351964 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c0857-b0b8-406c-97fe-7b2ea3244434 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:26.392274 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c258f-f8e9-4e99-bbb6-7be77c631fc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:26.392948 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c258f-f8e9-4e99-bbb6-7be77c631fc3 service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:26.393282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c258f-f8e9-4e99-bbb6-7be77c631fc3 service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:26.393732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c258f-f8e9-4e99-bbb6-7be77c631fc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:26.410400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 878/1753] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:26 2022] POST /identity/v3/users => generated 300 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:26.414071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b1c02-a389-4a86-97bb-279999e7bf35 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:26.414729 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b1c02-a389-4a86-97bb-279999e7bf35 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:26.415245 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b1c02-a389-4a86-97bb-279999e7bf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:26.479485 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-bd2b1c02-a389-4a86-97bb-279999e7bf35 None None] MFA Rules not processed for user `8cda12550db1442ab04f30b9875fdbea`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:26.494924 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-bd2b1c02-a389-4a86-97bb-279999e7bf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:26.617072 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c258f-f8e9-4e99-bbb6-7be77c631fc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:26.621805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c258f-f8e9-4e99-bbb6-7be77c631fc3 service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:26.653664 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 876/1754] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 825 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:26.656416 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c258f-f8e9-4e99-bbb6-7be77c631fc3 service nova] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:26.692628 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c258f-f8e9-4e99-bbb6-7be77c631fc3 service nova] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:26.714248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 879/1755] 10.222.0.27 () {58 vars in 1015 bytes} [Thu Jun 23 02:04:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:26.722105 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe4da4-96f6-47f5-8494-8ae325c1394c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:26.723147 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe4da4-96f6-47f5-8494-8ae325c1394c admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:26.723480 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe4da4-96f6-47f5-8494-8ae325c1394c admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:26.723740 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe4da4-96f6-47f5-8494-8ae325c1394c admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:26.724504 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe4da4-96f6-47f5-8494-8ae325c1394c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:26.726436 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe4da4-96f6-47f5-8494-8ae325c1394c admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:26.798347 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 877/1756] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:26.800711 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b1c02-a389-4a86-97bb-279999e7bf35 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:26.837839 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b1c02-a389-4a86-97bb-279999e7bf35 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:26.858844 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab5174-8775-44f8-8772-e91e12f9d72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:26.862016 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab5174-8775-44f8-8772-e91e12f9d72e admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:26.862971 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab5174-8775-44f8-8772-e91e12f9d72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:26.863605 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab5174-8775-44f8-8772-e91e12f9d72e admin admin] PATH_INFO: `/v3/projects/ded983caad0d438ab60758f400f1978f/users/96d7c470c9be4ab29ff2e891f115dc56/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:26.931026 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab5174-8775-44f8-8772-e91e12f9d72e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded983caad0d438ab60758f400f1978f, user_id=96d7c470c9be4ab29ff2e891f115dc56, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:26.938104 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab5174-8775-44f8-8772-e91e12f9d72e admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:26.986657 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 880/1757] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:26 2022] PUT /identity/v3/projects/ded983caad0d438ab60758f400f1978f/users/96d7c470c9be4ab29ff2e891f115dc56/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:26.988261 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe4da4-96f6-47f5-8494-8ae325c1394c admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:26.996314 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab5174-8775-44f8-8772-e91e12f9d72e admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:27.022564 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe4da4-96f6-47f5-8494-8ae325c1394c admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:27.097290 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:27.127766 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:27.150177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab5174-8775-44f8-8772-e91e12f9d72e admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:27.161533 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170e643-dc7d-423d-abcc-18b419afedc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:27.162384 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170e643-dc7d-423d-abcc-18b419afedc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:27.165615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170e643-dc7d-423d-abcc-18b419afedc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:27.166028 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170e643-dc7d-423d-abcc-18b419afedc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:27.182786 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0170e643-dc7d-423d-abcc-18b419afedc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:27.184518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0170e643-dc7d-423d-abcc-18b419afedc0 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:27.212749 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 881/1758] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:27.214386 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1fd9f-89ff-4f37-a7e4-cc973ae2b02c None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:27.227659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1fd9f-89ff-4f37-a7e4-cc973ae2b02c None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:27.235960 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1fd9f-89ff-4f37-a7e4-cc973ae2b02c None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:27.242121 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 882/1759] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 23 02:04:27 2022] GET /identity => generated 270 bytes in 27 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 02:04:27.243998 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e24250-a53f-4cbe-806e-e10470d549e3 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:27.247096 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e24250-a53f-4cbe-806e-e10470d549e3 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:27.247712 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e24250-a53f-4cbe-806e-e10470d549e3 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:27.250638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 883/1760] 10.222.0.13 () {54 vars in 912 bytes} [Thu Jun 23 02:04:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 02:04:27.264315 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed751b-96cd-4260-a081-10d37ad946c8 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:27.266230 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed751b-96cd-4260-a081-10d37ad946c8 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:27.266623 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed751b-96cd-4260-a081-10d37ad946c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:27.298978 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e50542-b701-482e-9071-f46a25cc5cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:27.300829 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e50542-b701-482e-9071-f46a25cc5cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:27.301253 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e50542-b701-482e-9071-f46a25cc5cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:27.301680 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e50542-b701-482e-9071-f46a25cc5cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:27.302611 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e50542-b701-482e-9071-f46a25cc5cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:27.304491 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e50542-b701-482e-9071-f46a25cc5cf7 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:27.314463 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-72ed751b-96cd-4260-a081-10d37ad946c8 None None] MFA Rules not processed for user `8cda12550db1442ab04f30b9875fdbea`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:27.316135 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-72ed751b-96cd-4260-a081-10d37ad946c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:27.337749 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 884/1762] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 02:04:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:04:27.337959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 878/1762] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:27.339316 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31df32-af52-4f35-aca4-8bb8ba82e473 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:27.340558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31df32-af52-4f35-aca4-8bb8ba82e473 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:27.341056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31df32-af52-4f35-aca4-8bb8ba82e473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:27.342089 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e50542-b701-482e-9071-f46a25cc5cf7 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:27.368257 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e50542-b701-482e-9071-f46a25cc5cf7 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:27.378128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beccda2-e4ef-45b7-8460-c78882bd1319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:27.379357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beccda2-e4ef-45b7-8460-c78882bd1319 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:27.379841 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beccda2-e4ef-45b7-8460-c78882bd1319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:27.380265 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beccda2-e4ef-45b7-8460-c78882bd1319 admin admin] PATH_INFO: `/v3/projects/ded983caad0d438ab60758f400f1978f/users/96d7c470c9be4ab29ff2e891f115dc56/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:27.384383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beccda2-e4ef-45b7-8460-c78882bd1319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded983caad0d438ab60758f400f1978f, user_id=96d7c470c9be4ab29ff2e891f115dc56, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:27.384547 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-9f31df32-af52-4f35-aca4-8bb8ba82e473 None None] MFA Rules not processed for user `9756f5b9de8a4f23b365a96d309d86ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:27.387947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-9f31df32-af52-4f35-aca4-8bb8ba82e473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:27.390310 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beccda2-e4ef-45b7-8460-c78882bd1319 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:27.424597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 879/1763] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:27 2022] PUT /identity/v3/projects/ded983caad0d438ab60758f400f1978f/users/96d7c470c9be4ab29ff2e891f115dc56/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:27.426422 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beccda2-e4ef-45b7-8460-c78882bd1319 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:27.530489 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 885/1764] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 23 02:04:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:27.535522 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd237e4c-3994-48a1-91f3-53b247e4d61e None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:27.535831 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd237e4c-3994-48a1-91f3-53b247e4d61e None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:27.536121 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd237e4c-3994-48a1-91f3-53b247e4d61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:27.611664 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-dd237e4c-3994-48a1-91f3-53b247e4d61e None None] MFA Rules not processed for user `96d7c470c9be4ab29ff2e891f115dc56`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:27.614149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-dd237e4c-3994-48a1-91f3-53b247e4d61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:27.634064 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beccda2-e4ef-45b7-8460-c78882bd1319 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:27.641876 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09933bb1-d196-4d01-8a21-4b963e34da7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:27.645043 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09933bb1-d196-4d01-8a21-4b963e34da7b service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:27.645507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09933bb1-d196-4d01-8a21-4b963e34da7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:27.645926 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09933bb1-d196-4d01-8a21-4b963e34da7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:27.703267 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09933bb1-d196-4d01-8a21-4b963e34da7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:27.709307 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09933bb1-d196-4d01-8a21-4b963e34da7b service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:27.733052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 880/1765] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:27.763341 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 886/1766] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:27.776174 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09933bb1-d196-4d01-8a21-4b963e34da7b service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:27.777680 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-09933bb1-d196-4d01-8a21-4b963e34da7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:27.811518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd237e4c-3994-48a1-91f3-53b247e4d61e None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:27.813231 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-dd237e4c-3994-48a1-91f3-53b247e4d61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:27.961416 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:27.998098 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09933bb1-d196-4d01-8a21-4b963e34da7b service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:28.006230 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd237e4c-3994-48a1-91f3-53b247e4d61e None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:28.017579 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d6079-74e3-4c79-a89d-f861612ead74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:28.018330 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d6079-74e3-4c79-a89d-f861612ead74 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:28.018541 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d6079-74e3-4c79-a89d-f861612ead74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:28.018820 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d6079-74e3-4c79-a89d-f861612ead74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:28.026024 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa8312-9877-4a85-aee1-084de41df723 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9756f5b9de8a4f23b365a96d309d86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:28.028371 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa8312-9877-4a85-aee1-084de41df723 service placement] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:28.028873 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa8312-9877-4a85-aee1-084de41df723 service placement] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:28.030241 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa8312-9877-4a85-aee1-084de41df723 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:28.060491 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa8312-9877-4a85-aee1-084de41df723 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:28.063628 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa8312-9877-4a85-aee1-084de41df723 service placement] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:28.071881 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d6079-74e3-4c79-a89d-f861612ead74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:28.081667 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d6079-74e3-4c79-a89d-f861612ead74 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:28.117646 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 887/1767] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:28.134412 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 881/1768] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:29.157988 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa8312-9877-4a85-aee1-084de41df723 service placement] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:29.159484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5baa8312-9877-4a85-aee1-084de41df723 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:29.446317 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa8312-9877-4a85-aee1-084de41df723 service placement] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:29.463090 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168a7ce-0037-44ee-9b98-ef01a2a4b16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:29.464232 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168a7ce-0037-44ee-9b98-ef01a2a4b16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:29.464518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168a7ce-0037-44ee-9b98-ef01a2a4b16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:29.464922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168a7ce-0037-44ee-9b98-ef01a2a4b16e admin admin] PATH_INFO: `/v3/projects/2daec9a8f0f5448487329a754bdf7a30` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:29.466200 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168a7ce-0037-44ee-9b98-ef01a2a4b16e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2daec9a8f0f5448487329a754bdf7a30)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:29.468235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168a7ce-0037-44ee-9b98-ef01a2a4b16e admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:29.596973 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d6079-74e3-4c79-a89d-f861612ead74 service cinder] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:29.625060 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d6079-74e3-4c79-a89d-f861612ead74 service cinder] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:29.653182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e168a7ce-0037-44ee-9b98-ef01a2a4b16e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2daec9a8f0f5448487329a754bdf7a30', 'request_id': 'req-e168a7ce-0037-44ee-9b98-ef01a2a4b16e'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:29.668242 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e168a7ce-0037-44ee-9b98-ef01a2a4b16e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2daec9a8f0f5448487329a754bdf7a30', 'request_id': 'req-e168a7ce-0037-44ee-9b98-ef01a2a4b16e'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:29.683403 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e168a7ce-0037-44ee-9b98-ef01a2a4b16e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2daec9a8f0f5448487329a754bdf7a30', 'request_id': 'req-e168a7ce-0037-44ee-9b98-ef01a2a4b16e'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:29.705017 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e168a7ce-0037-44ee-9b98-ef01a2a4b16e admin admin] The token cache is being invalidate because project 2daec9a8f0f5448487329a754bdf7a30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:04:29.706069 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e168a7ce-0037-44ee-9b98-ef01a2a4b16e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:29.711654 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e168a7ce-0037-44ee-9b98-ef01a2a4b16e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:29.713881 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 888/1769] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:04:29 2022] DELETE /identity/v3/projects/2daec9a8f0f5448487329a754bdf7a30 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:29.718157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168a7ce-0037-44ee-9b98-ef01a2a4b16e admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:29.723087 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-e168a7ce-0037-44ee-9b98-ef01a2a4b16e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:29.807333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711e366-b992-4eca-99b8-d35bc533813f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:29.816045 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711e366-b992-4eca-99b8-d35bc533813f service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:29.817981 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711e366-b992-4eca-99b8-d35bc533813f service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:29.819789 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711e366-b992-4eca-99b8-d35bc533813f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:29.828148 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-3711e366-b992-4eca-99b8-d35bc533813f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:29.864478 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:29.934041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168a7ce-0037-44ee-9b98-ef01a2a4b16e admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:29.947302 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789a082-fc88-4179-942f-d71ccbada398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:29.948264 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789a082-fc88-4179-942f-d71ccbada398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:29.948614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789a082-fc88-4179-942f-d71ccbada398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:29.948837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789a082-fc88-4179-942f-d71ccbada398 admin admin] PATH_INFO: `/v3/users/ea0107206bb8447db378704781e8e7bd` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:29.950208 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789a082-fc88-4179-942f-d71ccbada398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea0107206bb8447db378704781e8e7bd)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:29.952373 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789a082-fc88-4179-942f-d71ccbada398 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:29.976363 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:30.049815 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711e366-b992-4eca-99b8-d35bc533813f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:30.051315 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711e366-b992-4eca-99b8-d35bc533813f service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:30.078452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f789a082-fc88-4179-942f-d71ccbada398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea0107206bb8447db378704781e8e7bd'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:30.085556 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 882/1770] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:30.099701 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f789a082-fc88-4179-942f-d71ccbada398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea0107206bb8447db378704781e8e7bd'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:30.100724 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f789a082-fc88-4179-942f-d71ccbada398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea0107206bb8447db378704781e8e7bd'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:30.101318 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f789a082-fc88-4179-942f-d71ccbada398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea0107206bb8447db378704781e8e7bd'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:30.141040 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f789a082-fc88-4179-942f-d71ccbada398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea0107206bb8447db378704781e8e7bd'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:30.203365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 889/1771] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:04:29 2022] DELETE /identity/v3/users/ea0107206bb8447db378704781e8e7bd => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:31.960075 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711e366-b992-4eca-99b8-d35bc533813f service cinder] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:31.961707 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-3711e366-b992-4eca-99b8-d35bc533813f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:32.028191 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711e366-b992-4eca-99b8-d35bc533813f service cinder] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:32.332317 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cd424-434d-4629-957d-0f6d4c4bed03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:32.338485 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cd424-434d-4629-957d-0f6d4c4bed03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:32.340178 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cd424-434d-4629-957d-0f6d4c4bed03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:32.340491 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cd424-434d-4629-957d-0f6d4c4bed03 admin admin] PATH_INFO: `/v3/users/5c881959a8094f77a0100c9023e75228` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:32.345987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cd424-434d-4629-957d-0f6d4c4bed03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c881959a8094f77a0100c9023e75228)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:32.357838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cd424-434d-4629-957d-0f6d4c4bed03 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:32.598151 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-4e5cd424-434d-4629-957d-0f6d4c4bed03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c881959a8094f77a0100c9023e75228'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:32.645669 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-4e5cd424-434d-4629-957d-0f6d4c4bed03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c881959a8094f77a0100c9023e75228'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:32.693773 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-4e5cd424-434d-4629-957d-0f6d4c4bed03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c881959a8094f77a0100c9023e75228'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:32.696348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-4e5cd424-434d-4629-957d-0f6d4c4bed03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c881959a8094f77a0100c9023e75228'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:32.724097 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-4e5cd424-434d-4629-957d-0f6d4c4bed03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c881959a8094f77a0100c9023e75228'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:32.754974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 883/1772] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:04:31 2022] DELETE /identity/v3/users/5c881959a8094f77a0100c9023e75228 => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:33.340279 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789a082-fc88-4179-942f-d71ccbada398 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:33.342039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-f789a082-fc88-4179-942f-d71ccbada398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:33.404671 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790928cc-afc9-4943-b9e6-6c87d5241b96 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:33.405218 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790928cc-afc9-4943-b9e6-6c87d5241b96 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:33.405218 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790928cc-afc9-4943-b9e6-6c87d5241b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:33.426065 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789a082-fc88-4179-942f-d71ccbada398 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:33.529515 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-790928cc-afc9-4943-b9e6-6c87d5241b96 None None] MFA Rules not processed for user `042853e4abce41f9a3e8263d1fc8ac00`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:33.530648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-790928cc-afc9-4943-b9e6-6c87d5241b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:33.581521 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:33.691021 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf98b0-a9f4-4bfe-95b6-77b41a15feea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:33.692194 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf98b0-a9f4-4bfe-95b6-77b41a15feea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:33.695796 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf98b0-a9f4-4bfe-95b6-77b41a15feea admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:33.696287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf98b0-a9f4-4bfe-95b6-77b41a15feea admin admin] PATH_INFO: `/v3/projects/58ff16d4ca004601b5ed4b7b3c5eea30` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:33.701409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf98b0-a9f4-4bfe-95b6-77b41a15feea admin admin] RBAC: Authorizing `identity:delete_project(project_id=58ff16d4ca004601b5ed4b7b3c5eea30)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:33.709189 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf98b0-a9f4-4bfe-95b6-77b41a15feea admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:33.836415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 884/1773] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:33.837474 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790928cc-afc9-4943-b9e6-6c87d5241b96 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:33.848033 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-790928cc-afc9-4943-b9e6-6c87d5241b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:33.959706 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-56cf98b0-a9f4-4bfe-95b6-77b41a15feea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58ff16d4ca004601b5ed4b7b3c5eea30', 'request_id': 'req-56cf98b0-a9f4-4bfe-95b6-77b41a15feea'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:33.980600 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-56cf98b0-a9f4-4bfe-95b6-77b41a15feea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58ff16d4ca004601b5ed4b7b3c5eea30', 'request_id': 'req-56cf98b0-a9f4-4bfe-95b6-77b41a15feea'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:34.000083 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-56cf98b0-a9f4-4bfe-95b6-77b41a15feea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58ff16d4ca004601b5ed4b7b3c5eea30', 'request_id': 'req-56cf98b0-a9f4-4bfe-95b6-77b41a15feea'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:34.029005 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-56cf98b0-a9f4-4bfe-95b6-77b41a15feea admin admin] The token cache is being invalidate because project 58ff16d4ca004601b5ed4b7b3c5eea30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:04:34.031066 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-56cf98b0-a9f4-4bfe-95b6-77b41a15feea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:34.034356 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-56cf98b0-a9f4-4bfe-95b6-77b41a15feea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:34.040115 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 890/1774] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:04:33 2022] DELETE /identity/v3/projects/58ff16d4ca004601b5ed4b7b3c5eea30 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:04:34.046248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f27e1-8256-4448-989f-7e2d056c766c None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:34.046747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f27e1-8256-4448-989f-7e2d056c766c None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:34.048793 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f27e1-8256-4448-989f-7e2d056c766c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:34.106423 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-585f27e1-8256-4448-989f-7e2d056c766c None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:34.113228 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-585f27e1-8256-4448-989f-7e2d056c766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:34.157887 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:34.182744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790928cc-afc9-4943-b9e6-6c87d5241b96 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:34.383277 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237adcc-afc2-4174-87fe-9f1dd57c6cf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:34.384423 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237adcc-afc2-4174-87fe-9f1dd57c6cf1 service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:34.384875 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237adcc-afc2-4174-87fe-9f1dd57c6cf1 service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:34.385461 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237adcc-afc2-4174-87fe-9f1dd57c6cf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:34.393628 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 891/1775] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:34.395257 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a12ab3-2aca-41ec-85d4-f766fedcb876 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:34.402014 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a12ab3-2aca-41ec-85d4-f766fedcb876 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:34.402303 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a12ab3-2aca-41ec-85d4-f766fedcb876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:34.404389 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-b237adcc-afc2-4174-87fe-9f1dd57c6cf1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:34.488642 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-77a12ab3-2aca-41ec-85d4-f766fedcb876 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:34.494522 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-77a12ab3-2aca-41ec-85d4-f766fedcb876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:34.531651 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 892/1776] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:34.540486 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a12ab3-2aca-41ec-85d4-f766fedcb876 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:34.558187 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:34.581552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a12ab3-2aca-41ec-85d4-f766fedcb876 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:34.597916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237adcc-afc2-4174-87fe-9f1dd57c6cf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:34.599611 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc46a4e-2371-4f15-98ba-d4084fc13e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:34.600520 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc46a4e-2371-4f15-98ba-d4084fc13e2d admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:34.600933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237adcc-afc2-4174-87fe-9f1dd57c6cf1 service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:34.601383 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc46a4e-2371-4f15-98ba-d4084fc13e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:34.606751 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc46a4e-2371-4f15-98ba-d4084fc13e2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:34.607887 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc46a4e-2371-4f15-98ba-d4084fc13e2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:04:34.609544 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc46a4e-2371-4f15-98ba-d4084fc13e2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:34.617085 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc46a4e-2371-4f15-98ba-d4084fc13e2d admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:34.666068 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 893/1777] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 02:04:34.681608 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc46a4e-2371-4f15-98ba-d4084fc13e2d admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:34.699026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 885/1778] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 862 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:34.713846 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc46a4e-2371-4f15-98ba-d4084fc13e2d admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:34.739136 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dd805-ebc0-4a45-89d1-a36a81c41a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:34.740116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dd805-ebc0-4a45-89d1-a36a81c41a78 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:34.740550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dd805-ebc0-4a45-89d1-a36a81c41a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:34.741812 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dd805-ebc0-4a45-89d1-a36a81c41a78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:34.742711 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120dd805-ebc0-4a45-89d1-a36a81c41a78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:34.746870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120dd805-ebc0-4a45-89d1-a36a81c41a78 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:34.846346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237adcc-afc2-4174-87fe-9f1dd57c6cf1 service nova] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:34.847620 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 894/1779] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:34 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:34.911457 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237adcc-afc2-4174-87fe-9f1dd57c6cf1 service nova] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:35.261117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288a079-5039-4bfb-8182-a228b37f6daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:35.261915 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288a079-5039-4bfb-8182-a228b37f6daa admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:35.262225 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288a079-5039-4bfb-8182-a228b37f6daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:35.262575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288a079-5039-4bfb-8182-a228b37f6daa admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:35.263447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288a079-5039-4bfb-8182-a228b37f6daa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:35.265433 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288a079-5039-4bfb-8182-a228b37f6daa admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:35.297276 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e130c5c-dd31-4a02-863c-6826580fc315 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:35.297276 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e130c5c-dd31-4a02-863c-6826580fc315 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:35.297276 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e130c5c-dd31-4a02-863c-6826580fc315 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:35.297276 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 895/1780] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 23 02:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 02:04:35.322419 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 886/1781] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:34 2022] POST /identity/v3/users => generated 292 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:04:35.325962 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e130c5c-dd31-4a02-863c-6826580fc315 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:35.349374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e130c5c-dd31-4a02-863c-6826580fc315 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:35.379843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8844af-2e72-4089-8bf6-22cdd71bb788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:35.384638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8844af-2e72-4089-8bf6-22cdd71bb788 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:35.384957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8844af-2e72-4089-8bf6-22cdd71bb788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:35.385243 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8844af-2e72-4089-8bf6-22cdd71bb788 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:35.390368 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8844af-2e72-4089-8bf6-22cdd71bb788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:35.393855 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8844af-2e72-4089-8bf6-22cdd71bb788 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:35.433287 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bcd04-55ed-4d57-958c-d17eb1ac9c1e None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:35.433965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bcd04-55ed-4d57-958c-d17eb1ac9c1e None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:35.434505 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bcd04-55ed-4d57-958c-d17eb1ac9c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:35.491549 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 896/1782] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:35.492792 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8844af-2e72-4089-8bf6-22cdd71bb788 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:35.528847 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8844af-2e72-4089-8bf6-22cdd71bb788 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:35.536651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-a01bcd04-55ed-4d57-958c-d17eb1ac9c1e None None] MFA Rules not processed for user `9d3b5180fb7144c394c39d4db28713b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:35.538092 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a01bcd04-55ed-4d57-958c-d17eb1ac9c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:35.556313 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277a2fd-06ab-42d7-9033-2a35f079af96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:35.557048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277a2fd-06ab-42d7-9033-2a35f079af96 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:35.557333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277a2fd-06ab-42d7-9033-2a35f079af96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:35.557608 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277a2fd-06ab-42d7-9033-2a35f079af96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:35.558359 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277a2fd-06ab-42d7-9033-2a35f079af96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:35.562620 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277a2fd-06ab-42d7-9033-2a35f079af96 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:35.605257 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 897/1783] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:35.610153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277a2fd-06ab-42d7-9033-2a35f079af96 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:35.659848 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277a2fd-06ab-42d7-9033-2a35f079af96 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:35.676429 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33a54d-40ee-4498-bb55-4cc1c6061583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:35.677745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33a54d-40ee-4498-bb55-4cc1c6061583 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:35.678306 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33a54d-40ee-4498-bb55-4cc1c6061583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:35.678874 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33a54d-40ee-4498-bb55-4cc1c6061583 admin admin] PATH_INFO: `/v3/projects/d6e576aa42e14a0d9e8616ab705ba44c/users/aabe5e5277f24a5b8ceec819ee1a0a43/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:35.746927 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 887/1784] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 23 02:04:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 23 02:04:35.749497 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bcd04-55ed-4d57-958c-d17eb1ac9c1e None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:35.749989 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33a54d-40ee-4498-bb55-4cc1c6061583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e576aa42e14a0d9e8616ab705ba44c, user_id=aabe5e5277f24a5b8ceec819ee1a0a43, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:35.753527 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33a54d-40ee-4498-bb55-4cc1c6061583 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:35.754534 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a01bcd04-55ed-4d57-958c-d17eb1ac9c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:35.803879 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 898/1785] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:35 2022] PUT /identity/v3/projects/d6e576aa42e14a0d9e8616ab705ba44c/users/aabe5e5277f24a5b8ceec819ee1a0a43/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:35.806641 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33a54d-40ee-4498-bb55-4cc1c6061583 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:35.814372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5e33a54d-40ee-4498-bb55-4cc1c6061583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:35.951483 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bcd04-55ed-4d57-958c-d17eb1ac9c1e None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:36.035805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:36.051781 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33a54d-40ee-4498-bb55-4cc1c6061583 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:36.074667 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7a6e6-99ff-4877-9497-628a676e7070 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:36.075790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7a6e6-99ff-4877-9497-628a676e7070 service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:36.076184 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7a6e6-99ff-4877-9497-628a676e7070 service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:36.076516 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7a6e6-99ff-4877-9497-628a676e7070 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:36.102884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81943e-1067-4320-a144-18475886d594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:36.103657 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81943e-1067-4320-a144-18475886d594 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:36.103942 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81943e-1067-4320-a144-18475886d594 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:36.104224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81943e-1067-4320-a144-18475886d594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:36.108734 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-1c81943e-1067-4320-a144-18475886d594 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:36.122799 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7a6e6-99ff-4877-9497-628a676e7070 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:36.124782 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7a6e6-99ff-4877-9497-628a676e7070 service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:36.182855 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 899/1786] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:36.185031 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daca350-9358-43b7-b858-b01b4b621214 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:36.185365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daca350-9358-43b7-b858-b01b4b621214 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:36.185717 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daca350-9358-43b7-b858-b01b4b621214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:36.267321 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-7daca350-9358-43b7-b858-b01b4b621214 None None] MFA Rules not processed for user `aabe5e5277f24a5b8ceec819ee1a0a43`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:36.269011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-7daca350-9358-43b7-b858-b01b4b621214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:36.282112 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:36.317571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81943e-1067-4320-a144-18475886d594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:36.319102 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81943e-1067-4320-a144-18475886d594 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:36.350969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 888/1787] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:36.653555 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 900/1788] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:36.656565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81943e-1067-4320-a144-18475886d594 service cinder] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:36.927446 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81943e-1067-4320-a144-18475886d594 service cinder] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:36.943293 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a1362-d020-4e0e-bd7c-9513b4193250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:36.944115 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a1362-d020-4e0e-bd7c-9513b4193250 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:36.944459 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a1362-d020-4e0e-bd7c-9513b4193250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:36.944915 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a1362-d020-4e0e-bd7c-9513b4193250 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:36.945596 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a1362-d020-4e0e-bd7c-9513b4193250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:36.956106 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a1362-d020-4e0e-bd7c-9513b4193250 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:37.050095 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 889/1789] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:36 2022] POST /identity/v3/projects => generated 385 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:37.053719 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daca350-9358-43b7-b858-b01b4b621214 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:37.079654 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daca350-9358-43b7-b858-b01b4b621214 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:37.328743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7281d-5df9-4ac2-811c-a500a7770acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:37.328967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7281d-5df9-4ac2-811c-a500a7770acf admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:37.329270 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7281d-5df9-4ac2-811c-a500a7770acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:37.329544 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7281d-5df9-4ac2-811c-a500a7770acf admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:37.330259 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7281d-5df9-4ac2-811c-a500a7770acf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:37.338418 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7281d-5df9-4ac2-811c-a500a7770acf admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:37.405684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 901/1790] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:37 2022] POST /identity/v3/users => generated 299 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:37.407351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a1362-d020-4e0e-bd7c-9513b4193250 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:37.419500 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7281d-5df9-4ac2-811c-a500a7770acf admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:37.422535 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-c9d7281d-5df9-4ac2-811c-a500a7770acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:37.433469 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a1362-d020-4e0e-bd7c-9513b4193250 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:37.451926 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436cf1b3-02ab-405a-87c9-7095c8488966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:37.457490 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cf1b3-02ab-405a-87c9-7095c8488966 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:37.460003 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cf1b3-02ab-405a-87c9-7095c8488966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:37.460292 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cf1b3-02ab-405a-87c9-7095c8488966 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:37.461152 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436cf1b3-02ab-405a-87c9-7095c8488966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:37.462835 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436cf1b3-02ab-405a-87c9-7095c8488966 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:37.467476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7281d-5df9-4ac2-811c-a500a7770acf admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:37.507764 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479718f-8a4e-4c79-991b-2f2d750ba9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:37.511171 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479718f-8a4e-4c79-991b-2f2d750ba9b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:37.512712 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 890/1791] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:37.517491 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479718f-8a4e-4c79-991b-2f2d750ba9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:37.517836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479718f-8a4e-4c79-991b-2f2d750ba9b1 admin admin] PATH_INFO: `/v3/projects/af81bbf5f1994b1dbdf6110e8eeaf81c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:37.520241 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436cf1b3-02ab-405a-87c9-7095c8488966 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:37.525442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479718f-8a4e-4c79-991b-2f2d750ba9b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af81bbf5f1994b1dbdf6110e8eeaf81c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:37.533487 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479718f-8a4e-4c79-991b-2f2d750ba9b1 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:37.592238 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436cf1b3-02ab-405a-87c9-7095c8488966 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:37.625302 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2d7b9-dcc6-47e5-9775-86fb846b3474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:37.630411 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2d7b9-dcc6-47e5-9775-86fb846b3474 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:37.630755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2d7b9-dcc6-47e5-9775-86fb846b3474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:37.631219 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2d7b9-dcc6-47e5-9775-86fb846b3474 admin admin] PATH_INFO: `/v3/projects/c7011974a85243b8a66da853a738d841/users/4caae498c9f04e9c80e4fb24cc5d8faa/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:37.705917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2d7b9-dcc6-47e5-9775-86fb846b3474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7011974a85243b8a66da853a738d841, user_id=4caae498c9f04e9c80e4fb24cc5d8faa, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:37.720051 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2d7b9-dcc6-47e5-9775-86fb846b3474 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:37.750087 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e479718f-8a4e-4c79-991b-2f2d750ba9b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af81bbf5f1994b1dbdf6110e8eeaf81c', 'request_id': 'req-e479718f-8a4e-4c79-991b-2f2d750ba9b1'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:37.761465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 891/1792] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:37 2022] PUT /identity/v3/projects/c7011974a85243b8a66da853a738d841/users/4caae498c9f04e9c80e4fb24cc5d8faa/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:37.765472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2d7b9-dcc6-47e5-9775-86fb846b3474 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:37.777576 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e479718f-8a4e-4c79-991b-2f2d750ba9b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af81bbf5f1994b1dbdf6110e8eeaf81c', 'request_id': 'req-e479718f-8a4e-4c79-991b-2f2d750ba9b1'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:37.807492 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e479718f-8a4e-4c79-991b-2f2d750ba9b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af81bbf5f1994b1dbdf6110e8eeaf81c', 'request_id': 'req-e479718f-8a4e-4c79-991b-2f2d750ba9b1'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:37.842362 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e479718f-8a4e-4c79-991b-2f2d750ba9b1 admin admin] The token cache is being invalidate because project af81bbf5f1994b1dbdf6110e8eeaf81c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:04:37.842656 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e479718f-8a4e-4c79-991b-2f2d750ba9b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:37.850684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e479718f-8a4e-4c79-991b-2f2d750ba9b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:37.863129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 902/1793] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:04:37 2022] DELETE /identity/v3/projects/af81bbf5f1994b1dbdf6110e8eeaf81c => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:37.864322 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479718f-8a4e-4c79-991b-2f2d750ba9b1 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:37.869379 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-e479718f-8a4e-4c79-991b-2f2d750ba9b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:37.936742 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:37.969732 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:38.015477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2d7b9-dcc6-47e5-9775-86fb846b3474 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:38.038984 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64833c4-ab52-48be-91b5-9acd07924aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:38.041893 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64833c4-ab52-48be-91b5-9acd07924aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:38.042181 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64833c4-ab52-48be-91b5-9acd07924aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:38.042460 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64833c4-ab52-48be-91b5-9acd07924aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:38.043837 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64833c4-ab52-48be-91b5-9acd07924aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:38.062188 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64833c4-ab52-48be-91b5-9acd07924aa6 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:38.100224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 892/1794] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:38.101217 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64833c4-ab52-48be-91b5-9acd07924aa6 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:38.105226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-e64833c4-ab52-48be-91b5-9acd07924aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:38.120548 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479718f-8a4e-4c79-991b-2f2d750ba9b1 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:38.145433 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd4d97-3f22-48b2-bca3-35b047ee90a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:38.148304 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd4d97-3f22-48b2-bca3-35b047ee90a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:38.148639 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd4d97-3f22-48b2-bca3-35b047ee90a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:38.148875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd4d97-3f22-48b2-bca3-35b047ee90a4 admin admin] PATH_INFO: `/v3/users/e41531e528254c27ba7e0cb48a3851dd` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:38.157840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd4d97-3f22-48b2-bca3-35b047ee90a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e41531e528254c27ba7e0cb48a3851dd)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:38.160616 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd4d97-3f22-48b2-bca3-35b047ee90a4 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:38.163732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64833c4-ab52-48be-91b5-9acd07924aa6 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:38.182244 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2afa8-9081-444b-9b5d-80ffb133bb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:38.183181 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2afa8-9081-444b-9b5d-80ffb133bb12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:38.183553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2afa8-9081-444b-9b5d-80ffb133bb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:38.186037 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2afa8-9081-444b-9b5d-80ffb133bb12 admin admin] PATH_INFO: `/v3/projects/c7011974a85243b8a66da853a738d841/users/4caae498c9f04e9c80e4fb24cc5d8faa/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:38.205146 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2afa8-9081-444b-9b5d-80ffb133bb12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7011974a85243b8a66da853a738d841, user_id=4caae498c9f04e9c80e4fb24cc5d8faa, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:38.216416 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2afa8-9081-444b-9b5d-80ffb133bb12 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:38.306877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 893/1795] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:38 2022] PUT /identity/v3/projects/c7011974a85243b8a66da853a738d841/users/4caae498c9f04e9c80e4fb24cc5d8faa/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:38.306877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a3d9e-657d-43c7-937b-db77a5eded54 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:38.306877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a3d9e-657d-43c7-937b-db77a5eded54 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:38.306877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a3d9e-657d-43c7-937b-db77a5eded54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:38.356085 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-2cfd4d97-3f22-48b2-bca3-35b047ee90a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e41531e528254c27ba7e0cb48a3851dd'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:38.377056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-2cfd4d97-3f22-48b2-bca3-35b047ee90a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e41531e528254c27ba7e0cb48a3851dd'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:38.379179 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-2cfd4d97-3f22-48b2-bca3-35b047ee90a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e41531e528254c27ba7e0cb48a3851dd'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:38.380714 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-2cfd4d97-3f22-48b2-bca3-35b047ee90a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e41531e528254c27ba7e0cb48a3851dd'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:38.409003 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-ff2a3d9e-657d-43c7-937b-db77a5eded54 None None] MFA Rules not processed for user `4caae498c9f04e9c80e4fb24cc5d8faa`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:38.411613 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-ff2a3d9e-657d-43c7-937b-db77a5eded54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:38.444354 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-2cfd4d97-3f22-48b2-bca3-35b047ee90a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e41531e528254c27ba7e0cb48a3851dd'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:38.492583 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 903/1796] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:04:37 2022] DELETE /identity/v3/users/e41531e528254c27ba7e0cb48a3851dd => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:38.605990 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd4d97-3f22-48b2-bca3-35b047ee90a4 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:38.607822 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 894/1797] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:38.608738 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-2cfd4d97-3f22-48b2-bca3-35b047ee90a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:38.774788 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd4d97-3f22-48b2-bca3-35b047ee90a4 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:38.779061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00df573-89ac-4233-9717-5bd23b916d03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:38.780361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00df573-89ac-4233-9717-5bd23b916d03 service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:38.780361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00df573-89ac-4233-9717-5bd23b916d03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:38.780749 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00df573-89ac-4233-9717-5bd23b916d03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:38.838455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:38.861127 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00df573-89ac-4233-9717-5bd23b916d03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:38.877797 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00df573-89ac-4233-9717-5bd23b916d03 service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:38.911261 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 904/1798] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:39.018958 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3596c2-afdf-4a2b-a7fc-a0065fd76ce4 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:39.019611 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3596c2-afdf-4a2b-a7fc-a0065fd76ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:39.019907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3596c2-afdf-4a2b-a7fc-a0065fd76ce4 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:39.022122 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 895/1799] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 23 02:04:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 02:04:39.105819 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762fe2d-1c89-416e-92b0-94899bbced70 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:39.106410 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762fe2d-1c89-416e-92b0-94899bbced70 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:39.106886 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762fe2d-1c89-416e-92b0-94899bbced70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:39.160660 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-9762fe2d-1c89-416e-92b0-94899bbced70 None None] MFA Rules not processed for user `9d3b5180fb7144c394c39d4db28713b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:39.163585 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-9762fe2d-1c89-416e-92b0-94899bbced70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:39.404445 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 905/1800] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 23 02:04:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:39.443242 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3596c2-afdf-4a2b-a7fc-a0065fd76ce4 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:39.447906 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-5d3596c2-afdf-4a2b-a7fc-a0065fd76ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:39.500771 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3596c2-afdf-4a2b-a7fc-a0065fd76ce4 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:39.512743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583148b-4685-4c6b-9d30-d2a8c26e9845 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:39.513554 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583148b-4685-4c6b-9d30-d2a8c26e9845 service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:39.513900 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583148b-4685-4c6b-9d30-d2a8c26e9845 service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:39.514241 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583148b-4685-4c6b-9d30-d2a8c26e9845 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:39.552005 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583148b-4685-4c6b-9d30-d2a8c26e9845 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:39.553830 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583148b-4685-4c6b-9d30-d2a8c26e9845 service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:39.571285 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 896/1801] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:39.864695 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279ff89-ac3b-4f4d-a11d-1d59e90ddbb8 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:39.865751 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279ff89-ac3b-4f4d-a11d-1d59e90ddbb8 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:39.866276 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279ff89-ac3b-4f4d-a11d-1d59e90ddbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:39.882993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583148b-4685-4c6b-9d30-d2a8c26e9845 service nova] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:39.884485 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-d583148b-4685-4c6b-9d30-d2a8c26e9845 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:39.929925 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-0279ff89-ac3b-4f4d-a11d-1d59e90ddbb8 None None] MFA Rules not processed for user `ee036a5188e8459989184fa216cc79e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:39.933362 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-0279ff89-ac3b-4f4d-a11d-1d59e90ddbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:40.038116 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583148b-4685-4c6b-9d30-d2a8c26e9845 service nova] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:40.050660 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68401fa5-b2fd-4267-aa17-7178517455d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:40.051597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68401fa5-b2fd-4267-aa17-7178517455d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:40.051883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68401fa5-b2fd-4267-aa17-7178517455d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:40.053114 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68401fa5-b2fd-4267-aa17-7178517455d4 admin admin] PATH_INFO: `/v3/projects/f2cf5537ebb249f691cdd927ebddc4a2` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:40.054914 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68401fa5-b2fd-4267-aa17-7178517455d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2cf5537ebb249f691cdd927ebddc4a2)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:40.057957 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68401fa5-b2fd-4267-aa17-7178517455d4 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:40.062321 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 906/1802] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:40.105521 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:40.125992 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-68401fa5-b2fd-4267-aa17-7178517455d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2cf5537ebb249f691cdd927ebddc4a2', 'request_id': 'req-68401fa5-b2fd-4267-aa17-7178517455d4'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:40.142464 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-68401fa5-b2fd-4267-aa17-7178517455d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2cf5537ebb249f691cdd927ebddc4a2', 'request_id': 'req-68401fa5-b2fd-4267-aa17-7178517455d4'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:40.153196 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-68401fa5-b2fd-4267-aa17-7178517455d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2cf5537ebb249f691cdd927ebddc4a2', 'request_id': 'req-68401fa5-b2fd-4267-aa17-7178517455d4'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:40.171511 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-68401fa5-b2fd-4267-aa17-7178517455d4 admin admin] The token cache is being invalidate because project f2cf5537ebb249f691cdd927ebddc4a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:04:40.172280 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-68401fa5-b2fd-4267-aa17-7178517455d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:40.173158 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-68401fa5-b2fd-4267-aa17-7178517455d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:40.176455 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 897/1803] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:04:39 2022] DELETE /identity/v3/projects/f2cf5537ebb249f691cdd927ebddc4a2 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:40.182444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b97a72-7cf6-4675-a7cf-deb0fea775df None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:40.182961 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b97a72-7cf6-4675-a7cf-deb0fea775df None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:40.183212 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b97a72-7cf6-4675-a7cf-deb0fea775df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:40.226318 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-24b97a72-7cf6-4675-a7cf-deb0fea775df None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:40.228106 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-24b97a72-7cf6-4675-a7cf-deb0fea775df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:40.363449 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 907/1804] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:40.377451 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6addcc-906a-45ef-8cd4-0e7681208265 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:40.377814 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6addcc-906a-45ef-8cd4-0e7681208265 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:40.378185 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6addcc-906a-45ef-8cd4-0e7681208265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:40.421601 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-ba6addcc-906a-45ef-8cd4-0e7681208265 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:40.423231 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-ba6addcc-906a-45ef-8cd4-0e7681208265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:40.437653 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 898/1805] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:40.441844 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b97a72-7cf6-4675-a7cf-deb0fea775df None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:40.460175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b97a72-7cf6-4675-a7cf-deb0fea775df None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:40.469024 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070dcc7-37c3-448c-9dd4-510488eab68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:40.470021 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070dcc7-37c3-448c-9dd4-510488eab68e admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:40.470626 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070dcc7-37c3-448c-9dd4-510488eab68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:40.471512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070dcc7-37c3-448c-9dd4-510488eab68e admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:40.472608 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070dcc7-37c3-448c-9dd4-510488eab68e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:04:40.473298 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070dcc7-37c3-448c-9dd4-510488eab68e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:40.478145 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070dcc7-37c3-448c-9dd4-510488eab68e admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:40.506132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 908/1806] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 02:04:40.511069 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6addcc-906a-45ef-8cd4-0e7681208265 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:40.546350 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6addcc-906a-45ef-8cd4-0e7681208265 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:40.572947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b28bf-3676-493d-b8f7-eaa86f231fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:40.574046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b28bf-3676-493d-b8f7-eaa86f231fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:40.574571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b28bf-3676-493d-b8f7-eaa86f231fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:40.575647 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b28bf-3676-493d-b8f7-eaa86f231fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:40.576722 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b28bf-3676-493d-b8f7-eaa86f231fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:40.596714 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b28bf-3676-493d-b8f7-eaa86f231fb7 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:40.611200 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070dcc7-37c3-448c-9dd4-510488eab68e admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:40.613039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-6070dcc7-37c3-448c-9dd4-510488eab68e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:40.659799 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070dcc7-37c3-448c-9dd4-510488eab68e admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:40.684245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 899/1807] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:40 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:40.686432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cba0f-3ed6-4457-8de3-98b467547e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:40.686926 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b28bf-3676-493d-b8f7-eaa86f231fb7 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:40.687347 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cba0f-3ed6-4457-8de3-98b467547e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:40.687652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cba0f-3ed6-4457-8de3-98b467547e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:40.688095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cba0f-3ed6-4457-8de3-98b467547e01 admin admin] PATH_INFO: `/v3/users/aabe5e5277f24a5b8ceec819ee1a0a43` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:40.690410 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cba0f-3ed6-4457-8de3-98b467547e01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aabe5e5277f24a5b8ceec819ee1a0a43)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:40.692859 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cba0f-3ed6-4457-8de3-98b467547e01 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:40.699835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:40.772829 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-776cba0f-3ed6-4457-8de3-98b467547e01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aabe5e5277f24a5b8ceec819ee1a0a43'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:40.782771 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-776cba0f-3ed6-4457-8de3-98b467547e01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aabe5e5277f24a5b8ceec819ee1a0a43'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:40.784021 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-776cba0f-3ed6-4457-8de3-98b467547e01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aabe5e5277f24a5b8ceec819ee1a0a43'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:40.785549 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-776cba0f-3ed6-4457-8de3-98b467547e01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aabe5e5277f24a5b8ceec819ee1a0a43'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:40.811693 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-776cba0f-3ed6-4457-8de3-98b467547e01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aabe5e5277f24a5b8ceec819ee1a0a43'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:40.831125 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 909/1808] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:04:40 2022] DELETE /identity/v3/users/aabe5e5277f24a5b8ceec819ee1a0a43 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:40.835024 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cba0f-3ed6-4457-8de3-98b467547e01 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:40.839311 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-776cba0f-3ed6-4457-8de3-98b467547e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:40.849043 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b28bf-3676-493d-b8f7-eaa86f231fb7 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:40.956540 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896699eb-4b39-48a1-9328-3ff12b470a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:40.957537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896699eb-4b39-48a1-9328-3ff12b470a12 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:40.957839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896699eb-4b39-48a1-9328-3ff12b470a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:40.958188 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896699eb-4b39-48a1-9328-3ff12b470a12 admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:40.958964 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896699eb-4b39-48a1-9328-3ff12b470a12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:40.961735 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896699eb-4b39-48a1-9328-3ff12b470a12 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:40.998386 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 900/1809] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:40 2022] POST /identity/v3/users => generated 290 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:41.000495 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690dc80-05de-4d26-8aca-81f839e20aa0 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:41.000777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690dc80-05de-4d26-8aca-81f839e20aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:41.001104 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690dc80-05de-4d26-8aca-81f839e20aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:41.025952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-b690dc80-05de-4d26-8aca-81f839e20aa0 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:41.027122 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-b690dc80-05de-4d26-8aca-81f839e20aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:41.030158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cba0f-3ed6-4457-8de3-98b467547e01 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:41.036672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 901/1810] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:41.040835 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690dc80-05de-4d26-8aca-81f839e20aa0 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:41.042531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-b690dc80-05de-4d26-8aca-81f839e20aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:41.047297 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c7867-3c43-4608-9be3-2c0c015c130c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:41.048495 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c7867-3c43-4608-9be3-2c0c015c130c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:41.050489 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c7867-3c43-4608-9be3-2c0c015c130c admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:41.050979 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c7867-3c43-4608-9be3-2c0c015c130c admin admin] PATH_INFO: `/v3/users/58911020daeb4d1e86706528fdc8b114` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:41.053442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c7867-3c43-4608-9be3-2c0c015c130c admin admin] RBAC: Authorizing `identity:delete_user(user_id=58911020daeb4d1e86706528fdc8b114)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:41.058778 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c7867-3c43-4608-9be3-2c0c015c130c admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:41.070383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690dc80-05de-4d26-8aca-81f839e20aa0 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:41.082968 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309910c-8b05-4fa6-b74a-c06d1e61e019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:41.083702 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309910c-8b05-4fa6-b74a-c06d1e61e019 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:41.083985 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309910c-8b05-4fa6-b74a-c06d1e61e019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:41.084388 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309910c-8b05-4fa6-b74a-c06d1e61e019 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:41.085572 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309910c-8b05-4fa6-b74a-c06d1e61e019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:41.091448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309910c-8b05-4fa6-b74a-c06d1e61e019 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:41.110610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 902/1811] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:41.111627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309910c-8b05-4fa6-b74a-c06d1e61e019 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:41.113636 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-3309910c-8b05-4fa6-b74a-c06d1e61e019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:41.125662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:41.144302 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-d56c7867-3c43-4608-9be3-2c0c015c130c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58911020daeb4d1e86706528fdc8b114'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:41.159089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-d56c7867-3c43-4608-9be3-2c0c015c130c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58911020daeb4d1e86706528fdc8b114'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:41.160346 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-d56c7867-3c43-4608-9be3-2c0c015c130c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58911020daeb4d1e86706528fdc8b114'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:41.164139 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-d56c7867-3c43-4608-9be3-2c0c015c130c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58911020daeb4d1e86706528fdc8b114'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:41.181509 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309910c-8b05-4fa6-b74a-c06d1e61e019 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:41.186814 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4f72e-53fa-46b4-ab0c-c02b3c619ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:41.187627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4f72e-53fa-46b4-ab0c-c02b3c619ffa service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:41.187980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4f72e-53fa-46b4-ab0c-c02b3c619ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:41.188451 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4f72e-53fa-46b4-ab0c-c02b3c619ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:41.189946 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-d56c7867-3c43-4608-9be3-2c0c015c130c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58911020daeb4d1e86706528fdc8b114'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:41.190631 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-f1a4f72e-53fa-46b4-ab0c-c02b3c619ffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:41.210867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4f72e-53fa-46b4-ab0c-c02b3c619ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:41.212528 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4f72e-53fa-46b4-ab0c-c02b3c619ffa service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:41.229154 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 910/1812] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:04:40 2022] DELETE /identity/v3/users/58911020daeb4d1e86706528fdc8b114 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:41.230716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c7867-3c43-4608-9be3-2c0c015c130c admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:41.232337 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-d56c7867-3c43-4608-9be3-2c0c015c130c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:41.245593 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 903/1813] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:41.247152 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6baa17-cba3-41ab-8887-b09643bccfbc None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:41.247469 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6baa17-cba3-41ab-8887-b09643bccfbc None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:41.248147 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6baa17-cba3-41ab-8887-b09643bccfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:41.250768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:41.288688 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-0c6baa17-cba3-41ab-8887-b09643bccfbc None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:41.289961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-0c6baa17-cba3-41ab-8887-b09643bccfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:41.402107 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c7867-3c43-4608-9be3-2c0c015c130c admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:41.415514 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 904/1814] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:41.416447 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9def0-42a8-4fda-a1be-d66cbc7ef696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:41.417274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9def0-42a8-4fda-a1be-d66cbc7ef696 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:41.419551 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9def0-42a8-4fda-a1be-d66cbc7ef696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:41.419950 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9def0-42a8-4fda-a1be-d66cbc7ef696 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:41.421314 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9def0-42a8-4fda-a1be-d66cbc7ef696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:41.426236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9def0-42a8-4fda-a1be-d66cbc7ef696 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:41.451788 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 911/1815] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:41.453252 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6baa17-cba3-41ab-8887-b09643bccfbc None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:41.453663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9def0-42a8-4fda-a1be-d66cbc7ef696 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:41.455550 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-0c6baa17-cba3-41ab-8887-b09643bccfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:41.480517 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9def0-42a8-4fda-a1be-d66cbc7ef696 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:41.501886 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff07ba0-4887-420d-980b-c0e0bcb7384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:41.502901 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff07ba0-4887-420d-980b-c0e0bcb7384e admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:41.503256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff07ba0-4887-420d-980b-c0e0bcb7384e admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:41.503630 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff07ba0-4887-420d-980b-c0e0bcb7384e admin admin] PATH_INFO: `/v3/projects/66fa25f096764fe5bb72b919cd7c0c83/users/483cbd2116d5437ab39b898afeb8974f/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:41.546770 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff07ba0-4887-420d-980b-c0e0bcb7384e admin admin] RBAC: Authorizing `identity:create_grant(project_id=66fa25f096764fe5bb72b919cd7c0c83, user_id=483cbd2116d5437ab39b898afeb8974f, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:41.550469 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff07ba0-4887-420d-980b-c0e0bcb7384e admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:41.589131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 912/1816] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:41 2022] PUT /identity/v3/projects/66fa25f096764fe5bb72b919cd7c0c83/users/483cbd2116d5437ab39b898afeb8974f/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:41.600043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03314e-0da2-459e-9f8b-9c1366b652e7 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:41.600582 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03314e-0da2-459e-9f8b-9c1366b652e7 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:41.600992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03314e-0da2-459e-9f8b-9c1366b652e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:41.614171 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6baa17-cba3-41ab-8887-b09643bccfbc None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:41.686547 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-ab03314e-0da2-459e-9f8b-9c1366b652e7 None None] MFA Rules not processed for user `483cbd2116d5437ab39b898afeb8974f`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:41.687861 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-ab03314e-0da2-459e-9f8b-9c1366b652e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:41.775453 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42699021-b012-4753-b1da-40fb13fde3b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:41.778178 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42699021-b012-4753-b1da-40fb13fde3b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:41.778940 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42699021-b012-4753-b1da-40fb13fde3b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:41.779980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42699021-b012-4753-b1da-40fb13fde3b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:41.809410 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:41.875616 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 913/1817] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:04:41.877043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03314e-0da2-459e-9f8b-9c1366b652e7 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:41.896006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42699021-b012-4753-b1da-40fb13fde3b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:41.899251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42699021-b012-4753-b1da-40fb13fde3b8 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:41.919452 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 905/1818] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:42.117698 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03314e-0da2-459e-9f8b-9c1366b652e7 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:42.143098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48574f2b-3a1f-448a-96fc-702267314bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:42.143994 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48574f2b-3a1f-448a-96fc-702267314bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:42.144280 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48574f2b-3a1f-448a-96fc-702267314bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:42.144559 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48574f2b-3a1f-448a-96fc-702267314bd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:42.145261 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48574f2b-3a1f-448a-96fc-702267314bd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:42.147499 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48574f2b-3a1f-448a-96fc-702267314bd3 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:42.190687 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:42.278989 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 914/1819] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:41 2022] POST /identity/v3/projects => generated 379 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:42.283304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42699021-b012-4753-b1da-40fb13fde3b8 service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:42.314645 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42699021-b012-4753-b1da-40fb13fde3b8 service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:42.536376 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48574f2b-3a1f-448a-96fc-702267314bd3 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:42.538789 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-48574f2b-3a1f-448a-96fc-702267314bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:42.573364 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d44e4-99d4-467f-b79c-1ef7e0292a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:42.573777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d44e4-99d4-467f-b79c-1ef7e0292a7f admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:42.574074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d44e4-99d4-467f-b79c-1ef7e0292a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:42.574341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d44e4-99d4-467f-b79c-1ef7e0292a7f admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:42.575360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d44e4-99d4-467f-b79c-1ef7e0292a7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:42.580221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d44e4-99d4-467f-b79c-1ef7e0292a7f admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:42.647983 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 906/1820] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:42 2022] POST /identity/v3/users => generated 296 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:42.651958 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d44e4-99d4-467f-b79c-1ef7e0292a7f admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:42.676823 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d44e4-99d4-467f-b79c-1ef7e0292a7f admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:42.692001 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300eafeb-a8ea-4410-9fb4-799e0b265fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:42.693117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300eafeb-a8ea-4410-9fb4-799e0b265fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:42.693404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300eafeb-a8ea-4410-9fb4-799e0b265fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:42.698059 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300eafeb-a8ea-4410-9fb4-799e0b265fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:42.699267 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300eafeb-a8ea-4410-9fb4-799e0b265fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:42.703966 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48574f2b-3a1f-448a-96fc-702267314bd3 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:42.708737 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300eafeb-a8ea-4410-9fb4-799e0b265fd3 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:42.718101 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0453569-9388-4f0d-bbd9-63aaf47f6a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:42.719351 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0453569-9388-4f0d-bbd9-63aaf47f6a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:42.720154 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0453569-9388-4f0d-bbd9-63aaf47f6a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:42.720565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0453569-9388-4f0d-bbd9-63aaf47f6a1f admin admin] PATH_INFO: `/v3/projects/d6e576aa42e14a0d9e8616ab705ba44c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:42.722921 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0453569-9388-4f0d-bbd9-63aaf47f6a1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6e576aa42e14a0d9e8616ab705ba44c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:42.726818 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0453569-9388-4f0d-bbd9-63aaf47f6a1f admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:42.757370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 907/1821] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:42.758476 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300eafeb-a8ea-4410-9fb4-799e0b265fd3 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:42.779874 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300eafeb-a8ea-4410-9fb4-799e0b265fd3 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:42.788156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa55b60-6ef6-489d-9f0e-02fcc8909e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:42.789428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa55b60-6ef6-489d-9f0e-02fcc8909e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:42.789800 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa55b60-6ef6-489d-9f0e-02fcc8909e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:42.790117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa55b60-6ef6-489d-9f0e-02fcc8909e32 admin admin] PATH_INFO: `/v3/projects/b7f28ad086d8463aaa5300115c64b63a/users/b90aeb262e694ff4b80b9fe81f295c6c/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:42.820561 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa55b60-6ef6-489d-9f0e-02fcc8909e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f28ad086d8463aaa5300115c64b63a, user_id=b90aeb262e694ff4b80b9fe81f295c6c, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:42.824079 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa55b60-6ef6-489d-9f0e-02fcc8909e32 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:42.825227 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f0453569-9388-4f0d-bbd9-63aaf47f6a1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6e576aa42e14a0d9e8616ab705ba44c', 'request_id': 'req-f0453569-9388-4f0d-bbd9-63aaf47f6a1f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:42.832328 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f0453569-9388-4f0d-bbd9-63aaf47f6a1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6e576aa42e14a0d9e8616ab705ba44c', 'request_id': 'req-f0453569-9388-4f0d-bbd9-63aaf47f6a1f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:42.843678 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 908/1822] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:42 2022] PUT /identity/v3/projects/b7f28ad086d8463aaa5300115c64b63a/users/b90aeb262e694ff4b80b9fe81f295c6c/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:42.846273 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f0453569-9388-4f0d-bbd9-63aaf47f6a1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6e576aa42e14a0d9e8616ab705ba44c', 'request_id': 'req-f0453569-9388-4f0d-bbd9-63aaf47f6a1f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:42.848227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa55b60-6ef6-489d-9f0e-02fcc8909e32 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:42.872805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f0453569-9388-4f0d-bbd9-63aaf47f6a1f admin admin] The token cache is being invalidate because project d6e576aa42e14a0d9e8616ab705ba44c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:04:42.873487 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f0453569-9388-4f0d-bbd9-63aaf47f6a1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:42.875827 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f0453569-9388-4f0d-bbd9-63aaf47f6a1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:42.879801 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 915/1823] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:04:42 2022] DELETE /identity/v3/projects/d6e576aa42e14a0d9e8616ab705ba44c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:04:42.885619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0453569-9388-4f0d-bbd9-63aaf47f6a1f admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:42.888732 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-f0453569-9388-4f0d-bbd9-63aaf47f6a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:42.998120 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0453569-9388-4f0d-bbd9-63aaf47f6a1f admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:43.015463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa55b60-6ef6-489d-9f0e-02fcc8909e32 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:43.017555 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483ff47-22f9-4a15-955e-9231f70e20de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:43.018100 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483ff47-22f9-4a15-955e-9231f70e20de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:43.018454 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483ff47-22f9-4a15-955e-9231f70e20de admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:43.018724 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483ff47-22f9-4a15-955e-9231f70e20de admin admin] PATH_INFO: `/v3/projects/efd8956234e048f6b754cd5d1dde967d` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:43.021106 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483ff47-22f9-4a15-955e-9231f70e20de admin admin] RBAC: Authorizing `identity:delete_project(project_id=efd8956234e048f6b754cd5d1dde967d)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:43.023891 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483ff47-22f9-4a15-955e-9231f70e20de admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:43.027643 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6a275-baf7-4dbe-a14a-2d9a681a3fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:43.028346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6a275-baf7-4dbe-a14a-2d9a681a3fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:43.028634 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6a275-baf7-4dbe-a14a-2d9a681a3fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:43.028908 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6a275-baf7-4dbe-a14a-2d9a681a3fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:43.029682 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6a275-baf7-4dbe-a14a-2d9a681a3fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:43.031498 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6a275-baf7-4dbe-a14a-2d9a681a3fd4 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:43.054037 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 909/1824] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:43.055325 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6a275-baf7-4dbe-a14a-2d9a681a3fd4 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:43.056225 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:43.058037 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-75a6a275-baf7-4dbe-a14a-2d9a681a3fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:43.082981 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6a275-baf7-4dbe-a14a-2d9a681a3fd4 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:43.097178 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576db3f8-a61f-4e74-8bf5-64a4f54b8b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:43.098094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576db3f8-a61f-4e74-8bf5-64a4f54b8b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:43.098361 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576db3f8-a61f-4e74-8bf5-64a4f54b8b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:43.098637 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576db3f8-a61f-4e74-8bf5-64a4f54b8b2c admin admin] PATH_INFO: `/v3/users/4caae498c9f04e9c80e4fb24cc5d8faa` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:43.102348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576db3f8-a61f-4e74-8bf5-64a4f54b8b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4caae498c9f04e9c80e4fb24cc5d8faa)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:43.110263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576db3f8-a61f-4e74-8bf5-64a4f54b8b2c admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:43.114358 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:43.138494 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-8483ff47-22f9-4a15-955e-9231f70e20de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efd8956234e048f6b754cd5d1dde967d', 'request_id': 'req-8483ff47-22f9-4a15-955e-9231f70e20de'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:43.153054 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-8483ff47-22f9-4a15-955e-9231f70e20de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efd8956234e048f6b754cd5d1dde967d', 'request_id': 'req-8483ff47-22f9-4a15-955e-9231f70e20de'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:43.168171 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-8483ff47-22f9-4a15-955e-9231f70e20de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efd8956234e048f6b754cd5d1dde967d', 'request_id': 'req-8483ff47-22f9-4a15-955e-9231f70e20de'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:43.195382 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-8483ff47-22f9-4a15-955e-9231f70e20de admin admin] The token cache is being invalidate because project efd8956234e048f6b754cd5d1dde967d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:04:43.196232 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-8483ff47-22f9-4a15-955e-9231f70e20de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:43.196636 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-576db3f8-a61f-4e74-8bf5-64a4f54b8b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4caae498c9f04e9c80e4fb24cc5d8faa'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:43.198102 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-8483ff47-22f9-4a15-955e-9231f70e20de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:43.200469 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 916/1825] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:04:42 2022] DELETE /identity/v3/projects/efd8956234e048f6b754cd5d1dde967d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:43.201322 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483ff47-22f9-4a15-955e-9231f70e20de admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:43.205224 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-8483ff47-22f9-4a15-955e-9231f70e20de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:43.233369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-576db3f8-a61f-4e74-8bf5-64a4f54b8b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4caae498c9f04e9c80e4fb24cc5d8faa'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:43.244579 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-576db3f8-a61f-4e74-8bf5-64a4f54b8b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4caae498c9f04e9c80e4fb24cc5d8faa'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:43.246192 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-576db3f8-a61f-4e74-8bf5-64a4f54b8b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4caae498c9f04e9c80e4fb24cc5d8faa'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:43.273877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-576db3f8-a61f-4e74-8bf5-64a4f54b8b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4caae498c9f04e9c80e4fb24cc5d8faa'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:43.289548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 910/1826] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:04:43 2022] DELETE /identity/v3/users/4caae498c9f04e9c80e4fb24cc5d8faa => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:43.289548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576db3f8-a61f-4e74-8bf5-64a4f54b8b2c admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:43.290606 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-576db3f8-a61f-4e74-8bf5-64a4f54b8b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:43.444796 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483ff47-22f9-4a15-955e-9231f70e20de admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:43.489129 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576db3f8-a61f-4e74-8bf5-64a4f54b8b2c admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:43.499670 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cce5f-dd90-49d3-9fde-2e4017f9bbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:43.500690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cce5f-dd90-49d3-9fde-2e4017f9bbb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:43.500976 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cce5f-dd90-49d3-9fde-2e4017f9bbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:43.501253 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cce5f-dd90-49d3-9fde-2e4017f9bbb5 admin admin] PATH_INFO: `/v3/users/c9bf6ee4c3904f6aa54da46469ef258f` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:43.502534 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291cce5f-dd90-49d3-9fde-2e4017f9bbb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9bf6ee4c3904f6aa54da46469ef258f)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:43.506439 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291cce5f-dd90-49d3-9fde-2e4017f9bbb5 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:43.563952 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0739e-bac1-4cd6-9319-2d6d2f6ac4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:43.565182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0739e-bac1-4cd6-9319-2d6d2f6ac4e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:43.565548 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0739e-bac1-4cd6-9319-2d6d2f6ac4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:43.566024 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0739e-bac1-4cd6-9319-2d6d2f6ac4e7 admin admin] PATH_INFO: `/v3/projects/b7f28ad086d8463aaa5300115c64b63a/users/b90aeb262e694ff4b80b9fe81f295c6c/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:43.578314 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0739e-bac1-4cd6-9319-2d6d2f6ac4e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f28ad086d8463aaa5300115c64b63a, user_id=b90aeb262e694ff4b80b9fe81f295c6c, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:43.602600 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0739e-bac1-4cd6-9319-2d6d2f6ac4e7 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:43.616779 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-291cce5f-dd90-49d3-9fde-2e4017f9bbb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9bf6ee4c3904f6aa54da46469ef258f'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:43.650534 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 917/1827] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:43 2022] PUT /identity/v3/projects/b7f28ad086d8463aaa5300115c64b63a/users/b90aeb262e694ff4b80b9fe81f295c6c/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:43.653052 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1f735-82cc-4f82-a9a0-3e7b853e8538 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:43.653452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1f735-82cc-4f82-a9a0-3e7b853e8538 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:43.653562 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-291cce5f-dd90-49d3-9fde-2e4017f9bbb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9bf6ee4c3904f6aa54da46469ef258f'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:43.653899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1f735-82cc-4f82-a9a0-3e7b853e8538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:43.673174 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-291cce5f-dd90-49d3-9fde-2e4017f9bbb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9bf6ee4c3904f6aa54da46469ef258f'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:43.674514 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-291cce5f-dd90-49d3-9fde-2e4017f9bbb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9bf6ee4c3904f6aa54da46469ef258f'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:43.686955 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-291cce5f-dd90-49d3-9fde-2e4017f9bbb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9bf6ee4c3904f6aa54da46469ef258f'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:43.691004 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:43.700309 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 911/1828] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:04:43 2022] DELETE /identity/v3/users/c9bf6ee4c3904f6aa54da46469ef258f => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:43.703776 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-b0b1f735-82cc-4f82-a9a0-3e7b853e8538 None None] MFA Rules not processed for user `b90aeb262e694ff4b80b9fe81f295c6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:43.705881 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-b0b1f735-82cc-4f82-a9a0-3e7b853e8538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:43.786688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:43.861740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 918/1829] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:43.878860 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cce5f-dd90-49d3-9fde-2e4017f9bbb5 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:43.895514 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-291cce5f-dd90-49d3-9fde-2e4017f9bbb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:44.061845 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cce5f-dd90-49d3-9fde-2e4017f9bbb5 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:44.072093 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc0f59-05d0-45ec-9a5f-c2b2153364cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:44.072786 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc0f59-05d0-45ec-9a5f-c2b2153364cd service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:44.073112 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc0f59-05d0-45ec-9a5f-c2b2153364cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:44.073763 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc0f59-05d0-45ec-9a5f-c2b2153364cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:44.076776 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-decc0f59-05d0-45ec-9a5f-c2b2153364cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:44.164881 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc0f59-05d0-45ec-9a5f-c2b2153364cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:44.167865 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc0f59-05d0-45ec-9a5f-c2b2153364cd service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:44.199903 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 912/1830] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:44.610110 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1f735-82cc-4f82-a9a0-3e7b853e8538 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:44.612046 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-b0b1f735-82cc-4f82-a9a0-3e7b853e8538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:44.754514 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1f735-82cc-4f82-a9a0-3e7b853e8538 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:44.767320 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38ab0b-0723-4359-b5f6-05c8cdf63c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:44.769121 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38ab0b-0723-4359-b5f6-05c8cdf63c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:44.769619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38ab0b-0723-4359-b5f6-05c8cdf63c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:44.769985 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38ab0b-0723-4359-b5f6-05c8cdf63c40 admin admin] PATH_INFO: `/v3/projects/c7011974a85243b8a66da853a738d841` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:44.774314 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38ab0b-0723-4359-b5f6-05c8cdf63c40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7011974a85243b8a66da853a738d841)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:44.775274 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc0f59-05d0-45ec-9a5f-c2b2153364cd service cinder] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:44.776762 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-decc0f59-05d0-45ec-9a5f-c2b2153364cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:44.777395 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38ab0b-0723-4359-b5f6-05c8cdf63c40 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:44.804532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc0f59-05d0-45ec-9a5f-c2b2153364cd service cinder] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:44.813101 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45998914-3fc0-4a82-9b5f-9b6c1ee48c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:44.821271 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45998914-3fc0-4a82-9b5f-9b6c1ee48c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:44.821812 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45998914-3fc0-4a82-9b5f-9b6c1ee48c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:44.822029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45998914-3fc0-4a82-9b5f-9b6c1ee48c1c admin admin] PATH_INFO: `/v3/projects/a36998b2586d4eafa239fcee1022cdb1` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:44.824380 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45998914-3fc0-4a82-9b5f-9b6c1ee48c1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a36998b2586d4eafa239fcee1022cdb1)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:44.826333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45998914-3fc0-4a82-9b5f-9b6c1ee48c1c admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:44.863153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-3e38ab0b-0723-4359-b5f6-05c8cdf63c40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7011974a85243b8a66da853a738d841', 'request_id': 'req-3e38ab0b-0723-4359-b5f6-05c8cdf63c40'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:44.875713 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-3e38ab0b-0723-4359-b5f6-05c8cdf63c40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7011974a85243b8a66da853a738d841', 'request_id': 'req-3e38ab0b-0723-4359-b5f6-05c8cdf63c40'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:44.887594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-3e38ab0b-0723-4359-b5f6-05c8cdf63c40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7011974a85243b8a66da853a738d841', 'request_id': 'req-3e38ab0b-0723-4359-b5f6-05c8cdf63c40'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:44.907663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-3e38ab0b-0723-4359-b5f6-05c8cdf63c40 admin admin] The token cache is being invalidate because project c7011974a85243b8a66da853a738d841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:04:44.908177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-3e38ab0b-0723-4359-b5f6-05c8cdf63c40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:44.915824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-3e38ab0b-0723-4359-b5f6-05c8cdf63c40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:44.933835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 919/1831] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:04:44 2022] DELETE /identity/v3/projects/c7011974a85243b8a66da853a738d841 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:44.938206 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e3f46-d445-4803-8caa-5c39e3e8476d None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:44.938520 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e3f46-d445-4803-8caa-5c39e3e8476d None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:44.941372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e3f46-d445-4803-8caa-5c39e3e8476d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:44.944890 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-45998914-3fc0-4a82-9b5f-9b6c1ee48c1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a36998b2586d4eafa239fcee1022cdb1', 'request_id': 'req-45998914-3fc0-4a82-9b5f-9b6c1ee48c1c'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:44.956925 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-45998914-3fc0-4a82-9b5f-9b6c1ee48c1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a36998b2586d4eafa239fcee1022cdb1', 'request_id': 'req-45998914-3fc0-4a82-9b5f-9b6c1ee48c1c'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:44.966911 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-a35e3f46-d445-4803-8caa-5c39e3e8476d None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:44.967830 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-a35e3f46-d445-4803-8caa-5c39e3e8476d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:44.969296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-45998914-3fc0-4a82-9b5f-9b6c1ee48c1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a36998b2586d4eafa239fcee1022cdb1', 'request_id': 'req-45998914-3fc0-4a82-9b5f-9b6c1ee48c1c'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:44.986573 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-45998914-3fc0-4a82-9b5f-9b6c1ee48c1c admin admin] The token cache is being invalidate because project a36998b2586d4eafa239fcee1022cdb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:04:44.986951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-45998914-3fc0-4a82-9b5f-9b6c1ee48c1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:44.987648 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-45998914-3fc0-4a82-9b5f-9b6c1ee48c1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:44.998116 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 913/1832] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:04:44 2022] DELETE /identity/v3/projects/a36998b2586d4eafa239fcee1022cdb1 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:45.002823 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45998914-3fc0-4a82-9b5f-9b6c1ee48c1c admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:45.005832 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-45998914-3fc0-4a82-9b5f-9b6c1ee48c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:45.046853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 920/1833] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:04:45.055552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009c390-138d-4920-9953-f9b23b38ade0 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:45.055842 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009c390-138d-4920-9953-f9b23b38ade0 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:45.056114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009c390-138d-4920-9953-f9b23b38ade0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:45.065349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:45.071496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:45.079049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-d009c390-138d-4920-9953-f9b23b38ade0 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:45.080670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-d009c390-138d-4920-9953-f9b23b38ade0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:45.092482 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 921/1834] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:45.096227 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009c390-138d-4920-9953-f9b23b38ade0 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:45.098878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45998914-3fc0-4a82-9b5f-9b6c1ee48c1c admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:45.105078 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b6cd2-b54e-4f2e-a6b8-5aa135c1ba67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:45.105983 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b6cd2-b54e-4f2e-a6b8-5aa135c1ba67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:45.106267 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b6cd2-b54e-4f2e-a6b8-5aa135c1ba67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:45.106453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009c390-138d-4920-9953-f9b23b38ade0 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:45.106529 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b6cd2-b54e-4f2e-a6b8-5aa135c1ba67 admin admin] PATH_INFO: `/v3/users/96d7c470c9be4ab29ff2e891f115dc56` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:45.113077 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b6cd2-b54e-4f2e-a6b8-5aa135c1ba67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96d7c470c9be4ab29ff2e891f115dc56)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:45.113077 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b6cd2-b54e-4f2e-a6b8-5aa135c1ba67 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:45.123171 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082a6f2-b231-4775-974e-b5282efa6b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:45.124002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082a6f2-b231-4775-974e-b5282efa6b44 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:45.124480 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082a6f2-b231-4775-974e-b5282efa6b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:45.124814 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082a6f2-b231-4775-974e-b5282efa6b44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:45.125671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082a6f2-b231-4775-974e-b5282efa6b44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:04:45.126482 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082a6f2-b231-4775-974e-b5282efa6b44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:45.128351 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082a6f2-b231-4775-974e-b5282efa6b44 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:45.141519 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 922/1835] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 02:04:45.142679 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601f15a-ab90-4fd9-84ca-36479407c0fc None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:45.143111 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601f15a-ab90-4fd9-84ca-36479407c0fc None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:45.143267 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601f15a-ab90-4fd9-84ca-36479407c0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:45.176418 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-7601f15a-ab90-4fd9-84ca-36479407c0fc None None] MFA Rules not processed for user `042853e4abce41f9a3e8263d1fc8ac00`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:45.179641 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-7601f15a-ab90-4fd9-84ca-36479407c0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:45.192940 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-cd8b6cd2-b54e-4f2e-a6b8-5aa135c1ba67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96d7c470c9be4ab29ff2e891f115dc56'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:45.206143 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-cd8b6cd2-b54e-4f2e-a6b8-5aa135c1ba67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96d7c470c9be4ab29ff2e891f115dc56'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:45.217583 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-cd8b6cd2-b54e-4f2e-a6b8-5aa135c1ba67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96d7c470c9be4ab29ff2e891f115dc56'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:45.218439 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-cd8b6cd2-b54e-4f2e-a6b8-5aa135c1ba67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96d7c470c9be4ab29ff2e891f115dc56'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:45.231798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-cd8b6cd2-b54e-4f2e-a6b8-5aa135c1ba67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96d7c470c9be4ab29ff2e891f115dc56'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:45.241824 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 914/1836] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:04:45 2022] DELETE /identity/v3/users/96d7c470c9be4ab29ff2e891f115dc56 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:45.246835 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b6cd2-b54e-4f2e-a6b8-5aa135c1ba67 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:45.248573 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-cd8b6cd2-b54e-4f2e-a6b8-5aa135c1ba67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:45.378259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b6cd2-b54e-4f2e-a6b8-5aa135c1ba67 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:45.385930 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88d96b-f19d-45ac-b4b6-65db3543f55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:45.387669 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88d96b-f19d-45ac-b4b6-65db3543f55e admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:45.388197 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88d96b-f19d-45ac-b4b6-65db3543f55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:45.389174 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88d96b-f19d-45ac-b4b6-65db3543f55e admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:45.390154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88d96b-f19d-45ac-b4b6-65db3543f55e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:45.392685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88d96b-f19d-45ac-b4b6-65db3543f55e admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:45.436041 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 915/1837] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:45 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:45.437655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 923/1838] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:45.439260 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601f15a-ab90-4fd9-84ca-36479407c0fc None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:45.457010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601f15a-ab90-4fd9-84ca-36479407c0fc None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:45.558439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6c151-aef1-43a4-914f-83e870d05222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:45.559147 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6c151-aef1-43a4-914f-83e870d05222 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:45.559612 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6c151-aef1-43a4-914f-83e870d05222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:45.559989 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6c151-aef1-43a4-914f-83e870d05222 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:45.560691 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c6c151-aef1-43a4-914f-83e870d05222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:45.564440 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c6c151-aef1-43a4-914f-83e870d05222 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:45.601322 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 924/1839] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:45 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:45.605670 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88d96b-f19d-45ac-b4b6-65db3543f55e admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:45.628099 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88d96b-f19d-45ac-b4b6-65db3543f55e admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:45.637331 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70216f8-7a59-45c8-852a-f23d70d744c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:45.638290 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70216f8-7a59-45c8-852a-f23d70d744c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:45.638794 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70216f8-7a59-45c8-852a-f23d70d744c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:45.639131 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70216f8-7a59-45c8-852a-f23d70d744c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:45.640774 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70216f8-7a59-45c8-852a-f23d70d744c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:45.643357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70216f8-7a59-45c8-852a-f23d70d744c6 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:45.662820 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 916/1840] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:04:45.666775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6c151-aef1-43a4-914f-83e870d05222 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:45.700234 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6c151-aef1-43a4-914f-83e870d05222 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:45.708461 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11952471-5db0-40ae-80cc-1270bfc39625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:45.709553 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11952471-5db0-40ae-80cc-1270bfc39625 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:45.709929 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11952471-5db0-40ae-80cc-1270bfc39625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:45.710433 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11952471-5db0-40ae-80cc-1270bfc39625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:45.712029 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11952471-5db0-40ae-80cc-1270bfc39625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:45.714806 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11952471-5db0-40ae-80cc-1270bfc39625 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:45.735931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 925/1841] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:04:45.738345 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70216f8-7a59-45c8-852a-f23d70d744c6 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:45.753806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70216f8-7a59-45c8-852a-f23d70d744c6 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:45.760872 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59fee4-d1a1-497b-9292-4c850c845a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:45.762037 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59fee4-d1a1-497b-9292-4c850c845a60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:45.762426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59fee4-d1a1-497b-9292-4c850c845a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:45.762820 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59fee4-d1a1-497b-9292-4c850c845a60 admin admin] PATH_INFO: `/v3/projects/edbcd471337e48de9505d80df5dcc3d5/users/b273b0ca7ce04710b0395390b36a0ba6/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:45.782220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59fee4-d1a1-497b-9292-4c850c845a60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edbcd471337e48de9505d80df5dcc3d5, user_id=b273b0ca7ce04710b0395390b36a0ba6, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:45.785997 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59fee4-d1a1-497b-9292-4c850c845a60 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:45.787726 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11952471-5db0-40ae-80cc-1270bfc39625 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:45.794797 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-11952471-5db0-40ae-80cc-1270bfc39625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:45.830747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11952471-5db0-40ae-80cc-1270bfc39625 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:45.872358 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 917/1842] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:45 2022] PUT /identity/v3/projects/edbcd471337e48de9505d80df5dcc3d5/users/b273b0ca7ce04710b0395390b36a0ba6/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:45.887607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933da274-d572-4f3e-83bf-412ff9243e38 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:45.887607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933da274-d572-4f3e-83bf-412ff9243e38 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:45.887607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933da274-d572-4f3e-83bf-412ff9243e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:45.919688 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:45.960596 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-933da274-d572-4f3e-83bf-412ff9243e38 None None] MFA Rules not processed for user `b273b0ca7ce04710b0395390b36a0ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:45.962181 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-933da274-d572-4f3e-83bf-412ff9243e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:46.013227 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a0607-650c-4ac3-82e9-ae578e34fbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:46.014374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a0607-650c-4ac3-82e9-ae578e34fbcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:46.014834 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a0607-650c-4ac3-82e9-ae578e34fbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:46.015257 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a0607-650c-4ac3-82e9-ae578e34fbcc admin admin] PATH_INFO: `/v3/projects/ded983caad0d438ab60758f400f1978f` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:46.018253 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a0607-650c-4ac3-82e9-ae578e34fbcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ded983caad0d438ab60758f400f1978f)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:46.023431 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a0607-650c-4ac3-82e9-ae578e34fbcc admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:46.050448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:46.140077 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-222a0607-650c-4ac3-82e9-ae578e34fbcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ded983caad0d438ab60758f400f1978f', 'request_id': 'req-222a0607-650c-4ac3-82e9-ae578e34fbcc'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:46.156698 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-222a0607-650c-4ac3-82e9-ae578e34fbcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ded983caad0d438ab60758f400f1978f', 'request_id': 'req-222a0607-650c-4ac3-82e9-ae578e34fbcc'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:46.164047 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 918/1843] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:46.164047 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933da274-d572-4f3e-83bf-412ff9243e38 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:46.164047 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-933da274-d572-4f3e-83bf-412ff9243e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:46.176835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-222a0607-650c-4ac3-82e9-ae578e34fbcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ded983caad0d438ab60758f400f1978f', 'request_id': 'req-222a0607-650c-4ac3-82e9-ae578e34fbcc'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:46.203861 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-222a0607-650c-4ac3-82e9-ae578e34fbcc admin admin] The token cache is being invalidate because project ded983caad0d438ab60758f400f1978f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:04:46.204243 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-222a0607-650c-4ac3-82e9-ae578e34fbcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:46.208306 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-222a0607-650c-4ac3-82e9-ae578e34fbcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:46.211295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 926/1844] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:04:45 2022] DELETE /identity/v3/projects/ded983caad0d438ab60758f400f1978f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:04:46.215841 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eff0eb-4265-4800-a537-45e7746e22b5 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:46.216255 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eff0eb-4265-4800-a537-45e7746e22b5 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:46.216626 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eff0eb-4265-4800-a537-45e7746e22b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:46.255159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-d8eff0eb-4265-4800-a537-45e7746e22b5 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:46.256543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-d8eff0eb-4265-4800-a537-45e7746e22b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:46.303377 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933da274-d572-4f3e-83bf-412ff9243e38 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:46.387308 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 927/1845] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:04:46.388423 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eff0eb-4265-4800-a537-45e7746e22b5 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:46.392932 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-d8eff0eb-4265-4800-a537-45e7746e22b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:46.420378 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2866c4-af52-4077-9737-76d9b754ffdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:46.421391 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2866c4-af52-4077-9737-76d9b754ffdb service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:46.421761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2866c4-af52-4077-9737-76d9b754ffdb service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:46.422130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2866c4-af52-4077-9737-76d9b754ffdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:46.429142 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-0a2866c4-af52-4077-9737-76d9b754ffdb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:46.494556 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eff0eb-4265-4800-a537-45e7746e22b5 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:46.499038 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d63746-e5d6-44e3-92ff-2dbe89dc2dac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:46.499884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d63746-e5d6-44e3-92ff-2dbe89dc2dac service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:46.500168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d63746-e5d6-44e3-92ff-2dbe89dc2dac service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:46.500441 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d63746-e5d6-44e3-92ff-2dbe89dc2dac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:46.504169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-62d63746-e5d6-44e3-92ff-2dbe89dc2dac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:46.615947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2866c4-af52-4077-9737-76d9b754ffdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:46.617132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:46.618839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2866c4-af52-4077-9737-76d9b754ffdb service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:46.621352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d63746-e5d6-44e3-92ff-2dbe89dc2dac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:46.625322 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d63746-e5d6-44e3-92ff-2dbe89dc2dac service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:46.639172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 919/1846] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:46.647332 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfcd57-a688-4931-93af-1d493e105a2d None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:46.647692 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfcd57-a688-4931-93af-1d493e105a2d None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:46.647967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfcd57-a688-4931-93af-1d493e105a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:46.657153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 928/1847] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:46.667932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:46.691912 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-e6dfcd57-a688-4931-93af-1d493e105a2d None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:46.693038 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-e6dfcd57-a688-4931-93af-1d493e105a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:46.714718 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 920/1848] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:46.724143 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d63746-e5d6-44e3-92ff-2dbe89dc2dac service cinder] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:46.748228 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d63746-e5d6-44e3-92ff-2dbe89dc2dac service cinder] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:46.757191 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506a8ab-3a17-4688-a37c-ee2133a8c9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:46.758099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506a8ab-3a17-4688-a37c-ee2133a8c9ef admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:46.758385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506a8ab-3a17-4688-a37c-ee2133a8c9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:46.758937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506a8ab-3a17-4688-a37c-ee2133a8c9ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:46.763402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506a8ab-3a17-4688-a37c-ee2133a8c9ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:04:46.763886 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506a8ab-3a17-4688-a37c-ee2133a8c9ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:46.766317 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506a8ab-3a17-4688-a37c-ee2133a8c9ef admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:46.784213 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 929/1849] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 02:04:46.789934 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfcd57-a688-4931-93af-1d493e105a2d None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:46.802502 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfcd57-a688-4931-93af-1d493e105a2d None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:46.817140 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3c284-1b04-47b1-a1e1-837a3860ee58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:46.818114 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3c284-1b04-47b1-a1e1-837a3860ee58 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:46.820089 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3c284-1b04-47b1-a1e1-837a3860ee58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:46.820519 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3c284-1b04-47b1-a1e1-837a3860ee58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:46.821326 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3c284-1b04-47b1-a1e1-837a3860ee58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:46.824806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3c284-1b04-47b1-a1e1-837a3860ee58 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:46.908919 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 921/1850] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:46 2022] POST /identity/v3/projects => generated 401 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:46.914382 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506a8ab-3a17-4688-a37c-ee2133a8c9ef admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:46.937866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506a8ab-3a17-4688-a37c-ee2133a8c9ef admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:47.059261 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1de16-cc26-41f0-a19f-d3ff5db5c8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:47.064048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1de16-cc26-41f0-a19f-d3ff5db5c8dc admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:47.064971 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1de16-cc26-41f0-a19f-d3ff5db5c8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:47.067271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1de16-cc26-41f0-a19f-d3ff5db5c8dc admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:47.067656 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1de16-cc26-41f0-a19f-d3ff5db5c8dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:47.070508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1de16-cc26-41f0-a19f-d3ff5db5c8dc admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:47.106786 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 930/1851] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:46 2022] POST /identity/v3/users => generated 301 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:47.110723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3c284-1b04-47b1-a1e1-837a3860ee58 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:47.131122 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3c284-1b04-47b1-a1e1-837a3860ee58 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:47.147686 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66800998-d55f-46f5-ac13-a3b31579205b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:47.148292 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66800998-d55f-46f5-ac13-a3b31579205b admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:47.148575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66800998-d55f-46f5-ac13-a3b31579205b admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:47.148849 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66800998-d55f-46f5-ac13-a3b31579205b admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:47.149597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66800998-d55f-46f5-ac13-a3b31579205b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:47.154281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66800998-d55f-46f5-ac13-a3b31579205b admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:47.187915 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 922/1852] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:47.191291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1de16-cc26-41f0-a19f-d3ff5db5c8dc admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:47.207586 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1de16-cc26-41f0-a19f-d3ff5db5c8dc admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:47.219233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc6fbd-f96b-4d76-9603-3b0ac9100080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:47.219233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc6fbd-f96b-4d76-9603-3b0ac9100080 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:47.219233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc6fbd-f96b-4d76-9603-3b0ac9100080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:47.219233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc6fbd-f96b-4d76-9603-3b0ac9100080 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:47.219623 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc6fbd-f96b-4d76-9603-3b0ac9100080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:47.220488 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc6fbd-f96b-4d76-9603-3b0ac9100080 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:47.239820 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 931/1853] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:47.240777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66800998-d55f-46f5-ac13-a3b31579205b admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:47.265078 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66800998-d55f-46f5-ac13-a3b31579205b admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:47.273196 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70bb6c-7dd9-42cf-bdc7-4b5b40c9c184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:47.280415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70bb6c-7dd9-42cf-bdc7-4b5b40c9c184 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:47.280706 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70bb6c-7dd9-42cf-bdc7-4b5b40c9c184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:47.281001 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70bb6c-7dd9-42cf-bdc7-4b5b40c9c184 admin admin] PATH_INFO: `/v3/projects/b0c3ada9affd4d8399bfc3cc15088351/users/ae957516ea06446e896f13b81ab71407/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:47.297821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70bb6c-7dd9-42cf-bdc7-4b5b40c9c184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c3ada9affd4d8399bfc3cc15088351, user_id=ae957516ea06446e896f13b81ab71407, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:47.301013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70bb6c-7dd9-42cf-bdc7-4b5b40c9c184 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:47.319342 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 923/1854] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:47 2022] PUT /identity/v3/projects/b0c3ada9affd4d8399bfc3cc15088351/users/ae957516ea06446e896f13b81ab71407/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:04:47.332817 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7b49e-87f0-4186-85ea-f3a8147db458 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:47.332817 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7b49e-87f0-4186-85ea-f3a8147db458 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:47.332817 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7b49e-87f0-4186-85ea-f3a8147db458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:47.387791 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-afd7b49e-87f0-4186-85ea-f3a8147db458 None None] MFA Rules not processed for user `ae957516ea06446e896f13b81ab71407`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:47.389013 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-afd7b49e-87f0-4186-85ea-f3a8147db458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:47.534910 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 932/1855] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:04:47.540223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70bb6c-7dd9-42cf-bdc7-4b5b40c9c184 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:47.632353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70bb6c-7dd9-42cf-bdc7-4b5b40c9c184 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:47.637225 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dd69c-a667-4414-abe6-5f13de439257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:47.637909 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dd69c-a667-4414-abe6-5f13de439257 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:47.638192 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dd69c-a667-4414-abe6-5f13de439257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:47.638465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dd69c-a667-4414-abe6-5f13de439257 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:47.639170 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2dd69c-a667-4414-abe6-5f13de439257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:47.641165 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2dd69c-a667-4414-abe6-5f13de439257 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:47.668892 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 924/1856] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:47 2022] POST /identity/v3/projects => generated 401 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:47.673248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7b49e-87f0-4186-85ea-f3a8147db458 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:47.684658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7b49e-87f0-4186-85ea-f3a8147db458 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:47.747342 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:47.767986 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2a0e5-2c2b-4b4e-89ec-adfb5a4700b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:47.768864 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2a0e5-2c2b-4b4e-89ec-adfb5a4700b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:47.769146 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2a0e5-2c2b-4b4e-89ec-adfb5a4700b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:47.769469 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2a0e5-2c2b-4b4e-89ec-adfb5a4700b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:47.770221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2a0e5-2c2b-4b4e-89ec-adfb5a4700b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:47.772436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2a0e5-2c2b-4b4e-89ec-adfb5a4700b8 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:47.804645 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 933/1857] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:47 2022] POST /identity/v3/users => generated 307 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:04:47.806253 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dd69c-a667-4414-abe6-5f13de439257 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:47.827237 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dd69c-a667-4414-abe6-5f13de439257 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:47.840412 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0b311-e24b-4c6a-abe0-f7081a55f455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:47.841277 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0b311-e24b-4c6a-abe0-f7081a55f455 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:47.841565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0b311-e24b-4c6a-abe0-f7081a55f455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:47.841844 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0b311-e24b-4c6a-abe0-f7081a55f455 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:47.842609 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0b311-e24b-4c6a-abe0-f7081a55f455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:47.847564 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0b311-e24b-4c6a-abe0-f7081a55f455 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:47.887701 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 925/1858] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:04:47.889442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10dbe8-3f4b-4044-94d9-45cba2908ecf None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:47.889729 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10dbe8-3f4b-4044-94d9-45cba2908ecf None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:47.890006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10dbe8-3f4b-4044-94d9-45cba2908ecf None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:47.890542 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0b311-e24b-4c6a-abe0-f7081a55f455 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:47.891835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 934/1859] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 23 02:04:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 02:04:47.913590 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a821f-7b9f-417f-985e-4262adf7326c None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:47.914040 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a821f-7b9f-417f-985e-4262adf7326c None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:47.914322 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a821f-7b9f-417f-985e-4262adf7326c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:47.918101 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0b311-e24b-4c6a-abe0-f7081a55f455 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:47.934763 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649e255-060b-48c0-8d6d-55500ef2434d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:47.936990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649e255-060b-48c0-8d6d-55500ef2434d admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:47.937301 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649e255-060b-48c0-8d6d-55500ef2434d admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:47.937587 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649e255-060b-48c0-8d6d-55500ef2434d admin admin] PATH_INFO: `/v3/projects/29cb4539f6c1405ab2ea21a0f5af2f5e/users/a38d1d98005c4217b329499bf81be4da/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:47.958739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-fe1a821f-7b9f-417f-985e-4262adf7326c None None] MFA Rules not processed for user `9d3b5180fb7144c394c39d4db28713b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:47.960155 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-fe1a821f-7b9f-417f-985e-4262adf7326c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:47.982973 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649e255-060b-48c0-8d6d-55500ef2434d admin admin] RBAC: Authorizing `identity:create_grant(project_id=29cb4539f6c1405ab2ea21a0f5af2f5e, user_id=a38d1d98005c4217b329499bf81be4da, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:47.989352 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649e255-060b-48c0-8d6d-55500ef2434d admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:48.014854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 926/1860] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:47 2022] PUT /identity/v3/projects/29cb4539f6c1405ab2ea21a0f5af2f5e/users/a38d1d98005c4217b329499bf81be4da/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:48.021641 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649e255-060b-48c0-8d6d-55500ef2434d admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:48.087900 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 935/1861] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 23 02:04:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:48.104966 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a821f-7b9f-417f-985e-4262adf7326c None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:48.106368 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-fe1a821f-7b9f-417f-985e-4262adf7326c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:48.120210 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:48.134386 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a821f-7b9f-417f-985e-4262adf7326c None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:48.137141 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649e255-060b-48c0-8d6d-55500ef2434d admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:48.143545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f44460-7664-452e-a5c6-f250736594d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:48.144671 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f44460-7664-452e-a5c6-f250736594d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:48.145098 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f44460-7664-452e-a5c6-f250736594d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:48.145392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f44460-7664-452e-a5c6-f250736594d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:48.146905 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f44460-7664-452e-a5c6-f250736594d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:48.149246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f44460-7664-452e-a5c6-f250736594d2 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:48.167089 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 927/1862] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:48.172221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f44460-7664-452e-a5c6-f250736594d2 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:48.199498 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f44460-7664-452e-a5c6-f250736594d2 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:48.206625 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3406d-d29c-4cd5-b5bd-c77b61ee9313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:48.207962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3406d-d29c-4cd5-b5bd-c77b61ee9313 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:48.208243 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3406d-d29c-4cd5-b5bd-c77b61ee9313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:48.208528 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3406d-d29c-4cd5-b5bd-c77b61ee9313 admin admin] PATH_INFO: `/v3/projects/29cb4539f6c1405ab2ea21a0f5af2f5e/users/a38d1d98005c4217b329499bf81be4da/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:48.211886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3406d-d29c-4cd5-b5bd-c77b61ee9313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29cb4539f6c1405ab2ea21a0f5af2f5e, user_id=a38d1d98005c4217b329499bf81be4da, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:48.217086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3406d-d29c-4cd5-b5bd-c77b61ee9313 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:48.219018 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04414391-d868-472e-a20b-b4b91db5375c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:48.219448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04414391-d868-472e-a20b-b4b91db5375c service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:48.219772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04414391-d868-472e-a20b-b4b91db5375c service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:48.220116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04414391-d868-472e-a20b-b4b91db5375c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:48.232901 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04414391-d868-472e-a20b-b4b91db5375c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:48.234949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04414391-d868-472e-a20b-b4b91db5375c service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:48.244803 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 928/1863] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:48 2022] PUT /identity/v3/projects/29cb4539f6c1405ab2ea21a0f5af2f5e/users/a38d1d98005c4217b329499bf81be4da/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:04:48.247593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 936/1864] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:04:48.256718 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84433c-463f-451f-a308-bd8662becb5f None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:48.257841 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84433c-463f-451f-a308-bd8662becb5f None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:48.258970 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84433c-463f-451f-a308-bd8662becb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:48.326039 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-4d84433c-463f-451f-a308-bd8662becb5f None None] MFA Rules not processed for user `a38d1d98005c4217b329499bf81be4da`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:48.328226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-4d84433c-463f-451f-a308-bd8662becb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:48.449469 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 929/1865] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:48 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:48.506035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04414391-d868-472e-a20b-b4b91db5375c service nova] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:48.604348 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04414391-d868-472e-a20b-b4b91db5375c service nova] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:48.618657 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:48.679280 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e43ab4-8011-42ac-b227-06f6fbb1c54a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:48.680000 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e43ab4-8011-42ac-b227-06f6fbb1c54a service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:48.680280 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e43ab4-8011-42ac-b227-06f6fbb1c54a service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:48.680604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e43ab4-8011-42ac-b227-06f6fbb1c54a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:48.695955 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e43ab4-8011-42ac-b227-06f6fbb1c54a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:48.697450 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e43ab4-8011-42ac-b227-06f6fbb1c54a service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:48.715298 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 937/1866] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:48 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:04:48.949252 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84433c-463f-451f-a308-bd8662becb5f None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:48.974246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84433c-463f-451f-a308-bd8662becb5f None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:48.986391 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799fd20-8cb6-42d2-b798-042712affc62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:48.987571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799fd20-8cb6-42d2-b798-042712affc62 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:48.988353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799fd20-8cb6-42d2-b798-042712affc62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:48.988478 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799fd20-8cb6-42d2-b798-042712affc62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:49.094237 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799fd20-8cb6-42d2-b798-042712affc62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:49.097130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799fd20-8cb6-42d2-b798-042712affc62 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:49.113829 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 930/1867] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:04:51.185832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e43ab4-8011-42ac-b227-06f6fbb1c54a service cinder] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:51.188392 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-43e43ab4-8011-42ac-b227-06f6fbb1c54a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:51.273614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e43ab4-8011-42ac-b227-06f6fbb1c54a service cinder] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:51.278748 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bb5a8-5cee-42de-a088-17ad6627fbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:51.281565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bb5a8-5cee-42de-a088-17ad6627fbf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:51.281565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bb5a8-5cee-42de-a088-17ad6627fbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:51.281565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bb5a8-5cee-42de-a088-17ad6627fbf2 admin admin] PATH_INFO: `/v3/users/483cbd2116d5437ab39b898afeb8974f` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:51.282756 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bb5a8-5cee-42de-a088-17ad6627fbf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=483cbd2116d5437ab39b898afeb8974f)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:51.284865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bb5a8-5cee-42de-a088-17ad6627fbf2 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:51.349207 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-ba8bb5a8-5cee-42de-a088-17ad6627fbf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '483cbd2116d5437ab39b898afeb8974f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:51.359098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-ba8bb5a8-5cee-42de-a088-17ad6627fbf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '483cbd2116d5437ab39b898afeb8974f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:51.359937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-ba8bb5a8-5cee-42de-a088-17ad6627fbf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '483cbd2116d5437ab39b898afeb8974f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:51.360554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-ba8bb5a8-5cee-42de-a088-17ad6627fbf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '483cbd2116d5437ab39b898afeb8974f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:51.381518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-ba8bb5a8-5cee-42de-a088-17ad6627fbf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '483cbd2116d5437ab39b898afeb8974f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:51.403001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 938/1868] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:04:51 2022] DELETE /identity/v3/users/483cbd2116d5437ab39b898afeb8974f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:51.407747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75359a09-268d-417a-b66c-d2856b1c487e None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:51.408288 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75359a09-268d-417a-b66c-d2856b1c487e None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:51.408288 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75359a09-268d-417a-b66c-d2856b1c487e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:51.431563 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-75359a09-268d-417a-b66c-d2856b1c487e None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:51.432952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-75359a09-268d-417a-b66c-d2856b1c487e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:51.508372 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:51.529129 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 931/1869] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:51.547193 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bb5a8-5cee-42de-a088-17ad6627fbf2 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:51.550466 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-ba8bb5a8-5cee-42de-a088-17ad6627fbf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:51.632255 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:51.665116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bb5a8-5cee-42de-a088-17ad6627fbf2 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:51.669593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739bf49-575b-4237-80cb-b645e5303164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:51.670325 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739bf49-575b-4237-80cb-b645e5303164 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:51.670655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739bf49-575b-4237-80cb-b645e5303164 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:51.670935 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739bf49-575b-4237-80cb-b645e5303164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:51.682521 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739bf49-575b-4237-80cb-b645e5303164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:51.684183 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739bf49-575b-4237-80cb-b645e5303164 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:51.697597 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 939/1870] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:52.762225 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75359a09-268d-417a-b66c-d2856b1c487e None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:52.765768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-75359a09-268d-417a-b66c-d2856b1c487e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:52.783003 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75359a09-268d-417a-b66c-d2856b1c487e None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:52.791430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77f170-1073-403d-a54d-d79e678f4522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:52.792332 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77f170-1073-403d-a54d-d79e678f4522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:52.792637 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77f170-1073-403d-a54d-d79e678f4522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:52.793079 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77f170-1073-403d-a54d-d79e678f4522 admin admin] PATH_INFO: `/v3/projects/66fa25f096764fe5bb72b919cd7c0c83` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:52.796829 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77f170-1073-403d-a54d-d79e678f4522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66fa25f096764fe5bb72b919cd7c0c83)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:52.799251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77f170-1073-403d-a54d-d79e678f4522 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:52.879584 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-dd77f170-1073-403d-a54d-d79e678f4522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66fa25f096764fe5bb72b919cd7c0c83', 'request_id': 'req-dd77f170-1073-403d-a54d-d79e678f4522'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:52.892625 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-dd77f170-1073-403d-a54d-d79e678f4522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66fa25f096764fe5bb72b919cd7c0c83', 'request_id': 'req-dd77f170-1073-403d-a54d-d79e678f4522'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:52.941345 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-dd77f170-1073-403d-a54d-d79e678f4522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66fa25f096764fe5bb72b919cd7c0c83', 'request_id': 'req-dd77f170-1073-403d-a54d-d79e678f4522'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:52.963076 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-dd77f170-1073-403d-a54d-d79e678f4522 admin admin] The token cache is being invalidate because project 66fa25f096764fe5bb72b919cd7c0c83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:04:52.963779 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-dd77f170-1073-403d-a54d-d79e678f4522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:52.965058 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-dd77f170-1073-403d-a54d-d79e678f4522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:52.967384 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 932/1871] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:04:52 2022] DELETE /identity/v3/projects/66fa25f096764fe5bb72b919cd7c0c83 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:52.972306 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739bf49-575b-4237-80cb-b645e5303164 service neutron] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:52.983218 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739bf49-575b-4237-80cb-b645e5303164 service neutron] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:53.054722 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e2ca6-5b94-4559-948b-fdc6e1d83aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:53.055814 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e2ca6-5b94-4559-948b-fdc6e1d83aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:53.056172 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e2ca6-5b94-4559-948b-fdc6e1d83aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:53.056509 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e2ca6-5b94-4559-948b-fdc6e1d83aac admin admin] PATH_INFO: `/v3/users/b90aeb262e694ff4b80b9fe81f295c6c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:53.057941 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e2ca6-5b94-4559-948b-fdc6e1d83aac admin admin] RBAC: Authorizing `identity:delete_user(user_id=b90aeb262e694ff4b80b9fe81f295c6c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:53.060050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e2ca6-5b94-4559-948b-fdc6e1d83aac admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:53.110439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-2b4e2ca6-5b94-4559-948b-fdc6e1d83aac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b90aeb262e694ff4b80b9fe81f295c6c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:53.117357 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-2b4e2ca6-5b94-4559-948b-fdc6e1d83aac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b90aeb262e694ff4b80b9fe81f295c6c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:53.118061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-2b4e2ca6-5b94-4559-948b-fdc6e1d83aac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b90aeb262e694ff4b80b9fe81f295c6c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:53.119497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-2b4e2ca6-5b94-4559-948b-fdc6e1d83aac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b90aeb262e694ff4b80b9fe81f295c6c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:53.131767 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-2b4e2ca6-5b94-4559-948b-fdc6e1d83aac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b90aeb262e694ff4b80b9fe81f295c6c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:53.145212 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 940/1872] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:04:52 2022] DELETE /identity/v3/users/b90aeb262e694ff4b80b9fe81f295c6c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:53.700800 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77f170-1073-403d-a54d-d79e678f4522 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:53.702909 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-dd77f170-1073-403d-a54d-d79e678f4522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:53.729091 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77f170-1073-403d-a54d-d79e678f4522 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:53.867272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92494f3a-cc95-428a-8894-cdd93882ac11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:53.868297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92494f3a-cc95-428a-8894-cdd93882ac11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:53.868504 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92494f3a-cc95-428a-8894-cdd93882ac11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:53.869031 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92494f3a-cc95-428a-8894-cdd93882ac11 admin admin] PATH_INFO: `/v3/projects/b7f28ad086d8463aaa5300115c64b63a` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:53.872339 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92494f3a-cc95-428a-8894-cdd93882ac11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7f28ad086d8463aaa5300115c64b63a)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:53.874542 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92494f3a-cc95-428a-8894-cdd93882ac11 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:53.997604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-92494f3a-cc95-428a-8894-cdd93882ac11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7f28ad086d8463aaa5300115c64b63a', 'request_id': 'req-92494f3a-cc95-428a-8894-cdd93882ac11'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:54.017627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-92494f3a-cc95-428a-8894-cdd93882ac11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7f28ad086d8463aaa5300115c64b63a', 'request_id': 'req-92494f3a-cc95-428a-8894-cdd93882ac11'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:54.024401 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e2ca6-5b94-4559-948b-fdc6e1d83aac admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:54.025766 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-92494f3a-cc95-428a-8894-cdd93882ac11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7f28ad086d8463aaa5300115c64b63a', 'request_id': 'req-92494f3a-cc95-428a-8894-cdd93882ac11'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:54.026811 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-2b4e2ca6-5b94-4559-948b-fdc6e1d83aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:54.061906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e2ca6-5b94-4559-948b-fdc6e1d83aac admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:54.081805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-92494f3a-cc95-428a-8894-cdd93882ac11 admin admin] The token cache is being invalidate because project b7f28ad086d8463aaa5300115c64b63a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:04:54.082091 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-92494f3a-cc95-428a-8894-cdd93882ac11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:54.082952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-92494f3a-cc95-428a-8894-cdd93882ac11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:54.092730 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 933/1873] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:04:53 2022] DELETE /identity/v3/projects/b7f28ad086d8463aaa5300115c64b63a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:54.097912 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1902fb-a1a3-42bb-b45d-19cac11d1cb4 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:54.098258 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1902fb-a1a3-42bb-b45d-19cac11d1cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:54.098528 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1902fb-a1a3-42bb-b45d-19cac11d1cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:54.133155 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-0a1902fb-a1a3-42bb-b45d-19cac11d1cb4 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:54.136869 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-0a1902fb-a1a3-42bb-b45d-19cac11d1cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:54.147773 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:54.268459 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 934/1874] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:04:54.275395 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:54.279110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01abba-b46d-40e7-b4e1-b2e26a96d821 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:54.279507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01abba-b46d-40e7-b4e1-b2e26a96d821 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:54.279858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01abba-b46d-40e7-b4e1-b2e26a96d821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:54.303748 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45853ce1-c4d6-4822-bdd3-19cbc85628d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:54.303748 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45853ce1-c4d6-4822-bdd3-19cbc85628d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:54.303748 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45853ce1-c4d6-4822-bdd3-19cbc85628d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:54.303748 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45853ce1-c4d6-4822-bdd3-19cbc85628d8 admin admin] PATH_INFO: `/v3/users/ae957516ea06446e896f13b81ab71407` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:54.310169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45853ce1-c4d6-4822-bdd3-19cbc85628d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae957516ea06446e896f13b81ab71407)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:54.312238 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45853ce1-c4d6-4822-bdd3-19cbc85628d8 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:54.338395 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-5f01abba-b46d-40e7-b4e1-b2e26a96d821 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:54.340848 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-5f01abba-b46d-40e7-b4e1-b2e26a96d821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:54.370303 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 935/1875] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:54.374809 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01abba-b46d-40e7-b4e1-b2e26a96d821 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:54.387273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01abba-b46d-40e7-b4e1-b2e26a96d821 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:54.393460 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0125d89-803a-4a29-a4e7-d4bd6c7d38fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:54.394413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0125d89-803a-4a29-a4e7-d4bd6c7d38fd admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:54.394890 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0125d89-803a-4a29-a4e7-d4bd6c7d38fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:54.395955 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0125d89-803a-4a29-a4e7-d4bd6c7d38fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:54.397060 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0125d89-803a-4a29-a4e7-d4bd6c7d38fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:04:54.397687 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0125d89-803a-4a29-a4e7-d4bd6c7d38fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:54.400063 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0125d89-803a-4a29-a4e7-d4bd6c7d38fd admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:54.415873 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-45853ce1-c4d6-4822-bdd3-19cbc85628d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae957516ea06446e896f13b81ab71407'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:54.436815 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 936/1876] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:04:54.438055 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-45853ce1-c4d6-4822-bdd3-19cbc85628d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae957516ea06446e896f13b81ab71407'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:54.438423 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0125d89-803a-4a29-a4e7-d4bd6c7d38fd admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:54.438955 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-45853ce1-c4d6-4822-bdd3-19cbc85628d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae957516ea06446e896f13b81ab71407'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:54.439825 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-45853ce1-c4d6-4822-bdd3-19cbc85628d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae957516ea06446e896f13b81ab71407'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:54.451032 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0125d89-803a-4a29-a4e7-d4bd6c7d38fd admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:54.456928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781904d4-d620-4c43-8c97-2fce3819a0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:54.457776 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781904d4-d620-4c43-8c97-2fce3819a0a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:54.458097 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781904d4-d620-4c43-8c97-2fce3819a0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:54.458438 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781904d4-d620-4c43-8c97-2fce3819a0a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:54.459326 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781904d4-d620-4c43-8c97-2fce3819a0a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:54.461963 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781904d4-d620-4c43-8c97-2fce3819a0a7 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:54.467545 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-45853ce1-c4d6-4822-bdd3-19cbc85628d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae957516ea06446e896f13b81ab71407'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:54.489505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 941/1877] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:04:54 2022] DELETE /identity/v3/users/ae957516ea06446e896f13b81ab71407 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:04:54.494758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 937/1878] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:54 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:04:54.495058 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced9ccb-ad94-4f6f-a9ef-2410d5c888fc None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:54.495974 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced9ccb-ad94-4f6f-a9ef-2410d5c888fc None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:54.496468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced9ccb-ad94-4f6f-a9ef-2410d5c888fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:54.499976 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781904d4-d620-4c43-8c97-2fce3819a0a7 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:54.501854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-781904d4-d620-4c43-8c97-2fce3819a0a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:54.517323 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-4ced9ccb-ad94-4f6f-a9ef-2410d5c888fc None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:54.518490 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-4ced9ccb-ad94-4f6f-a9ef-2410d5c888fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:54.590815 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 942/1879] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:04:54.594679 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781904d4-d620-4c43-8c97-2fce3819a0a7 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:54.601349 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced9ccb-ad94-4f6f-a9ef-2410d5c888fc None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:54.602011 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fa7bb-b533-468e-9ed2-d70e9f664d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:54.603220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fa7bb-b533-468e-9ed2-d70e9f664d9b admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:54.603330 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-4ced9ccb-ad94-4f6f-a9ef-2410d5c888fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:54.603775 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fa7bb-b533-468e-9ed2-d70e9f664d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:54.604281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fa7bb-b533-468e-9ed2-d70e9f664d9b admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:54.605613 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fa7bb-b533-468e-9ed2-d70e9f664d9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:54.608380 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fa7bb-b533-468e-9ed2-d70e9f664d9b admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:54.631650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 938/1880] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:54 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:54.637287 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fa7bb-b533-468e-9ed2-d70e9f664d9b admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:54.648458 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fa7bb-b533-468e-9ed2-d70e9f664d9b admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:54.652332 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75a450-95dd-432a-8d30-42bc67340312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:54.653193 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75a450-95dd-432a-8d30-42bc67340312 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:54.653418 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75a450-95dd-432a-8d30-42bc67340312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:54.653759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75a450-95dd-432a-8d30-42bc67340312 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:54.654565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75a450-95dd-432a-8d30-42bc67340312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:54.656321 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75a450-95dd-432a-8d30-42bc67340312 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:54.666875 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 939/1881] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:54.670681 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced9ccb-ad94-4f6f-a9ef-2410d5c888fc None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:54.670895 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75a450-95dd-432a-8d30-42bc67340312 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:54.674539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49914294-0945-4894-87ee-476f85304202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:54.675215 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49914294-0945-4894-87ee-476f85304202 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:54.675518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49914294-0945-4894-87ee-476f85304202 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:54.675787 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49914294-0945-4894-87ee-476f85304202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:54.681385 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75a450-95dd-432a-8d30-42bc67340312 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:54.685313 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49914294-0945-4894-87ee-476f85304202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:54.686184 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac790c3-6a42-4d11-b724-2a027f3c01fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:54.686806 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49914294-0945-4894-87ee-476f85304202 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:54.686908 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac790c3-6a42-4d11-b724-2a027f3c01fc admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:54.687173 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac790c3-6a42-4d11-b724-2a027f3c01fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:54.687476 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac790c3-6a42-4d11-b724-2a027f3c01fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:54.688287 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac790c3-6a42-4d11-b724-2a027f3c01fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:54.689938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac790c3-6a42-4d11-b724-2a027f3c01fc admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:54.697015 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 943/1882] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:54.703834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 940/1883] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:04:54.708208 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49914294-0945-4894-87ee-476f85304202 service neutron] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:54.718080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49914294-0945-4894-87ee-476f85304202 service neutron] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:54.722984 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247299c-9d9d-4ca6-b553-f087d366a8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:54.723904 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247299c-9d9d-4ca6-b553-f087d366a8a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:54.724187 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247299c-9d9d-4ca6-b553-f087d366a8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:54.724607 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247299c-9d9d-4ca6-b553-f087d366a8a2 admin admin] PATH_INFO: `/v3/projects/b9aab9215b3e4754b22425cdfbc3ba81/users/b9644f22a35e4f598c70965d69a1e91f/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:54.739840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247299c-9d9d-4ca6-b553-f087d366a8a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9aab9215b3e4754b22425cdfbc3ba81, user_id=b9644f22a35e4f598c70965d69a1e91f, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:54.742612 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247299c-9d9d-4ca6-b553-f087d366a8a2 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:54.745886 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:54.758155 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 944/1884] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:54 2022] PUT /identity/v3/projects/b9aab9215b3e4754b22425cdfbc3ba81/users/b9644f22a35e4f598c70965d69a1e91f/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:54.768530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82867417-3c13-44cf-9f43-db4c5f4e9e8e None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:54.768753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82867417-3c13-44cf-9f43-db4c5f4e9e8e None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:54.769058 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82867417-3c13-44cf-9f43-db4c5f4e9e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:54.798555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-82867417-3c13-44cf-9f43-db4c5f4e9e8e None None] MFA Rules not processed for user `b9644f22a35e4f598c70965d69a1e91f`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:54.800273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-82867417-3c13-44cf-9f43-db4c5f4e9e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:54.827438 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:54.875381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 941/1885] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:54.880048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247299c-9d9d-4ca6-b553-f087d366a8a2 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:54.948487 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247299c-9d9d-4ca6-b553-f087d366a8a2 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:54.953549 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4249b7-da58-442a-a449-de5b7aa0c1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:54.954240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4249b7-da58-442a-a449-de5b7aa0c1b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:54.954522 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4249b7-da58-442a-a449-de5b7aa0c1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:54.954828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4249b7-da58-442a-a449-de5b7aa0c1b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:54.955635 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4249b7-da58-442a-a449-de5b7aa0c1b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:54.957567 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4249b7-da58-442a-a449-de5b7aa0c1b9 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:54.971752 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82867417-3c13-44cf-9f43-db4c5f4e9e8e None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:54.973285 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-82867417-3c13-44cf-9f43-db4c5f4e9e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:54.989504 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82867417-3c13-44cf-9f43-db4c5f4e9e8e None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:54.995164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba64acc-b60c-42b4-a7e7-d90dcc7a46ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:54.996154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba64acc-b60c-42b4-a7e7-d90dcc7a46ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:54.996500 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba64acc-b60c-42b4-a7e7-d90dcc7a46ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:54.996842 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba64acc-b60c-42b4-a7e7-d90dcc7a46ba admin admin] PATH_INFO: `/v3/projects/b0c3ada9affd4d8399bfc3cc15088351` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:54.999222 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba64acc-b60c-42b4-a7e7-d90dcc7a46ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c3ada9affd4d8399bfc3cc15088351)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:55.000577 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba64acc-b60c-42b4-a7e7-d90dcc7a46ba admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:55.023964 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 945/1886] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:54 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:55.025316 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4249b7-da58-442a-a449-de5b7aa0c1b9 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:55.071863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-6ba64acc-b60c-42b4-a7e7-d90dcc7a46ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c3ada9affd4d8399bfc3cc15088351', 'request_id': 'req-6ba64acc-b60c-42b4-a7e7-d90dcc7a46ba'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:55.087941 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-6ba64acc-b60c-42b4-a7e7-d90dcc7a46ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c3ada9affd4d8399bfc3cc15088351', 'request_id': 'req-6ba64acc-b60c-42b4-a7e7-d90dcc7a46ba'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:55.101066 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-6ba64acc-b60c-42b4-a7e7-d90dcc7a46ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c3ada9affd4d8399bfc3cc15088351', 'request_id': 'req-6ba64acc-b60c-42b4-a7e7-d90dcc7a46ba'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:55.114654 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-6ba64acc-b60c-42b4-a7e7-d90dcc7a46ba admin admin] The token cache is being invalidate because project b0c3ada9affd4d8399bfc3cc15088351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:04:55.115082 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-6ba64acc-b60c-42b4-a7e7-d90dcc7a46ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:55.115901 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-6ba64acc-b60c-42b4-a7e7-d90dcc7a46ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:55.117614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 942/1887] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:04:54 2022] DELETE /identity/v3/projects/b0c3ada9affd4d8399bfc3cc15088351 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:04:55.121489 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba64acc-b60c-42b4-a7e7-d90dcc7a46ba admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:55.122949 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-6ba64acc-b60c-42b4-a7e7-d90dcc7a46ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:55.124027 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4249b7-da58-442a-a449-de5b7aa0c1b9 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:55.210775 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba64acc-b60c-42b4-a7e7-d90dcc7a46ba admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:55.217365 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cbdff-220c-4a52-be59-2cd7c1f4caa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:55.218439 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cbdff-220c-4a52-be59-2cd7c1f4caa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:55.218830 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cbdff-220c-4a52-be59-2cd7c1f4caa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:55.219208 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cbdff-220c-4a52-be59-2cd7c1f4caa6 admin admin] PATH_INFO: `/v3/users/a38d1d98005c4217b329499bf81be4da` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:55.220661 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184cbdff-220c-4a52-be59-2cd7c1f4caa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a38d1d98005c4217b329499bf81be4da)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:55.222811 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18342c80-79a5-4853-abfa-f60ec0d1f4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:55.222953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184cbdff-220c-4a52-be59-2cd7c1f4caa6 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:55.223810 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18342c80-79a5-4853-abfa-f60ec0d1f4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:55.224598 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18342c80-79a5-4853-abfa-f60ec0d1f4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:55.225387 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18342c80-79a5-4853-abfa-f60ec0d1f4d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:55.226274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18342c80-79a5-4853-abfa-f60ec0d1f4d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:55.231159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18342c80-79a5-4853-abfa-f60ec0d1f4d9 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:55.266394 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 946/1888] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:55 2022] POST /identity/v3/users => generated 300 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:55.271707 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18342c80-79a5-4853-abfa-f60ec0d1f4d9 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:55.276025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-18342c80-79a5-4853-abfa-f60ec0d1f4d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:55.287065 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18342c80-79a5-4853-abfa-f60ec0d1f4d9 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:55.293258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbb6df-192d-4d9a-923d-28dc0e1dd267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:55.293928 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbb6df-192d-4d9a-923d-28dc0e1dd267 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:55.294249 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbb6df-192d-4d9a-923d-28dc0e1dd267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:55.294538 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbb6df-192d-4d9a-923d-28dc0e1dd267 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:55.295387 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dbb6df-192d-4d9a-923d-28dc0e1dd267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:55.295526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-184cbdff-220c-4a52-be59-2cd7c1f4caa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a38d1d98005c4217b329499bf81be4da'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:55.297082 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dbb6df-192d-4d9a-923d-28dc0e1dd267 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:55.299047 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:55.310779 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 947/1889] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:55.315362 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbb6df-192d-4d9a-923d-28dc0e1dd267 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:55.319681 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-184cbdff-220c-4a52-be59-2cd7c1f4caa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a38d1d98005c4217b329499bf81be4da'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:55.326671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbb6df-192d-4d9a-923d-28dc0e1dd267 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:55.329154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-184cbdff-220c-4a52-be59-2cd7c1f4caa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a38d1d98005c4217b329499bf81be4da'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:55.330186 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-184cbdff-220c-4a52-be59-2cd7c1f4caa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a38d1d98005c4217b329499bf81be4da'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:55.331963 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664463f-770a-4e4a-b783-104ff4e71fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:55.333020 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664463f-770a-4e4a-b783-104ff4e71fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:55.333306 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664463f-770a-4e4a-b783-104ff4e71fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:55.333586 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664463f-770a-4e4a-b783-104ff4e71fa3 admin admin] PATH_INFO: `/v3/projects/1a6c68a0faa84e829a3a640dda8d381f/users/c4673ec8d890411684f5eda918bce367/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:55.337581 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:55.344763 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-184cbdff-220c-4a52-be59-2cd7c1f4caa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a38d1d98005c4217b329499bf81be4da'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:55.356433 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 943/1890] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:04:55 2022] DELETE /identity/v3/users/a38d1d98005c4217b329499bf81be4da => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:04:55.357993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664463f-770a-4e4a-b783-104ff4e71fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a6c68a0faa84e829a3a640dda8d381f, user_id=c4673ec8d890411684f5eda918bce367, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:55.361318 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664463f-770a-4e4a-b783-104ff4e71fa3 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:55.381503 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 948/1891] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:55 2022] PUT /identity/v3/projects/1a6c68a0faa84e829a3a640dda8d381f/users/c4673ec8d890411684f5eda918bce367/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:04:55.385824 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cbdff-220c-4a52-be59-2cd7c1f4caa6 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:55.387520 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-184cbdff-220c-4a52-be59-2cd7c1f4caa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:55.498896 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cbdff-220c-4a52-be59-2cd7c1f4caa6 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:55.694834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68d8e1-3855-4c36-ba87-2f530f4424c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:55.696831 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68d8e1-3855-4c36-ba87-2f530f4424c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:55.697877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68d8e1-3855-4c36-ba87-2f530f4424c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:55.699119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68d8e1-3855-4c36-ba87-2f530f4424c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:55.702021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68d8e1-3855-4c36-ba87-2f530f4424c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:55.713253 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68d8e1-3855-4c36-ba87-2f530f4424c4 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:55.751118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 944/1892] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:55.755643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664463f-770a-4e4a-b783-104ff4e71fa3 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:55.773467 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664463f-770a-4e4a-b783-104ff4e71fa3 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:55.779953 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f15e2c-9002-41a5-8314-166c6d8578e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:55.781112 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f15e2c-9002-41a5-8314-166c6d8578e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:55.781410 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f15e2c-9002-41a5-8314-166c6d8578e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:55.781739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f15e2c-9002-41a5-8314-166c6d8578e7 admin admin] PATH_INFO: `/v3/projects/1a6c68a0faa84e829a3a640dda8d381f/users/c4673ec8d890411684f5eda918bce367/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:55.784402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f15e2c-9002-41a5-8314-166c6d8578e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a6c68a0faa84e829a3a640dda8d381f, user_id=c4673ec8d890411684f5eda918bce367, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:55.788616 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f15e2c-9002-41a5-8314-166c6d8578e7 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:55.807914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 949/1893] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:55 2022] PUT /identity/v3/projects/1a6c68a0faa84e829a3a640dda8d381f/users/c4673ec8d890411684f5eda918bce367/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:55.819651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf62728-1b60-479c-8eb9-6fce57dc7246 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:55.819948 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf62728-1b60-479c-8eb9-6fce57dc7246 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:55.820235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf62728-1b60-479c-8eb9-6fce57dc7246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:55.853143 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-fcf62728-1b60-479c-8eb9-6fce57dc7246 None None] MFA Rules not processed for user `c4673ec8d890411684f5eda918bce367`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:55.854764 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-fcf62728-1b60-479c-8eb9-6fce57dc7246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:55.941293 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:55.954032 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 945/1894] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:55.968694 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f15e2c-9002-41a5-8314-166c6d8578e7 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:55.970689 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-b6f15e2c-9002-41a5-8314-166c6d8578e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:56.024185 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf62728-1b60-479c-8eb9-6fce57dc7246 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:56.028117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-fcf62728-1b60-479c-8eb9-6fce57dc7246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:56.056647 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f15e2c-9002-41a5-8314-166c6d8578e7 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:56.068888 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968289a-76c3-4743-9914-25d68b6fae97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:56.069883 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968289a-76c3-4743-9914-25d68b6fae97 service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:56.070881 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968289a-76c3-4743-9914-25d68b6fae97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:56.071379 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968289a-76c3-4743-9914-25d68b6fae97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:56.087906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968289a-76c3-4743-9914-25d68b6fae97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:56.091308 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968289a-76c3-4743-9914-25d68b6fae97 service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:56.109278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 950/1895] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:56.110375 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968289a-76c3-4743-9914-25d68b6fae97 service cinder] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:56.111713 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-f968289a-76c3-4743-9914-25d68b6fae97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:56.125778 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968289a-76c3-4743-9914-25d68b6fae97 service cinder] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:56.131157 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf62728-1b60-479c-8eb9-6fce57dc7246 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:56.135574 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2462879-e0b4-4c90-b8a1-ccd708775cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:56.136503 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2462879-e0b4-4c90-b8a1-ccd708775cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:56.136800 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2462879-e0b4-4c90-b8a1-ccd708775cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:56.136997 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94831f-e32d-4bae-992a-b7dd0a8e02b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:56.137105 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2462879-e0b4-4c90-b8a1-ccd708775cc7 admin admin] PATH_INFO: `/v3/projects/29cb4539f6c1405ab2ea21a0f5af2f5e` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:56.138277 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2462879-e0b4-4c90-b8a1-ccd708775cc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29cb4539f6c1405ab2ea21a0f5af2f5e)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:56.138381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94831f-e32d-4bae-992a-b7dd0a8e02b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:56.138830 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94831f-e32d-4bae-992a-b7dd0a8e02b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:56.139266 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94831f-e32d-4bae-992a-b7dd0a8e02b9 admin admin] PATH_INFO: `/v3/users/460d40753d094d7ab146e787fd90982d` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:56.140361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2462879-e0b4-4c90-b8a1-ccd708775cc7 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:56.142474 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94831f-e32d-4bae-992a-b7dd0a8e02b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=460d40753d094d7ab146e787fd90982d)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:56.145026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94831f-e32d-4bae-992a-b7dd0a8e02b9 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:56.207863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-6e94831f-e32d-4bae-992a-b7dd0a8e02b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460d40753d094d7ab146e787fd90982d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:56.208977 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e2462879-e0b4-4c90-b8a1-ccd708775cc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29cb4539f6c1405ab2ea21a0f5af2f5e', 'request_id': 'req-e2462879-e0b4-4c90-b8a1-ccd708775cc7'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:56.215643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e2462879-e0b4-4c90-b8a1-ccd708775cc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29cb4539f6c1405ab2ea21a0f5af2f5e', 'request_id': 'req-e2462879-e0b4-4c90-b8a1-ccd708775cc7'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:56.228036 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e2462879-e0b4-4c90-b8a1-ccd708775cc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29cb4539f6c1405ab2ea21a0f5af2f5e', 'request_id': 'req-e2462879-e0b4-4c90-b8a1-ccd708775cc7'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:56.230145 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-6e94831f-e32d-4bae-992a-b7dd0a8e02b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460d40753d094d7ab146e787fd90982d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:56.240099 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-6e94831f-e32d-4bae-992a-b7dd0a8e02b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460d40753d094d7ab146e787fd90982d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:56.241291 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-6e94831f-e32d-4bae-992a-b7dd0a8e02b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460d40753d094d7ab146e787fd90982d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:56.242954 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e2462879-e0b4-4c90-b8a1-ccd708775cc7 admin admin] The token cache is being invalidate because project 29cb4539f6c1405ab2ea21a0f5af2f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:04:56.243366 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e2462879-e0b4-4c90-b8a1-ccd708775cc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:56.244193 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e2462879-e0b4-4c90-b8a1-ccd708775cc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:56.246382 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 951/1896] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:04:56 2022] DELETE /identity/v3/projects/29cb4539f6c1405ab2ea21a0f5af2f5e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:56.250423 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2462879-e0b4-4c90-b8a1-ccd708775cc7 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:56.252122 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-e2462879-e0b4-4c90-b8a1-ccd708775cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:56.254999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-6e94831f-e32d-4bae-992a-b7dd0a8e02b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460d40753d094d7ab146e787fd90982d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:56.264859 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 946/1897] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:04:56 2022] DELETE /identity/v3/users/460d40753d094d7ab146e787fd90982d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:56.266331 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91d962-091d-45c1-a021-0d3073771a06 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:56.266686 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91d962-091d-45c1-a021-0d3073771a06 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:56.267045 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91d962-091d-45c1-a021-0d3073771a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:56.286062 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-dd91d962-091d-45c1-a021-0d3073771a06 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:56.287637 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-dd91d962-091d-45c1-a021-0d3073771a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:56.324196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:56.330768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2462879-e0b4-4c90-b8a1-ccd708775cc7 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:56.357063 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 947/1898] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:56.358530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c02021-7601-44ed-8097-be0ab66454b4 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:56.358855 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c02021-7601-44ed-8097-be0ab66454b4 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:56.359137 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c02021-7601-44ed-8097-be0ab66454b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:56.376691 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-26c02021-7601-44ed-8097-be0ab66454b4 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:56.377913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-26c02021-7601-44ed-8097-be0ab66454b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:56.386005 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 948/1899] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:56.387240 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01a707-290f-4cae-83d8-1f7534269598 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:56.387553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01a707-290f-4cae-83d8-1f7534269598 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:56.387835 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01a707-290f-4cae-83d8-1f7534269598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:56.396739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295647c-043c-444f-b416-499ebe627790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:56.397653 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295647c-043c-444f-b416-499ebe627790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:56.397931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295647c-043c-444f-b416-499ebe627790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:56.398204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295647c-043c-444f-b416-499ebe627790 admin admin] PATH_INFO: `/v3/users/b9644f22a35e4f598c70965d69a1e91f` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:56.399481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295647c-043c-444f-b416-499ebe627790 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9644f22a35e4f598c70965d69a1e91f)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:56.401466 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295647c-043c-444f-b416-499ebe627790 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:56.405576 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-0c01a707-290f-4cae-83d8-1f7534269598 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:56.406796 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-0c01a707-290f-4cae-83d8-1f7534269598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:56.414921 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 949/1900] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:56.415789 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01a707-290f-4cae-83d8-1f7534269598 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:56.417095 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-0c01a707-290f-4cae-83d8-1f7534269598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:56.422639 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:56.456306 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-7295647c-043c-444f-b416-499ebe627790 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9644f22a35e4f598c70965d69a1e91f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:56.464253 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-7295647c-043c-444f-b416-499ebe627790 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9644f22a35e4f598c70965d69a1e91f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:56.465026 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-7295647c-043c-444f-b416-499ebe627790 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9644f22a35e4f598c70965d69a1e91f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:56.465673 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-7295647c-043c-444f-b416-499ebe627790 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9644f22a35e4f598c70965d69a1e91f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:56.477503 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-7295647c-043c-444f-b416-499ebe627790 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9644f22a35e4f598c70965d69a1e91f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:56.479471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01a707-290f-4cae-83d8-1f7534269598 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:56.483385 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ebdbe-4048-4320-9eff-feca9b88e959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:56.484109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ebdbe-4048-4320-9eff-feca9b88e959 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:56.484412 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ebdbe-4048-4320-9eff-feca9b88e959 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:56.484738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ebdbe-4048-4320-9eff-feca9b88e959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:56.486823 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-b14ebdbe-4048-4320-9eff-feca9b88e959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:56.492469 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 952/1901] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:04:56 2022] DELETE /identity/v3/users/b9644f22a35e4f598c70965d69a1e91f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:56.496112 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295647c-043c-444f-b416-499ebe627790 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:56.497032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-7295647c-043c-444f-b416-499ebe627790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:56.498963 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ebdbe-4048-4320-9eff-feca9b88e959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:56.500476 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ebdbe-4048-4320-9eff-feca9b88e959 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:56.510455 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 950/1902] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:56.511791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb7a04-f698-444c-9c00-bdf0071a1519 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:56.512078 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb7a04-f698-444c-9c00-bdf0071a1519 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:56.512356 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb7a04-f698-444c-9c00-bdf0071a1519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:56.533187 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-40fb7a04-f698-444c-9c00-bdf0071a1519 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:56.534424 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-40fb7a04-f698-444c-9c00-bdf0071a1519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:56.597245 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295647c-043c-444f-b416-499ebe627790 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:56.615186 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470880eb-a11b-4b45-bd99-62f01572f28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:56.617873 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470880eb-a11b-4b45-bd99-62f01572f28d admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:56.618264 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470880eb-a11b-4b45-bd99-62f01572f28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:56.618769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470880eb-a11b-4b45-bd99-62f01572f28d admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:56.619698 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470880eb-a11b-4b45-bd99-62f01572f28d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:04:56.619861 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470880eb-a11b-4b45-bd99-62f01572f28d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:56.622354 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470880eb-a11b-4b45-bd99-62f01572f28d admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:56.649433 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 953/1903] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:04:56.650656 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470880eb-a11b-4b45-bd99-62f01572f28d admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:56.668603 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 951/1904] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:56.671614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470880eb-a11b-4b45-bd99-62f01572f28d admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:56.684990 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a422a-89bc-4bc1-b2dc-1adfd9f38b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:56.685880 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a422a-89bc-4bc1-b2dc-1adfd9f38b9c admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:56.686240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a422a-89bc-4bc1-b2dc-1adfd9f38b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:56.686610 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a422a-89bc-4bc1-b2dc-1adfd9f38b9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:56.687458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a422a-89bc-4bc1-b2dc-1adfd9f38b9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:56.689643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a422a-89bc-4bc1-b2dc-1adfd9f38b9c admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:56.712211 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb7a04-f698-444c-9c00-bdf0071a1519 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:56.713611 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:56.715585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-40fb7a04-f698-444c-9c00-bdf0071a1519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:56.741543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 954/1905] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:56 2022] POST /identity/v3/projects => generated 381 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:04:56.743540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a422a-89bc-4bc1-b2dc-1adfd9f38b9c admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:56.850631 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a422a-89bc-4bc1-b2dc-1adfd9f38b9c admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:56.860185 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa57b27-aa98-4cbc-a1b3-c48b1f30fed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:56.860984 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa57b27-aa98-4cbc-a1b3-c48b1f30fed5 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:56.861343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa57b27-aa98-4cbc-a1b3-c48b1f30fed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:56.861689 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa57b27-aa98-4cbc-a1b3-c48b1f30fed5 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:56.862469 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa57b27-aa98-4cbc-a1b3-c48b1f30fed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:56.866622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa57b27-aa98-4cbc-a1b3-c48b1f30fed5 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:56.906823 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb7a04-f698-444c-9c00-bdf0071a1519 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:56.924791 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 955/1906] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:56 2022] POST /identity/v3/users => generated 291 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:56.929581 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa57b27-aa98-4cbc-a1b3-c48b1f30fed5 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:56.964468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa57b27-aa98-4cbc-a1b3-c48b1f30fed5 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:56.986058 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc3bd5-7ad8-4127-829a-31b3cb6d87d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:56.988279 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc3bd5-7ad8-4127-829a-31b3cb6d87d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:56.988667 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc57102-a442-421a-9e06-0371370f8aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:56.989157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc3bd5-7ad8-4127-829a-31b3cb6d87d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:56.989157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc3bd5-7ad8-4127-829a-31b3cb6d87d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:56.989590 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc57102-a442-421a-9e06-0371370f8aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:56.990342 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc57102-a442-421a-9e06-0371370f8aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:56.990627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc57102-a442-421a-9e06-0371370f8aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:56.992157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc3bd5-7ad8-4127-829a-31b3cb6d87d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:56.998065 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc3bd5-7ad8-4127-829a-31b3cb6d87d9 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:57.003124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc57102-a442-421a-9e06-0371370f8aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:57.004707 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc57102-a442-421a-9e06-0371370f8aa3 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:57.017144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 952/1907] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:04:57.018105 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc57102-a442-421a-9e06-0371370f8aa3 service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:57.019460 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-2cc57102-a442-421a-9e06-0371370f8aa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:57.030779 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 956/1908] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:57.031068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:57.032896 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc3bd5-7ad8-4127-829a-31b3cb6d87d9 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:57.038272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc57102-a442-421a-9e06-0371370f8aa3 service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:57.044757 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317766d4-a644-47ec-bb18-2074b9a64543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:57.045876 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317766d4-a644-47ec-bb18-2074b9a64543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:57.046412 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317766d4-a644-47ec-bb18-2074b9a64543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:57.046893 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317766d4-a644-47ec-bb18-2074b9a64543 admin admin] PATH_INFO: `/v3/projects/22670522d77042eca0cf981ba857a117` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:57.049157 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317766d4-a644-47ec-bb18-2074b9a64543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22670522d77042eca0cf981ba857a117)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:57.051957 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317766d4-a644-47ec-bb18-2074b9a64543 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:57.058017 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc3bd5-7ad8-4127-829a-31b3cb6d87d9 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:57.070122 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa58b7-87d7-499a-830b-19866feb1fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:57.071835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa58b7-87d7-499a-830b-19866feb1fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:57.072438 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa58b7-87d7-499a-830b-19866feb1fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:57.075922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa58b7-87d7-499a-830b-19866feb1fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:57.077107 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa58b7-87d7-499a-830b-19866feb1fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:57.080609 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa58b7-87d7-499a-830b-19866feb1fe1 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:57.106520 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 957/1909] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:57.112154 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa58b7-87d7-499a-830b-19866feb1fe1 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:57.125226 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa58b7-87d7-499a-830b-19866feb1fe1 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:57.133863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-317766d4-a644-47ec-bb18-2074b9a64543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22670522d77042eca0cf981ba857a117', 'request_id': 'req-317766d4-a644-47ec-bb18-2074b9a64543'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:57.169376 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-317766d4-a644-47ec-bb18-2074b9a64543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22670522d77042eca0cf981ba857a117', 'request_id': 'req-317766d4-a644-47ec-bb18-2074b9a64543'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:57.184474 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-317766d4-a644-47ec-bb18-2074b9a64543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22670522d77042eca0cf981ba857a117', 'request_id': 'req-317766d4-a644-47ec-bb18-2074b9a64543'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:57.219625 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-317766d4-a644-47ec-bb18-2074b9a64543 admin admin] The token cache is being invalidate because project 22670522d77042eca0cf981ba857a117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:04:57.220057 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-317766d4-a644-47ec-bb18-2074b9a64543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:57.220817 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-317766d4-a644-47ec-bb18-2074b9a64543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:57.222834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 953/1910] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:04:57 2022] DELETE /identity/v3/projects/22670522d77042eca0cf981ba857a117 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:57.227431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317766d4-a644-47ec-bb18-2074b9a64543 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:57.229118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-317766d4-a644-47ec-bb18-2074b9a64543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:57.239702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1a747-8fb4-480c-90da-a9a7549c719b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:57.242638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1a747-8fb4-480c-90da-a9a7549c719b admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:57.242958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1a747-8fb4-480c-90da-a9a7549c719b admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:57.243244 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1a747-8fb4-480c-90da-a9a7549c719b admin admin] PATH_INFO: `/v3/projects/c38a21c7639d4fa0a25e4a216a94579c/users/a465233f11144b86b490cb7a9834eb2d/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:57.263615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317766d4-a644-47ec-bb18-2074b9a64543 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:57.266062 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1a747-8fb4-480c-90da-a9a7549c719b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38a21c7639d4fa0a25e4a216a94579c, user_id=a465233f11144b86b490cb7a9834eb2d, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:57.268867 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1a747-8fb4-480c-90da-a9a7549c719b admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:57.270457 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8ccd8-3c68-4cf1-a9f6-0d29b5d4632c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:57.271934 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8ccd8-3c68-4cf1-a9f6-0d29b5d4632c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:57.272382 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8ccd8-3c68-4cf1-a9f6-0d29b5d4632c admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:57.272747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8ccd8-3c68-4cf1-a9f6-0d29b5d4632c admin admin] PATH_INFO: `/v3/users/f3cc3356a2ed4dfcb36ec3533127d002` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:57.274204 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8ccd8-3c68-4cf1-a9f6-0d29b5d4632c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3cc3356a2ed4dfcb36ec3533127d002)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:57.276887 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8ccd8-3c68-4cf1-a9f6-0d29b5d4632c admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:57.306268 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 958/1911] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:57 2022] PUT /identity/v3/projects/c38a21c7639d4fa0a25e4a216a94579c/users/a465233f11144b86b490cb7a9834eb2d/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:57.318798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836ec7f-8784-4816-8a0a-a73f9a791595 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:57.318798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836ec7f-8784-4816-8a0a-a73f9a791595 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:57.319068 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836ec7f-8784-4816-8a0a-a73f9a791595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:57.363458 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-2be8ccd8-3c68-4cf1-a9f6-0d29b5d4632c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3cc3356a2ed4dfcb36ec3533127d002'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:57.374609 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-b836ec7f-8784-4816-8a0a-a73f9a791595 None None] MFA Rules not processed for user `a465233f11144b86b490cb7a9834eb2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:57.375932 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-b836ec7f-8784-4816-8a0a-a73f9a791595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:57.395630 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-2be8ccd8-3c68-4cf1-a9f6-0d29b5d4632c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3cc3356a2ed4dfcb36ec3533127d002'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:57.407432 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-2be8ccd8-3c68-4cf1-a9f6-0d29b5d4632c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3cc3356a2ed4dfcb36ec3533127d002'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:57.408523 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-2be8ccd8-3c68-4cf1-a9f6-0d29b5d4632c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3cc3356a2ed4dfcb36ec3533127d002'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:57.428493 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-2be8ccd8-3c68-4cf1-a9f6-0d29b5d4632c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3cc3356a2ed4dfcb36ec3533127d002'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:57.442425 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 954/1912] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:04:57 2022] DELETE /identity/v3/users/f3cc3356a2ed4dfcb36ec3533127d002 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:57.447834 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:57.514722 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 959/1913] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:57.519886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8ccd8-3c68-4cf1-a9f6-0d29b5d4632c admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:57.522247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-2be8ccd8-3c68-4cf1-a9f6-0d29b5d4632c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:57.645798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8ccd8-3c68-4cf1-a9f6-0d29b5d4632c admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:57.658592 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99954e12-d9f6-43c0-a45c-3e62f87a4288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:57.659441 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99954e12-d9f6-43c0-a45c-3e62f87a4288 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:57.659793 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99954e12-d9f6-43c0-a45c-3e62f87a4288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:57.660737 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99954e12-d9f6-43c0-a45c-3e62f87a4288 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:57.674735 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99954e12-d9f6-43c0-a45c-3e62f87a4288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:57.677455 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99954e12-d9f6-43c0-a45c-3e62f87a4288 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:57.686625 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:57.747974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 955/1914] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:57 2022] POST /identity/v3/projects => generated 385 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:57.749355 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836ec7f-8784-4816-8a0a-a73f9a791595 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:57.852406 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836ec7f-8784-4816-8a0a-a73f9a791595 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:57.969606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1c007-87ad-4db0-b816-0b26f9a38e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:57.970644 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1c007-87ad-4db0-b816-0b26f9a38e7c admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:57.971267 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1c007-87ad-4db0-b816-0b26f9a38e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:57.971637 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1c007-87ad-4db0-b816-0b26f9a38e7c admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:57.972650 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1c007-87ad-4db0-b816-0b26f9a38e7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:57.975186 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1c007-87ad-4db0-b816-0b26f9a38e7c admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:58.008454 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 960/1915] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:57 2022] POST /identity/v3/users => generated 299 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:58.010887 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99954e12-d9f6-43c0-a45c-3e62f87a4288 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:58.027493 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99954e12-d9f6-43c0-a45c-3e62f87a4288 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:58.035226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb50650-26f8-411a-828c-e9173aa8080c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:58.036120 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb50650-26f8-411a-828c-e9173aa8080c admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:58.036474 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb50650-26f8-411a-828c-e9173aa8080c admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:58.036883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb50650-26f8-411a-828c-e9173aa8080c admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:58.038680 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb50650-26f8-411a-828c-e9173aa8080c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:58.040642 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb50650-26f8-411a-828c-e9173aa8080c admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:58.053732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 956/1916] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:58.057118 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1c007-87ad-4db0-b816-0b26f9a38e7c admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:58.068167 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1c007-87ad-4db0-b816-0b26f9a38e7c admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:58.074281 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba9fb7-1522-4f6c-871b-7a54db862f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:58.075195 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba9fb7-1522-4f6c-871b-7a54db862f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:58.075504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba9fb7-1522-4f6c-871b-7a54db862f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:58.075776 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba9fb7-1522-4f6c-871b-7a54db862f2c admin admin] PATH_INFO: `/v3/projects/191106c0549f4a43bee894f0adf646c5/users/6f71cc21e5e84302b7840bcd670e2a29/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:58.092472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba9fb7-1522-4f6c-871b-7a54db862f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=191106c0549f4a43bee894f0adf646c5, user_id=6f71cc21e5e84302b7840bcd670e2a29, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:58.095365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba9fb7-1522-4f6c-871b-7a54db862f2c admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:58.114754 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 961/1917] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:58 2022] PUT /identity/v3/projects/191106c0549f4a43bee894f0adf646c5/users/6f71cc21e5e84302b7840bcd670e2a29/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:58.118641 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb50650-26f8-411a-828c-e9173aa8080c admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:58.129925 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb50650-26f8-411a-828c-e9173aa8080c admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:58.200489 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21f847-1889-4076-936b-eb350ece21b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:58.201365 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21f847-1889-4076-936b-eb350ece21b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:58.201742 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21f847-1889-4076-936b-eb350ece21b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:58.202025 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21f847-1889-4076-936b-eb350ece21b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:58.202774 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21f847-1889-4076-936b-eb350ece21b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:58.204435 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21f847-1889-4076-936b-eb350ece21b0 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:58.217276 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba9fb7-1522-4f6c-871b-7a54db862f2c admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:58.217989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 957/1918] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:58.219716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-7cba9fb7-1522-4f6c-871b-7a54db862f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:58.222531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21f847-1889-4076-936b-eb350ece21b0 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:58.236032 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21f847-1889-4076-936b-eb350ece21b0 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:58.242480 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f53d5-3d84-4794-9b57-763ea6f4987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:58.243923 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f53d5-3d84-4794-9b57-763ea6f4987b admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:58.244680 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f53d5-3d84-4794-9b57-763ea6f4987b admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:58.245309 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f53d5-3d84-4794-9b57-763ea6f4987b admin admin] PATH_INFO: `/v3/projects/191106c0549f4a43bee894f0adf646c5/users/6f71cc21e5e84302b7840bcd670e2a29/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:58.247878 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba9fb7-1522-4f6c-871b-7a54db862f2c admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:58.248264 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f53d5-3d84-4794-9b57-763ea6f4987b admin admin] RBAC: Authorizing `identity:create_grant(project_id=191106c0549f4a43bee894f0adf646c5, user_id=6f71cc21e5e84302b7840bcd670e2a29, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:58.251517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f53d5-3d84-4794-9b57-763ea6f4987b admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:58.253673 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c6fce-b4a1-467f-931b-3899d44eb398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:58.254728 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c6fce-b4a1-467f-931b-3899d44eb398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:58.255017 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c6fce-b4a1-467f-931b-3899d44eb398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:58.255294 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c6fce-b4a1-467f-931b-3899d44eb398 admin admin] PATH_INFO: `/v3/projects/4a035fae256048f0bb5a5c2b547fc2af` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:58.257143 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c6fce-b4a1-467f-931b-3899d44eb398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a035fae256048f0bb5a5c2b547fc2af)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:58.259739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c6fce-b4a1-467f-931b-3899d44eb398 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:58.265858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 958/1919] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:58 2022] PUT /identity/v3/projects/191106c0549f4a43bee894f0adf646c5/users/6f71cc21e5e84302b7840bcd670e2a29/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:58.276638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f53d5-3d84-4794-9b57-763ea6f4987b admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:58.280378 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-ec8f53d5-3d84-4794-9b57-763ea6f4987b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:58.308966 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:58.317752 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f09c6fce-b4a1-467f-931b-3899d44eb398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a035fae256048f0bb5a5c2b547fc2af', 'request_id': 'req-f09c6fce-b4a1-467f-931b-3899d44eb398'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:58.324908 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f09c6fce-b4a1-467f-931b-3899d44eb398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a035fae256048f0bb5a5c2b547fc2af', 'request_id': 'req-f09c6fce-b4a1-467f-931b-3899d44eb398'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:58.334653 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f09c6fce-b4a1-467f-931b-3899d44eb398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a035fae256048f0bb5a5c2b547fc2af', 'request_id': 'req-f09c6fce-b4a1-467f-931b-3899d44eb398'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:58.347331 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f09c6fce-b4a1-467f-931b-3899d44eb398 admin admin] The token cache is being invalidate because project 4a035fae256048f0bb5a5c2b547fc2af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:04:58.347657 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f09c6fce-b4a1-467f-931b-3899d44eb398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:58.348377 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f09c6fce-b4a1-467f-931b-3899d44eb398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:58.353915 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 962/1920] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:04:58 2022] DELETE /identity/v3/projects/4a035fae256048f0bb5a5c2b547fc2af => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:58.353915 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e3156-cfe8-4d69-a84b-33440959e9a1 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:58.353915 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e3156-cfe8-4d69-a84b-33440959e9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:58.353915 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e3156-cfe8-4d69-a84b-33440959e9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:58.357577 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f53d5-3d84-4794-9b57-763ea6f4987b admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:58.380471 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-ad7e3156-cfe8-4d69-a84b-33440959e9a1 None None] MFA Rules not processed for user `6f71cc21e5e84302b7840bcd670e2a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:58.381908 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-ad7e3156-cfe8-4d69-a84b-33440959e9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:58.423592 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66800b2d-8a6e-4565-98e2-0495f71f6600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:58.424849 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66800b2d-8a6e-4565-98e2-0495f71f6600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:58.425258 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66800b2d-8a6e-4565-98e2-0495f71f6600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:58.425534 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66800b2d-8a6e-4565-98e2-0495f71f6600 admin admin] PATH_INFO: `/v3/projects/b9aab9215b3e4754b22425cdfbc3ba81` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:58.426884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66800b2d-8a6e-4565-98e2-0495f71f6600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9aab9215b3e4754b22425cdfbc3ba81)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:58.428924 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66800b2d-8a6e-4565-98e2-0495f71f6600 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:58.435795 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:58.462723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 963/1921] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:58.464485 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd09746-e466-436f-8105-a0ca847f8b16 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:58.464772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd09746-e466-436f-8105-a0ca847f8b16 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:58.465047 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd09746-e466-436f-8105-a0ca847f8b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:58.487326 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-66800b2d-8a6e-4565-98e2-0495f71f6600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9aab9215b3e4754b22425cdfbc3ba81', 'request_id': 'req-66800b2d-8a6e-4565-98e2-0495f71f6600'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:58.490578 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-bdd09746-e466-436f-8105-a0ca847f8b16 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:58.492156 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-bdd09746-e466-436f-8105-a0ca847f8b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:58.497277 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-66800b2d-8a6e-4565-98e2-0495f71f6600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9aab9215b3e4754b22425cdfbc3ba81', 'request_id': 'req-66800b2d-8a6e-4565-98e2-0495f71f6600'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:58.503761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-66800b2d-8a6e-4565-98e2-0495f71f6600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9aab9215b3e4754b22425cdfbc3ba81', 'request_id': 'req-66800b2d-8a6e-4565-98e2-0495f71f6600'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:58.516502 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-66800b2d-8a6e-4565-98e2-0495f71f6600 admin admin] The token cache is being invalidate because project b9aab9215b3e4754b22425cdfbc3ba81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:04:58.516837 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-66800b2d-8a6e-4565-98e2-0495f71f6600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:58.517488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-66800b2d-8a6e-4565-98e2-0495f71f6600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:58.519176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 959/1922] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:04:58 2022] DELETE /identity/v3/projects/b9aab9215b3e4754b22425cdfbc3ba81 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:58.523112 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66800b2d-8a6e-4565-98e2-0495f71f6600 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:58.524492 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-66800b2d-8a6e-4565-98e2-0495f71f6600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:58.557551 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 964/1923] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:58.558438 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd09746-e466-436f-8105-a0ca847f8b16 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:58.559943 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-bdd09746-e466-436f-8105-a0ca847f8b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:58.572845 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd09746-e466-436f-8105-a0ca847f8b16 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:58.577648 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510bd57-6a51-4ac5-9a1c-a3da0a023158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:58.578631 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510bd57-6a51-4ac5-9a1c-a3da0a023158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:58.579038 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510bd57-6a51-4ac5-9a1c-a3da0a023158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:58.579309 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510bd57-6a51-4ac5-9a1c-a3da0a023158 admin admin] PATH_INFO: `/v3/users/c4673ec8d890411684f5eda918bce367` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:58.580614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510bd57-6a51-4ac5-9a1c-a3da0a023158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4673ec8d890411684f5eda918bce367)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:58.582590 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510bd57-6a51-4ac5-9a1c-a3da0a023158 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:58.587384 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66800b2d-8a6e-4565-98e2-0495f71f6600 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:58.591233 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6349d-43aa-49f1-a25f-6ac7ee2c70ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:58.592096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6349d-43aa-49f1-a25f-6ac7ee2c70ed service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:58.592379 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6349d-43aa-49f1-a25f-6ac7ee2c70ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:58.592654 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6349d-43aa-49f1-a25f-6ac7ee2c70ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:58.594614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-6aa6349d-43aa-49f1-a25f-6ac7ee2c70ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:58.639253 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-6510bd57-6a51-4ac5-9a1c-a3da0a023158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4673ec8d890411684f5eda918bce367'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:58.643362 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:58.651298 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-6510bd57-6a51-4ac5-9a1c-a3da0a023158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4673ec8d890411684f5eda918bce367'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:58.652194 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-6510bd57-6a51-4ac5-9a1c-a3da0a023158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4673ec8d890411684f5eda918bce367'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:58.652898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-6510bd57-6a51-4ac5-9a1c-a3da0a023158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4673ec8d890411684f5eda918bce367'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:58.667501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-6510bd57-6a51-4ac5-9a1c-a3da0a023158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4673ec8d890411684f5eda918bce367'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:58.670419 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6349d-43aa-49f1-a25f-6ac7ee2c70ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:58.671773 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6349d-43aa-49f1-a25f-6ac7ee2c70ed service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:58.684698 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 960/1924] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:04:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:04:58.686439 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a724c-2e6b-4530-9089-e6bd9d3fff2e None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:58.686748 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a724c-2e6b-4530-9089-e6bd9d3fff2e None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:58.686995 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a724c-2e6b-4530-9089-e6bd9d3fff2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:58.688022 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 965/1925] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:04:58 2022] DELETE /identity/v3/users/c4673ec8d890411684f5eda918bce367 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:58.709464 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-145a724c-2e6b-4530-9089-e6bd9d3fff2e None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:58.711204 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-145a724c-2e6b-4530-9089-e6bd9d3fff2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:58.799350 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:58.840472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 961/1926] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:58.842347 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510bd57-6a51-4ac5-9a1c-a3da0a023158 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:58.859642 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510bd57-6a51-4ac5-9a1c-a3da0a023158 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:58.866349 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286ab4f-6198-40d3-a89b-a8fd72d492db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:58.867987 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286ab4f-6198-40d3-a89b-a8fd72d492db admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:58.868298 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286ab4f-6198-40d3-a89b-a8fd72d492db admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:58.868625 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286ab4f-6198-40d3-a89b-a8fd72d492db admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:58.870337 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286ab4f-6198-40d3-a89b-a8fd72d492db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:04:58.870563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286ab4f-6198-40d3-a89b-a8fd72d492db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:58.873244 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286ab4f-6198-40d3-a89b-a8fd72d492db admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:58.902700 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 966/1927] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 02:04:58.915117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a724c-2e6b-4530-9089-e6bd9d3fff2e None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:58.928706 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a724c-2e6b-4530-9089-e6bd9d3fff2e None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:58.938780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df796f4-b33c-4d77-add0-71c9049f03e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:58.939754 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df796f4-b33c-4d77-add0-71c9049f03e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:58.940143 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df796f4-b33c-4d77-add0-71c9049f03e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:58.940534 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df796f4-b33c-4d77-add0-71c9049f03e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:58.942132 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df796f4-b33c-4d77-add0-71c9049f03e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:58.945040 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df796f4-b33c-4d77-add0-71c9049f03e5 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:58.985712 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 962/1928] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:58 2022] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:58.990870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286ab4f-6198-40d3-a89b-a8fd72d492db admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:59.012840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286ab4f-6198-40d3-a89b-a8fd72d492db admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:59.132143 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c833e-7fe0-4bf6-b9f0-f7c089dfcc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:59.133472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c833e-7fe0-4bf6-b9f0-f7c089dfcc65 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:59.133472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c833e-7fe0-4bf6-b9f0-f7c089dfcc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:59.133650 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c833e-7fe0-4bf6-b9f0-f7c089dfcc65 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:59.134262 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c833e-7fe0-4bf6-b9f0-f7c089dfcc65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:59.141937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c833e-7fe0-4bf6-b9f0-f7c089dfcc65 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:59.195835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 967/1929] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:58 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:59.202128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df796f4-b33c-4d77-add0-71c9049f03e5 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:59.219799 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df796f4-b33c-4d77-add0-71c9049f03e5 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:59.233863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b938e5-9d9a-4385-87ab-bd1dd2da6f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:59.240162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b938e5-9d9a-4385-87ab-bd1dd2da6f02 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:59.240529 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b938e5-9d9a-4385-87ab-bd1dd2da6f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:59.241187 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b938e5-9d9a-4385-87ab-bd1dd2da6f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:59.241603 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b938e5-9d9a-4385-87ab-bd1dd2da6f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:59.243521 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b938e5-9d9a-4385-87ab-bd1dd2da6f02 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:59.297315 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 963/1930] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:59.299033 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c833e-7fe0-4bf6-b9f0-f7c089dfcc65 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:59.317730 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b938e5-9d9a-4385-87ab-bd1dd2da6f02 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:59.320418 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c833e-7fe0-4bf6-b9f0-f7c089dfcc65 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:59.320800 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-73b938e5-9d9a-4385-87ab-bd1dd2da6f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:59.337131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9dd0a-6e7d-4549-95b3-6b90a7ad341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:59.338060 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9dd0a-6e7d-4549-95b3-6b90a7ad341a admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:59.338344 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9dd0a-6e7d-4549-95b3-6b90a7ad341a admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:59.338621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9dd0a-6e7d-4549-95b3-6b90a7ad341a admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:59.339363 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9dd0a-6e7d-4549-95b3-6b90a7ad341a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:59.341390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9dd0a-6e7d-4549-95b3-6b90a7ad341a admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:59.346597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b938e5-9d9a-4385-87ab-bd1dd2da6f02 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:59.359816 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371c589-0958-4cba-8be5-de70441c9a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:59.360355 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 968/1931] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:04:59.364474 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9dd0a-6e7d-4549-95b3-6b90a7ad341a admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:59.365484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371c589-0958-4cba-8be5-de70441c9a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:59.365794 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371c589-0958-4cba-8be5-de70441c9a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:59.366129 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371c589-0958-4cba-8be5-de70441c9a08 admin admin] PATH_INFO: `/v3/projects/1a6c68a0faa84e829a3a640dda8d381f` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:59.367721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371c589-0958-4cba-8be5-de70441c9a08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a6c68a0faa84e829a3a640dda8d381f)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:59.370940 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371c589-0958-4cba-8be5-de70441c9a08 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:59.402210 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9dd0a-6e7d-4549-95b3-6b90a7ad341a admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:59.414118 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521573ee-6421-42e3-a494-a3e7a3cd02a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:59.415380 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521573ee-6421-42e3-a494-a3e7a3cd02a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:59.415715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521573ee-6421-42e3-a494-a3e7a3cd02a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:59.415995 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521573ee-6421-42e3-a494-a3e7a3cd02a7 admin admin] PATH_INFO: `/v3/projects/45cd69fadbf74892899b54c56c9bb113/users/879c5269fd364e75bc8246de341af282/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:59.434639 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521573ee-6421-42e3-a494-a3e7a3cd02a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45cd69fadbf74892899b54c56c9bb113, user_id=879c5269fd364e75bc8246de341af282, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:59.439508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521573ee-6421-42e3-a494-a3e7a3cd02a7 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:59.475452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 969/1932] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:59 2022] PUT /identity/v3/projects/45cd69fadbf74892899b54c56c9bb113/users/879c5269fd364e75bc8246de341af282/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:04:59.481279 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-f371c589-0958-4cba-8be5-de70441c9a08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a6c68a0faa84e829a3a640dda8d381f', 'request_id': 'req-f371c589-0958-4cba-8be5-de70441c9a08'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:59.486749 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caca1d7-be3e-4b5a-9096-d43c6cce5bc3 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:59.487131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caca1d7-be3e-4b5a-9096-d43c6cce5bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:59.487530 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caca1d7-be3e-4b5a-9096-d43c6cce5bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:59.495478 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-f371c589-0958-4cba-8be5-de70441c9a08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a6c68a0faa84e829a3a640dda8d381f', 'request_id': 'req-f371c589-0958-4cba-8be5-de70441c9a08'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:59.519919 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-f371c589-0958-4cba-8be5-de70441c9a08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a6c68a0faa84e829a3a640dda8d381f', 'request_id': 'req-f371c589-0958-4cba-8be5-de70441c9a08'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:59.528304 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-5caca1d7-be3e-4b5a-9096-d43c6cce5bc3 None None] MFA Rules not processed for user `879c5269fd364e75bc8246de341af282`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:59.529750 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5caca1d7-be3e-4b5a-9096-d43c6cce5bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:59.532619 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-f371c589-0958-4cba-8be5-de70441c9a08 admin admin] The token cache is being invalidate because project 1a6c68a0faa84e829a3a640dda8d381f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:04:59.532907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-f371c589-0958-4cba-8be5-de70441c9a08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:59.533560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-f371c589-0958-4cba-8be5-de70441c9a08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:04:59.535874 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 964/1933] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:04:59 2022] DELETE /identity/v3/projects/1a6c68a0faa84e829a3a640dda8d381f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:04:59.540745 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d91848-791c-4cd4-9780-6021d5f660b4 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:59.541078 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d91848-791c-4cd4-9780-6021d5f660b4 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:59.541358 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d91848-791c-4cd4-9780-6021d5f660b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:59.560173 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-54d91848-791c-4cd4-9780-6021d5f660b4 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:59.561408 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-54d91848-791c-4cd4-9780-6021d5f660b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:59.601283 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:59.611677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 970/1934] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:04:59.613238 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caca1d7-be3e-4b5a-9096-d43c6cce5bc3 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:59.615853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5caca1d7-be3e-4b5a-9096-d43c6cce5bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:59.637162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 965/1935] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:04:59.645186 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e850c74-275b-4d3c-bd15-71c6503416c4 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:59.645567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e850c74-275b-4d3c-bd15-71c6503416c4 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:59.646631 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e850c74-275b-4d3c-bd15-71c6503416c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:59.669962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-7e850c74-275b-4d3c-bd15-71c6503416c4 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:04:59.671091 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-7e850c74-275b-4d3c-bd15-71c6503416c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:04:59.682996 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 966/1936] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:04:59.684054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e850c74-275b-4d3c-bd15-71c6503416c4 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:59.694540 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e850c74-275b-4d3c-bd15-71c6503416c4 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:59.698666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caca1d7-be3e-4b5a-9096-d43c6cce5bc3 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:59.699789 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c5ab7-8477-43e9-b399-1582183b52b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:59.700485 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c5ab7-8477-43e9-b399-1582183b52b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:59.700766 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c5ab7-8477-43e9-b399-1582183b52b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:59.701176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c5ab7-8477-43e9-b399-1582183b52b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:59.701885 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c5ab7-8477-43e9-b399-1582183b52b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:04:59.702197 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c5ab7-8477-43e9-b399-1582183b52b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:59.703897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c5ab7-8477-43e9-b399-1582183b52b8 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:59.706145 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed70b21-cc77-4982-8ecd-980ea43bb8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:59.706865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed70b21-cc77-4982-8ecd-980ea43bb8cf admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:59.707181 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed70b21-cc77-4982-8ecd-980ea43bb8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:59.707511 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed70b21-cc77-4982-8ecd-980ea43bb8cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:59.709425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed70b21-cc77-4982-8ecd-980ea43bb8cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:59.711917 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed70b21-cc77-4982-8ecd-980ea43bb8cf admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:59.736355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 967/1937] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 02:04:59.737916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c5ab7-8477-43e9-b399-1582183b52b8 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:59.748505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 971/1938] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:59 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:59.750463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c5ab7-8477-43e9-b399-1582183b52b8 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:59.752518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed70b21-cc77-4982-8ecd-980ea43bb8cf admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:59.776093 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:04:59.830275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176071a0-c3db-47a1-8306-b4326a2b7a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:59.830963 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176071a0-c3db-47a1-8306-b4326a2b7a96 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:59.831243 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176071a0-c3db-47a1-8306-b4326a2b7a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:59.831560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176071a0-c3db-47a1-8306-b4326a2b7a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:59.832428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176071a0-c3db-47a1-8306-b4326a2b7a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:59.835351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176071a0-c3db-47a1-8306-b4326a2b7a96 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:59.836954 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed70b21-cc77-4982-8ecd-980ea43bb8cf admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:59.841451 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c464db-fa2b-441e-a311-3cea99a230f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:59.842154 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c464db-fa2b-441e-a311-3cea99a230f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:59.842435 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c464db-fa2b-441e-a311-3cea99a230f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:59.842737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c464db-fa2b-441e-a311-3cea99a230f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:59.843603 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c464db-fa2b-441e-a311-3cea99a230f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:59.846725 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c464db-fa2b-441e-a311-3cea99a230f3 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:59.865145 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 968/1939] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:04:59 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:59.869168 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176071a0-c3db-47a1-8306-b4326a2b7a96 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:59.874427 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 972/1940] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:59 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:59.875405 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c464db-fa2b-441e-a311-3cea99a230f3 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:59.885397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c464db-fa2b-441e-a311-3cea99a230f3 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:59.950584 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176071a0-c3db-47a1-8306-b4326a2b7a96 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:04:59.957202 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbdf64-e443-44d9-a6ae-0841c68e4565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:59.957957 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbdf64-e443-44d9-a6ae-0841c68e4565 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:59.958244 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbdf64-e443-44d9-a6ae-0841c68e4565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:59.958738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbdf64-e443-44d9-a6ae-0841c68e4565 admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:59.959348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbdf64-e443-44d9-a6ae-0841c68e4565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:59.961392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbdf64-e443-44d9-a6ae-0841c68e4565 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:59.962658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69151e81-ff02-4e33-af96-4bfb6da413a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:04:59.963749 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69151e81-ff02-4e33-af96-4bfb6da413a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:04:59.964401 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69151e81-ff02-4e33-af96-4bfb6da413a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:04:59.964862 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69151e81-ff02-4e33-af96-4bfb6da413a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:04:59.965860 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69151e81-ff02-4e33-af96-4bfb6da413a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:04:59.968067 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69151e81-ff02-4e33-af96-4bfb6da413a5 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:04:59.980781 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 973/1941] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:04:59.985541 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69151e81-ff02-4e33-af96-4bfb6da413a5 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:59.992225 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 969/1942] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:04:59 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:04:59.993174 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbdf64-e443-44d9-a6ae-0841c68e4565 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:04:59.999011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69151e81-ff02-4e33-af96-4bfb6da413a5 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:00.004682 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea705968-b8a0-412b-88cb-632fc1b40238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:00.005213 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea705968-b8a0-412b-88cb-632fc1b40238 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:00.005681 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea705968-b8a0-412b-88cb-632fc1b40238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:00.005962 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea705968-b8a0-412b-88cb-632fc1b40238 admin admin] PATH_INFO: `/v3/projects/8fd1dfbd70134a969fc20fa9920c3397/users/a5072737b0bf46a995deec95a49bea51/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:00.006497 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbdf64-e443-44d9-a6ae-0841c68e4565 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:00.010814 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:00.013385 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98377cb-14f8-4414-a8d9-61812f3049a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:00.014105 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98377cb-14f8-4414-a8d9-61812f3049a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:00.014363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98377cb-14f8-4414-a8d9-61812f3049a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:00.014635 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98377cb-14f8-4414-a8d9-61812f3049a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:00.015436 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98377cb-14f8-4414-a8d9-61812f3049a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:00.017319 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98377cb-14f8-4414-a8d9-61812f3049a2 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:00.024693 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea705968-b8a0-412b-88cb-632fc1b40238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd1dfbd70134a969fc20fa9920c3397, user_id=a5072737b0bf46a995deec95a49bea51, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:00.027663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea705968-b8a0-412b-88cb-632fc1b40238 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:00.029502 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 970/1943] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:00.033170 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98377cb-14f8-4414-a8d9-61812f3049a2 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:00.045238 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98377cb-14f8-4414-a8d9-61812f3049a2 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:00.047295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 974/1944] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:04:59 2022] PUT /identity/v3/projects/8fd1dfbd70134a969fc20fa9920c3397/users/a5072737b0bf46a995deec95a49bea51/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:00.051257 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea705968-b8a0-412b-88cb-632fc1b40238 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:00.115283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1195019-4e85-48a0-a2c3-09e7e94e50c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:00.116151 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1195019-4e85-48a0-a2c3-09e7e94e50c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:00.116380 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1195019-4e85-48a0-a2c3-09e7e94e50c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:00.116659 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1195019-4e85-48a0-a2c3-09e7e94e50c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:00.117418 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1195019-4e85-48a0-a2c3-09e7e94e50c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:00.119166 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1195019-4e85-48a0-a2c3-09e7e94e50c4 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:00.130258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea705968-b8a0-412b-88cb-632fc1b40238 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:00.131267 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 971/1945] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:00.134740 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1195019-4e85-48a0-a2c3-09e7e94e50c4 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:00.138235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae7c7a-d269-4263-817d-827cad14e3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:00.138989 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae7c7a-d269-4263-817d-827cad14e3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:00.139348 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae7c7a-d269-4263-817d-827cad14e3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:00.141546 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae7c7a-d269-4263-817d-827cad14e3b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:00.142279 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae7c7a-d269-4263-817d-827cad14e3b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:00.144011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae7c7a-d269-4263-817d-827cad14e3b4 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:00.148091 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1195019-4e85-48a0-a2c3-09e7e94e50c4 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:00.154505 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9daa1-b264-474b-9f0a-ff46cb270a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:00.155710 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9daa1-b264-474b-9f0a-ff46cb270a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:00.155870 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9daa1-b264-474b-9f0a-ff46cb270a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:00.156208 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9daa1-b264-474b-9f0a-ff46cb270a2b admin admin] PATH_INFO: `/v3/projects/6b8d98197a444e53a502777c8169fd09/users/98b4d405afeb4d559245f511fb4a9b01/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:00.160012 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 975/1946] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:00.160779 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae7c7a-d269-4263-817d-827cad14e3b4 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:00.173134 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae7c7a-d269-4263-817d-827cad14e3b4 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:00.173595 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9daa1-b264-474b-9f0a-ff46cb270a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8d98197a444e53a502777c8169fd09, user_id=98b4d405afeb4d559245f511fb4a9b01, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:00.176675 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9daa1-b264-474b-9f0a-ff46cb270a2b admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:00.179402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1270804-d40c-4657-9595-65af5bf16fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:00.179990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:00.180859 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1270804-d40c-4657-9595-65af5bf16fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:00.181141 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1270804-d40c-4657-9595-65af5bf16fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:00.181456 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1270804-d40c-4657-9595-65af5bf16fd8 admin admin] PATH_INFO: `/v3/projects/8fd1dfbd70134a969fc20fa9920c3397/users/a5072737b0bf46a995deec95a49bea51/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:00.183702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1270804-d40c-4657-9595-65af5bf16fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd1dfbd70134a969fc20fa9920c3397, user_id=a5072737b0bf46a995deec95a49bea51, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:00.186696 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1270804-d40c-4657-9595-65af5bf16fd8 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:00.192833 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 972/1947] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:00 2022] PUT /identity/v3/projects/6b8d98197a444e53a502777c8169fd09/users/98b4d405afeb4d559245f511fb4a9b01/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:05:00.198455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 976/1948] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:00 2022] PUT /identity/v3/projects/8fd1dfbd70134a969fc20fa9920c3397/users/a5072737b0bf46a995deec95a49bea51/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:00.204436 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b695d71-1ada-44eb-8903-8f20379a9479 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:00.205002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b695d71-1ada-44eb-8903-8f20379a9479 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:00.205002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b695d71-1ada-44eb-8903-8f20379a9479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:00.211958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba856d-8881-4c7e-b56e-ca6ee15d0c17 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:00.212248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba856d-8881-4c7e-b56e-ca6ee15d0c17 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:00.212860 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba856d-8881-4c7e-b56e-ca6ee15d0c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:00.239358 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-9b695d71-1ada-44eb-8903-8f20379a9479 None None] MFA Rules not processed for user `98b4d405afeb4d559245f511fb4a9b01`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:00.240819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-9b695d71-1ada-44eb-8903-8f20379a9479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:00.243373 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-bdba856d-8881-4c7e-b56e-ca6ee15d0c17 None None] MFA Rules not processed for user `a5072737b0bf46a995deec95a49bea51`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:00.244630 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-bdba856d-8881-4c7e-b56e-ca6ee15d0c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:00.356070 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 977/1949] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:05:00.366766 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba856d-8881-4c7e-b56e-ca6ee15d0c17 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:00.368930 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-bdba856d-8881-4c7e-b56e-ca6ee15d0c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:00.394027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 973/1950] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:00.395002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b695d71-1ada-44eb-8903-8f20379a9479 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:00.458406 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba856d-8881-4c7e-b56e-ca6ee15d0c17 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:00.469694 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba9f1a-788c-4e97-9635-e67057037fcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:00.470376 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba9f1a-788c-4e97-9635-e67057037fcf service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:00.470651 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba9f1a-788c-4e97-9635-e67057037fcf service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:00.470982 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba9f1a-788c-4e97-9635-e67057037fcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:00.487114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:00.493285 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba9f1a-788c-4e97-9635-e67057037fcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:00.494592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba9f1a-788c-4e97-9635-e67057037fcf service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:00.510796 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b695d71-1ada-44eb-8903-8f20379a9479 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:00.518416 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 978/1951] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:05:00.520120 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff094f-c5ab-4f83-8c2d-3640891dea8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:00.521225 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff094f-c5ab-4f83-8c2d-3640891dea8f admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:00.521729 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff094f-c5ab-4f83-8c2d-3640891dea8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:00.522414 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff094f-c5ab-4f83-8c2d-3640891dea8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:00.523229 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff094f-c5ab-4f83-8c2d-3640891dea8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:00.525804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff094f-c5ab-4f83-8c2d-3640891dea8f admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:00.571926 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 974/1952] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:00 2022] POST /identity/v3/projects => generated 381 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:05:00.575906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba9f1a-788c-4e97-9635-e67057037fcf service cinder] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:00.591926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba9f1a-788c-4e97-9635-e67057037fcf service cinder] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:00.721708 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f53cc6-c677-4b59-8895-f2e92008cb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:00.722555 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f53cc6-c677-4b59-8895-f2e92008cb8a admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:00.722719 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f53cc6-c677-4b59-8895-f2e92008cb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:00.723178 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f53cc6-c677-4b59-8895-f2e92008cb8a admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:00.723957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f53cc6-c677-4b59-8895-f2e92008cb8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:00.726324 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f53cc6-c677-4b59-8895-f2e92008cb8a admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:00.750626 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff094f-c5ab-4f83-8c2d-3640891dea8f admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:00.754180 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-7eff094f-c5ab-4f83-8c2d-3640891dea8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:00.776956 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 979/1953] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:00 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:00.781417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f53cc6-c677-4b59-8895-f2e92008cb8a admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:00.796832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f53cc6-c677-4b59-8895-f2e92008cb8a admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:00.804544 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2a1f3-7143-4def-9c53-7921ae66de3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:00.805366 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2a1f3-7143-4def-9c53-7921ae66de3e admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:00.805700 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2a1f3-7143-4def-9c53-7921ae66de3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:00.806074 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2a1f3-7143-4def-9c53-7921ae66de3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:00.806908 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2a1f3-7143-4def-9c53-7921ae66de3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:00.809326 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2a1f3-7143-4def-9c53-7921ae66de3e admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:00.821948 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 980/1954] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:05:00.826225 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2a1f3-7143-4def-9c53-7921ae66de3e admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:00.838383 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2a1f3-7143-4def-9c53-7921ae66de3e admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:00.844240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b4fac-fb4c-4b31-8866-15ab2b0afcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:00.845570 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b4fac-fb4c-4b31-8866-15ab2b0afcb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:00.846055 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b4fac-fb4c-4b31-8866-15ab2b0afcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:00.846344 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b4fac-fb4c-4b31-8866-15ab2b0afcb2 admin admin] PATH_INFO: `/v3/projects/169a0e1ade7148d0991f7b38220191ac/users/7b0132242fb04192ade80c2f882fb192/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:00.862249 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff094f-c5ab-4f83-8c2d-3640891dea8f admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:00.869428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff42b89-9573-4a5d-88af-3367b392fb15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:00.870364 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff42b89-9573-4a5d-88af-3367b392fb15 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:00.870979 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff42b89-9573-4a5d-88af-3367b392fb15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:00.871532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff42b89-9573-4a5d-88af-3367b392fb15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:00.884299 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b4fac-fb4c-4b31-8866-15ab2b0afcb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=169a0e1ade7148d0991f7b38220191ac, user_id=7b0132242fb04192ade80c2f882fb192, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:00.888834 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b4fac-fb4c-4b31-8866-15ab2b0afcb2 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:00.924770 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 981/1955] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:00 2022] PUT /identity/v3/projects/169a0e1ade7148d0991f7b38220191ac/users/7b0132242fb04192ade80c2f882fb192/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:05:00.932510 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b4fac-fb4c-4b31-8866-15ab2b0afcb2 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:00.945635 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:00.984669 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff42b89-9573-4a5d-88af-3367b392fb15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:00.986313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff42b89-9573-4a5d-88af-3367b392fb15 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:00.997119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 975/1956] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:05:01.016190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b4fac-fb4c-4b31-8866-15ab2b0afcb2 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:01.024523 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebe289-a583-42d5-8acc-17f8ecb2dfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:01.025720 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebe289-a583-42d5-8acc-17f8ecb2dfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:01.026025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebe289-a583-42d5-8acc-17f8ecb2dfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:01.026370 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebe289-a583-42d5-8acc-17f8ecb2dfc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:01.027235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebe289-a583-42d5-8acc-17f8ecb2dfc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:01.028988 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebe289-a583-42d5-8acc-17f8ecb2dfc6 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:01.044146 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 982/1957] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:01.045157 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff42b89-9573-4a5d-88af-3367b392fb15 service cinder] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:01.058073 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff42b89-9573-4a5d-88af-3367b392fb15 service cinder] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:01.063319 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d897c-e556-4b74-989c-94e004b674a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:01.064352 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d897c-e556-4b74-989c-94e004b674a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:01.064760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d897c-e556-4b74-989c-94e004b674a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:01.065167 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d897c-e556-4b74-989c-94e004b674a5 admin admin] PATH_INFO: `/v3/projects/169a0e1ade7148d0991f7b38220191ac/users/7b0132242fb04192ade80c2f882fb192/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:01.067479 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d897c-e556-4b74-989c-94e004b674a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=169a0e1ade7148d0991f7b38220191ac, user_id=7b0132242fb04192ade80c2f882fb192, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:01.070652 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d897c-e556-4b74-989c-94e004b674a5 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:01.082799 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 976/1958] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:01 2022] PUT /identity/v3/projects/169a0e1ade7148d0991f7b38220191ac/users/7b0132242fb04192ade80c2f882fb192/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:01.093353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c734224-209e-4803-813d-49a943a6ae2e None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:01.093618 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c734224-209e-4803-813d-49a943a6ae2e None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:01.093939 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c734224-209e-4803-813d-49a943a6ae2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:01.134122 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-3c734224-209e-4803-813d-49a943a6ae2e None None] MFA Rules not processed for user `7b0132242fb04192ade80c2f882fb192`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:01.136005 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-3c734224-209e-4803-813d-49a943a6ae2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:01.178593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:01.221316 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 983/1959] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:01.233173 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d897c-e556-4b74-989c-94e004b674a5 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:01.290655 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d897c-e556-4b74-989c-94e004b674a5 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:01.294445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e11abd-2a99-4c26-bd77-2b9224d25ba6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:01.295009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e11abd-2a99-4c26-bd77-2b9224d25ba6 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:01.295293 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e11abd-2a99-4c26-bd77-2b9224d25ba6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:01.295604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e11abd-2a99-4c26-bd77-2b9224d25ba6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:01.306480 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e11abd-2a99-4c26-bd77-2b9224d25ba6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:01.308063 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e11abd-2a99-4c26-bd77-2b9224d25ba6 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:01.318577 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 977/1960] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:01.393034 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c734224-209e-4803-813d-49a943a6ae2e None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:01.403697 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c734224-209e-4803-813d-49a943a6ae2e None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:01.408020 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8add4-2b6f-4897-b01d-fd1d687babae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:01.408700 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8add4-2b6f-4897-b01d-fd1d687babae service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:01.408980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8add4-2b6f-4897-b01d-fd1d687babae service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:01.409248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8add4-2b6f-4897-b01d-fd1d687babae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:01.472943 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8add4-2b6f-4897-b01d-fd1d687babae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:01.475431 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8add4-2b6f-4897-b01d-fd1d687babae service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:01.485274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 984/1961] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:01.763186 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e11abd-2a99-4c26-bd77-2b9224d25ba6 service cinder] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:01.863146 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e11abd-2a99-4c26-bd77-2b9224d25ba6 service cinder] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:01.870971 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e7c86-c78e-4f3b-976d-ef089deeade4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:01.872842 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e7c86-c78e-4f3b-976d-ef089deeade4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:01.873340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e7c86-c78e-4f3b-976d-ef089deeade4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:01.873623 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e7c86-c78e-4f3b-976d-ef089deeade4 admin admin] PATH_INFO: `/v3/users/98b4d405afeb4d559245f511fb4a9b01` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:01.875729 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e7c86-c78e-4f3b-976d-ef089deeade4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98b4d405afeb4d559245f511fb4a9b01)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:01.877942 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e7c86-c78e-4f3b-976d-ef089deeade4 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:01.953799 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-ea4e7c86-c78e-4f3b-976d-ef089deeade4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98b4d405afeb4d559245f511fb4a9b01'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:01.961254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:01.967719 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-ea4e7c86-c78e-4f3b-976d-ef089deeade4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98b4d405afeb4d559245f511fb4a9b01'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:01.976162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-ea4e7c86-c78e-4f3b-976d-ef089deeade4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98b4d405afeb4d559245f511fb4a9b01'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:01.976935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-ea4e7c86-c78e-4f3b-976d-ef089deeade4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98b4d405afeb4d559245f511fb4a9b01'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:01.986286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-ea4e7c86-c78e-4f3b-976d-ef089deeade4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98b4d405afeb4d559245f511fb4a9b01'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:01.992680 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 978/1962] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:01 2022] DELETE /identity/v3/users/98b4d405afeb4d559245f511fb4a9b01 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:05:01.997359 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995ffda-c4b4-4fd5-8ec5-7de5ea4b76c4 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:01.997652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995ffda-c4b4-4fd5-8ec5-7de5ea4b76c4 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:01.997982 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995ffda-c4b4-4fd5-8ec5-7de5ea4b76c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:02.015938 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-a995ffda-c4b4-4fd5-8ec5-7de5ea4b76c4 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:02.017147 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-a995ffda-c4b4-4fd5-8ec5-7de5ea4b76c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:02.084651 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 985/1963] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:02.094294 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e7c86-c78e-4f3b-976d-ef089deeade4 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:02.095852 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-ea4e7c86-c78e-4f3b-976d-ef089deeade4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:02.163702 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e7c86-c78e-4f3b-976d-ef089deeade4 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:02.169168 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b161453-a590-4c9c-aee1-3f492f2faee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:02.169709 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b161453-a590-4c9c-aee1-3f492f2faee4 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:02.169845 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b161453-a590-4c9c-aee1-3f492f2faee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:02.170023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b161453-a590-4c9c-aee1-3f492f2faee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:02.181153 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b161453-a590-4c9c-aee1-3f492f2faee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:02.184505 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b161453-a590-4c9c-aee1-3f492f2faee4 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:02.196064 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 979/1964] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:02.221466 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995ffda-c4b4-4fd5-8ec5-7de5ea4b76c4 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:02.223008 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-a995ffda-c4b4-4fd5-8ec5-7de5ea4b76c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:02.244815 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995ffda-c4b4-4fd5-8ec5-7de5ea4b76c4 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:02.250606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ad9e4-4313-4175-8242-7d46ac5c5da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:02.251666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ad9e4-4313-4175-8242-7d46ac5c5da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:02.251934 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ad9e4-4313-4175-8242-7d46ac5c5da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:02.252213 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ad9e4-4313-4175-8242-7d46ac5c5da8 admin admin] PATH_INFO: `/v3/users/b273b0ca7ce04710b0395390b36a0ba6` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:02.253485 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ad9e4-4313-4175-8242-7d46ac5c5da8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b273b0ca7ce04710b0395390b36a0ba6)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:02.276459 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ad9e4-4313-4175-8242-7d46ac5c5da8 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:02.366310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-0e5ad9e4-4313-4175-8242-7d46ac5c5da8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b273b0ca7ce04710b0395390b36a0ba6'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:02.377662 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-0e5ad9e4-4313-4175-8242-7d46ac5c5da8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b273b0ca7ce04710b0395390b36a0ba6'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:02.379978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-0e5ad9e4-4313-4175-8242-7d46ac5c5da8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b273b0ca7ce04710b0395390b36a0ba6'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:02.381057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-0e5ad9e4-4313-4175-8242-7d46ac5c5da8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b273b0ca7ce04710b0395390b36a0ba6'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:02.392441 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:02.403198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-0e5ad9e4-4313-4175-8242-7d46ac5c5da8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b273b0ca7ce04710b0395390b36a0ba6'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:02.430958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 986/1965] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:02 2022] DELETE /identity/v3/users/b273b0ca7ce04710b0395390b36a0ba6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:02.435992 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790a49d-57c4-494a-b979-55209e7f183f None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:02.436551 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790a49d-57c4-494a-b979-55209e7f183f None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:02.436652 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790a49d-57c4-494a-b979-55209e7f183f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:02.459399 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-3790a49d-57c4-494a-b979-55209e7f183f None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:02.460807 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-3790a49d-57c4-494a-b979-55209e7f183f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:02.536529 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 980/1966] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:02.547217 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ad9e4-4313-4175-8242-7d46ac5c5da8 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:02.549428 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-0e5ad9e4-4313-4175-8242-7d46ac5c5da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:02.607478 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790a49d-57c4-494a-b979-55209e7f183f None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:02.608989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-3790a49d-57c4-494a-b979-55209e7f183f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:02.628609 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790a49d-57c4-494a-b979-55209e7f183f None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:02.650089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ad9e4-4313-4175-8242-7d46ac5c5da8 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:02.662642 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2e455-7157-4db6-9d2e-85ae88c7f621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:02.663513 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2e455-7157-4db6-9d2e-85ae88c7f621 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:02.663672 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2e455-7157-4db6-9d2e-85ae88c7f621 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:02.664004 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2e455-7157-4db6-9d2e-85ae88c7f621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:02.667016 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47e9f0-f774-4f8a-9806-d43e94a11487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:02.667969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47e9f0-f774-4f8a-9806-d43e94a11487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:02.668248 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47e9f0-f774-4f8a-9806-d43e94a11487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:02.668522 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47e9f0-f774-4f8a-9806-d43e94a11487 admin admin] PATH_INFO: `/v3/projects/6b8d98197a444e53a502777c8169fd09` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:02.672462 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47e9f0-f774-4f8a-9806-d43e94a11487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b8d98197a444e53a502777c8169fd09)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:02.675130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47e9f0-f774-4f8a-9806-d43e94a11487 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:02.689751 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2e455-7157-4db6-9d2e-85ae88c7f621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:02.692964 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2e455-7157-4db6-9d2e-85ae88c7f621 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:02.706660 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 987/1967] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:02.752233 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-9f47e9f0-f774-4f8a-9806-d43e94a11487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b8d98197a444e53a502777c8169fd09', 'request_id': 'req-9f47e9f0-f774-4f8a-9806-d43e94a11487'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:02.765137 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-9f47e9f0-f774-4f8a-9806-d43e94a11487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b8d98197a444e53a502777c8169fd09', 'request_id': 'req-9f47e9f0-f774-4f8a-9806-d43e94a11487'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:02.772365 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-9f47e9f0-f774-4f8a-9806-d43e94a11487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b8d98197a444e53a502777c8169fd09', 'request_id': 'req-9f47e9f0-f774-4f8a-9806-d43e94a11487'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:02.782079 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:02.786536 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-9f47e9f0-f774-4f8a-9806-d43e94a11487 admin admin] The token cache is being invalidate because project 6b8d98197a444e53a502777c8169fd09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:02.787241 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-9f47e9f0-f774-4f8a-9806-d43e94a11487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:02.788375 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-9f47e9f0-f774-4f8a-9806-d43e94a11487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:02.790462 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 981/1968] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:02 2022] DELETE /identity/v3/projects/6b8d98197a444e53a502777c8169fd09 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:02.794893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2e455-7157-4db6-9d2e-85ae88c7f621 service neutron] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:02.806015 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2e455-7157-4db6-9d2e-85ae88c7f621 service neutron] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:02.867646 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc57ee-0da7-424b-ae6b-3c171dee33a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:02.868563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc57ee-0da7-424b-ae6b-3c171dee33a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:02.868879 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc57ee-0da7-424b-ae6b-3c171dee33a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:02.869166 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc57ee-0da7-424b-ae6b-3c171dee33a7 admin admin] PATH_INFO: `/v3/users/7b0132242fb04192ade80c2f882fb192` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:02.870512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc57ee-0da7-424b-ae6b-3c171dee33a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b0132242fb04192ade80c2f882fb192)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:02.872724 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc57ee-0da7-424b-ae6b-3c171dee33a7 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:02.964860 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-11bc57ee-0da7-424b-ae6b-3c171dee33a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b0132242fb04192ade80c2f882fb192'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:02.974559 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-11bc57ee-0da7-424b-ae6b-3c171dee33a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b0132242fb04192ade80c2f882fb192'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:02.975554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-11bc57ee-0da7-424b-ae6b-3c171dee33a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b0132242fb04192ade80c2f882fb192'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:02.977197 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-11bc57ee-0da7-424b-ae6b-3c171dee33a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b0132242fb04192ade80c2f882fb192'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:02.993969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-11bc57ee-0da7-424b-ae6b-3c171dee33a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b0132242fb04192ade80c2f882fb192'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:03.013234 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 988/1969] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:02 2022] DELETE /identity/v3/users/7b0132242fb04192ade80c2f882fb192 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:05:03.293534 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47e9f0-f774-4f8a-9806-d43e94a11487 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:03.295097 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-9f47e9f0-f774-4f8a-9806-d43e94a11487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:03.309073 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47e9f0-f774-4f8a-9806-d43e94a11487 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:03.375226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e166df-f9f0-4ff0-b69f-19b4e6379586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:03.376205 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e166df-f9f0-4ff0-b69f-19b4e6379586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:03.376510 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e166df-f9f0-4ff0-b69f-19b4e6379586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:03.376768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e166df-f9f0-4ff0-b69f-19b4e6379586 admin admin] PATH_INFO: `/v3/projects/edbcd471337e48de9505d80df5dcc3d5` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:03.378213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e166df-f9f0-4ff0-b69f-19b4e6379586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edbcd471337e48de9505d80df5dcc3d5)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:03.380342 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e166df-f9f0-4ff0-b69f-19b4e6379586 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:03.399650 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc57ee-0da7-424b-ae6b-3c171dee33a7 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:03.401423 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-11bc57ee-0da7-424b-ae6b-3c171dee33a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:03.416671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:03.423115 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc57ee-0da7-424b-ae6b-3c171dee33a7 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:03.431373 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcafe6-b802-4761-a386-35f6c0c50fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:03.432712 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcafe6-b802-4761-a386-35f6c0c50fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:03.432985 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcafe6-b802-4761-a386-35f6c0c50fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:03.433276 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcafe6-b802-4761-a386-35f6c0c50fe5 admin admin] PATH_INFO: `/v3/projects/169a0e1ade7148d0991f7b38220191ac` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:03.434872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcafe6-b802-4761-a386-35f6c0c50fe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=169a0e1ade7148d0991f7b38220191ac)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:03.437490 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcafe6-b802-4761-a386-35f6c0c50fe5 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:03.441385 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-73e166df-f9f0-4ff0-b69f-19b4e6379586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edbcd471337e48de9505d80df5dcc3d5', 'request_id': 'req-73e166df-f9f0-4ff0-b69f-19b4e6379586'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:03.450684 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-73e166df-f9f0-4ff0-b69f-19b4e6379586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edbcd471337e48de9505d80df5dcc3d5', 'request_id': 'req-73e166df-f9f0-4ff0-b69f-19b4e6379586'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:03.457343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-73e166df-f9f0-4ff0-b69f-19b4e6379586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edbcd471337e48de9505d80df5dcc3d5', 'request_id': 'req-73e166df-f9f0-4ff0-b69f-19b4e6379586'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:03.475690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-73e166df-f9f0-4ff0-b69f-19b4e6379586 admin admin] The token cache is being invalidate because project edbcd471337e48de9505d80df5dcc3d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:03.476231 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-73e166df-f9f0-4ff0-b69f-19b4e6379586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:03.476928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-73e166df-f9f0-4ff0-b69f-19b4e6379586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:03.478496 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 982/1970] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:03 2022] DELETE /identity/v3/projects/edbcd471337e48de9505d80df5dcc3d5 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:03.479286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e166df-f9f0-4ff0-b69f-19b4e6379586 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:03.480623 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-73e166df-f9f0-4ff0-b69f-19b4e6379586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:03.498779 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-33dcafe6-b802-4761-a386-35f6c0c50fe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '169a0e1ade7148d0991f7b38220191ac', 'request_id': 'req-33dcafe6-b802-4761-a386-35f6c0c50fe5'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:03.505708 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-33dcafe6-b802-4761-a386-35f6c0c50fe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '169a0e1ade7148d0991f7b38220191ac', 'request_id': 'req-33dcafe6-b802-4761-a386-35f6c0c50fe5'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:03.514704 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-33dcafe6-b802-4761-a386-35f6c0c50fe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '169a0e1ade7148d0991f7b38220191ac', 'request_id': 'req-33dcafe6-b802-4761-a386-35f6c0c50fe5'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:03.525547 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-33dcafe6-b802-4761-a386-35f6c0c50fe5 admin admin] The token cache is being invalidate because project 169a0e1ade7148d0991f7b38220191ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:03.525852 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-33dcafe6-b802-4761-a386-35f6c0c50fe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:03.526554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-33dcafe6-b802-4761-a386-35f6c0c50fe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:03.528375 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 989/1971] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:03 2022] DELETE /identity/v3/projects/169a0e1ade7148d0991f7b38220191ac => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:03.529408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41f285-2a66-4533-9fac-6e6ae2f8e69c None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:03.529692 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41f285-2a66-4533-9fac-6e6ae2f8e69c None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:03.529968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41f285-2a66-4533-9fac-6e6ae2f8e69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:03.543963 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e166df-f9f0-4ff0-b69f-19b4e6379586 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:03.551294 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-2a41f285-2a66-4533-9fac-6e6ae2f8e69c None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:03.552849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-2a41f285-2a66-4533-9fac-6e6ae2f8e69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:03.610937 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:03.617448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 990/1972] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:03.618921 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a43d9f-8a05-4b00-a331-88a139fb3fc6 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:03.619235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a43d9f-8a05-4b00-a331-88a139fb3fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:03.619550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a43d9f-8a05-4b00-a331-88a139fb3fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:03.625061 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388fbba-9f4c-49a3-b1bb-9d182e0c24e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:03.626586 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388fbba-9f4c-49a3-b1bb-9d182e0c24e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:03.628041 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388fbba-9f4c-49a3-b1bb-9d182e0c24e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:03.628553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388fbba-9f4c-49a3-b1bb-9d182e0c24e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:03.631917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-e388fbba-9f4c-49a3-b1bb-9d182e0c24e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:03.638502 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-65a43d9f-8a05-4b00-a331-88a139fb3fc6 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:03.639747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-65a43d9f-8a05-4b00-a331-88a139fb3fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:03.649079 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 991/1973] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:03.650375 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667fe28-f0b5-46d5-8591-92a6ce4e0f7e None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:03.650661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667fe28-f0b5-46d5-8591-92a6ce4e0f7e None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:03.650937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667fe28-f0b5-46d5-8591-92a6ce4e0f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:03.672685 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-b667fe28-f0b5-46d5-8591-92a6ce4e0f7e None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:03.674271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-b667fe28-f0b5-46d5-8591-92a6ce4e0f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:03.682980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 992/1974] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:03.684331 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c21dd5-2681-4eea-8075-c4fccd8e99af None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:03.684653 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c21dd5-2681-4eea-8075-c4fccd8e99af None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:03.684901 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c21dd5-2681-4eea-8075-c4fccd8e99af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:03.703787 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-c9c21dd5-2681-4eea-8075-c4fccd8e99af None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:03.705054 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-c9c21dd5-2681-4eea-8075-c4fccd8e99af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:03.707904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388fbba-9f4c-49a3-b1bb-9d182e0c24e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:03.709759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388fbba-9f4c-49a3-b1bb-9d182e0c24e2 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:03.718952 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 993/1975] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:03.718952 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c21dd5-2681-4eea-8075-c4fccd8e99af None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:03.729290 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c21dd5-2681-4eea-8075-c4fccd8e99af None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:03.732543 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 983/1976] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:03.735058 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e72ef5-cd8b-47d4-9ecd-8ea893589aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:03.735821 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e72ef5-cd8b-47d4-9ecd-8ea893589aae admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:03.736103 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e72ef5-cd8b-47d4-9ecd-8ea893589aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:03.736369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e72ef5-cd8b-47d4-9ecd-8ea893589aae admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:03.737093 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e72ef5-cd8b-47d4-9ecd-8ea893589aae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:05:03.737392 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e72ef5-cd8b-47d4-9ecd-8ea893589aae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:03.739111 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e72ef5-cd8b-47d4-9ecd-8ea893589aae admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:03.750021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388fbba-9f4c-49a3-b1bb-9d182e0c24e2 service cinder] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:03.754748 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 994/1977] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:05:03.759671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e72ef5-cd8b-47d4-9ecd-8ea893589aae admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:03.770836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e72ef5-cd8b-47d4-9ecd-8ea893589aae admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:03.772705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388fbba-9f4c-49a3-b1bb-9d182e0c24e2 service cinder] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:03.775946 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ed2fa-4367-4c18-be4c-5ead59149ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:03.776705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ed2fa-4367-4c18-be4c-5ead59149ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:03.777045 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ed2fa-4367-4c18-be4c-5ead59149ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:03.777382 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ed2fa-4367-4c18-be4c-5ead59149ba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:03.778036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1a531-e6a0-4b3d-a5c6-765f4f4bb989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:03.778141 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ed2fa-4367-4c18-be4c-5ead59149ba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:03.778795 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1a531-e6a0-4b3d-a5c6-765f4f4bb989 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:03.779086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1a531-e6a0-4b3d-a5c6-765f4f4bb989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:03.779371 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1a531-e6a0-4b3d-a5c6-765f4f4bb989 admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:03.780142 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1a531-e6a0-4b3d-a5c6-765f4f4bb989 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:05:03.780455 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1a531-e6a0-4b3d-a5c6-765f4f4bb989 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:03.780607 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ed2fa-4367-4c18-be4c-5ead59149ba8 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:03.782515 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1a531-e6a0-4b3d-a5c6-765f4f4bb989 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:03.801715 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 984/1978] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:05:03.802944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1a531-e6a0-4b3d-a5c6-765f4f4bb989 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:03.816926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 995/1979] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:03 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:03.818133 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1a531-e6a0-4b3d-a5c6-765f4f4bb989 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:03.821481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ed2fa-4367-4c18-be4c-5ead59149ba8 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:03.868060 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:03.891226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6daeeb1-6b31-4c5a-ad33-3e8925244c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:03.892392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6daeeb1-6b31-4c5a-ad33-3e8925244c6d admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:03.892888 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6daeeb1-6b31-4c5a-ad33-3e8925244c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:03.893369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6daeeb1-6b31-4c5a-ad33-3e8925244c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:03.894628 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6daeeb1-6b31-4c5a-ad33-3e8925244c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:03.897908 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6daeeb1-6b31-4c5a-ad33-3e8925244c6d admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:03.909359 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ed2fa-4367-4c18-be4c-5ead59149ba8 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:03.915604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccc001-01a7-49d5-b811-af892c124928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:03.916725 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccc001-01a7-49d5-b811-af892c124928 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:03.917206 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccc001-01a7-49d5-b811-af892c124928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:03.917482 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccc001-01a7-49d5-b811-af892c124928 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:03.918219 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccc001-01a7-49d5-b811-af892c124928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:03.920667 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccc001-01a7-49d5-b811-af892c124928 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:03.938254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 985/1980] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:03 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:03.943813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6daeeb1-6b31-4c5a-ad33-3e8925244c6d admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:03.958594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 996/1981] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:03 2022] POST /identity/v3/users => generated 285 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:05:03.963484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccc001-01a7-49d5-b811-af892c124928 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:03.984374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccc001-01a7-49d5-b811-af892c124928 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:04.060427 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6daeeb1-6b31-4c5a-ad33-3e8925244c6d admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:04.067870 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6f6b3-799e-41ea-b9e3-a6a9dad18f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:04.068182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6f6b3-799e-41ea-b9e3-a6a9dad18f56 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:04.068513 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6f6b3-799e-41ea-b9e3-a6a9dad18f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:04.068828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6f6b3-799e-41ea-b9e3-a6a9dad18f56 admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:04.070127 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6f6b3-799e-41ea-b9e3-a6a9dad18f56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:04.073149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6f6b3-799e-41ea-b9e3-a6a9dad18f56 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:04.101684 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:04.122906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0378b-2a4c-4b1e-b94d-6664cd630abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:04.123673 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0378b-2a4c-4b1e-b94d-6664cd630abb admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:04.123957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0378b-2a4c-4b1e-b94d-6664cd630abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:04.124367 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0378b-2a4c-4b1e-b94d-6664cd630abb admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:04.125077 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0378b-2a4c-4b1e-b94d-6664cd630abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:04.127270 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 986/1982] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:03 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:05:04.127726 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0378b-2a4c-4b1e-b94d-6664cd630abb admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:04.134899 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6f6b3-799e-41ea-b9e3-a6a9dad18f56 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:04.143484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 997/1983] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:04.145032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0378b-2a4c-4b1e-b94d-6664cd630abb admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:04.162516 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6f6b3-799e-41ea-b9e3-a6a9dad18f56 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:04.166460 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0378b-2a4c-4b1e-b94d-6664cd630abb admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:04.175518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d2705-97bf-4e3e-a2f1-d73885de39fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:04.176162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d2705-97bf-4e3e-a2f1-d73885de39fc admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:04.177412 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d2705-97bf-4e3e-a2f1-d73885de39fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:04.177699 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d2705-97bf-4e3e-a2f1-d73885de39fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:04.180512 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d2705-97bf-4e3e-a2f1-d73885de39fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:04.180512 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d2705-97bf-4e3e-a2f1-d73885de39fc admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:04.201034 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4d006-a525-4334-8c24-b2fd41312cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:04.201655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4d006-a525-4334-8c24-b2fd41312cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:04.201955 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4d006-a525-4334-8c24-b2fd41312cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:04.202262 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4d006-a525-4334-8c24-b2fd41312cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:04.203008 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd4d006-a525-4334-8c24-b2fd41312cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:04.204672 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd4d006-a525-4334-8c24-b2fd41312cf5 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:04.206207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 987/1984] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:04.210148 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d2705-97bf-4e3e-a2f1-d73885de39fc admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:04.221335 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d2705-97bf-4e3e-a2f1-d73885de39fc admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:04.226398 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 998/1985] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:05:04.226534 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec478b3-bbee-4c94-acab-9df367017eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:04.226982 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec478b3-bbee-4c94-acab-9df367017eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:04.227333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec478b3-bbee-4c94-acab-9df367017eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:04.227764 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec478b3-bbee-4c94-acab-9df367017eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:04.228511 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec478b3-bbee-4c94-acab-9df367017eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:04.230144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec478b3-bbee-4c94-acab-9df367017eb2 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:04.231799 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4d006-a525-4334-8c24-b2fd41312cf5 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:04.249290 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 988/1986] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:05:04.258644 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec478b3-bbee-4c94-acab-9df367017eb2 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:04.277239 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec478b3-bbee-4c94-acab-9df367017eb2 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:04.292716 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941bc02-9ac9-4ab5-b22c-5a69c09e6b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:04.293722 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941bc02-9ac9-4ab5-b22c-5a69c09e6b21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:04.294010 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941bc02-9ac9-4ab5-b22c-5a69c09e6b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:04.294373 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941bc02-9ac9-4ab5-b22c-5a69c09e6b21 admin admin] PATH_INFO: `/v3/projects/0a3c60d0bc85442085b716e51024da6e/users/5e1654abac01497fab5fbbcfec987ee9/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:04.299625 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4d006-a525-4334-8c24-b2fd41312cf5 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:04.317970 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941bc02-9ac9-4ab5-b22c-5a69c09e6b21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a3c60d0bc85442085b716e51024da6e, user_id=5e1654abac01497fab5fbbcfec987ee9, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:04.321155 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68cbc47-0d09-4658-96ea-57eab591ae9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:04.321455 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941bc02-9ac9-4ab5-b22c-5a69c09e6b21 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:04.322359 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cbc47-0d09-4658-96ea-57eab591ae9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:04.322359 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cbc47-0d09-4658-96ea-57eab591ae9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:04.326302 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cbc47-0d09-4658-96ea-57eab591ae9b admin admin] PATH_INFO: `/v3/projects/3ecffc37690a49dc8cda96b5fabacc9b/users/2790457b77004defbea2825d15d8f00d/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:04.348053 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 989/1987] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:04 2022] PUT /identity/v3/projects/0a3c60d0bc85442085b716e51024da6e/users/5e1654abac01497fab5fbbcfec987ee9/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:04.353959 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68cbc47-0d09-4658-96ea-57eab591ae9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ecffc37690a49dc8cda96b5fabacc9b, user_id=2790457b77004defbea2825d15d8f00d, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:04.357132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68cbc47-0d09-4658-96ea-57eab591ae9b admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:04.361475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f354993-9a08-408d-a2e8-ade393b1e1ef None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:04.361863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f354993-9a08-408d-a2e8-ade393b1e1ef None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:04.362196 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f354993-9a08-408d-a2e8-ade393b1e1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:04.377154 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 999/1988] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:04 2022] PUT /identity/v3/projects/3ecffc37690a49dc8cda96b5fabacc9b/users/2790457b77004defbea2825d15d8f00d/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:04.382943 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f50ced-10ac-4563-8c9c-506b5af87a15 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:04.387785 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f50ced-10ac-4563-8c9c-506b5af87a15 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:04.388305 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f50ced-10ac-4563-8c9c-506b5af87a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:04.401497 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-7f354993-9a08-408d-a2e8-ade393b1e1ef None None] MFA Rules not processed for user `5e1654abac01497fab5fbbcfec987ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:04.402909 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-7f354993-9a08-408d-a2e8-ade393b1e1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:04.410123 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-17f50ced-10ac-4563-8c9c-506b5af87a15 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:04.413084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-17f50ced-10ac-4563-8c9c-506b5af87a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:04.496159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1000/1989] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:04.502046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 990/1990] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:04.503321 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f50ced-10ac-4563-8c9c-506b5af87a15 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:04.505351 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-17f50ced-10ac-4563-8c9c-506b5af87a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:04.516683 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f354993-9a08-408d-a2e8-ade393b1e1ef None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:04.518396 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-7f354993-9a08-408d-a2e8-ade393b1e1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:04.539607 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:04.589139 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f50ced-10ac-4563-8c9c-506b5af87a15 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:04.596480 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63aa258-9226-4f46-94bc-ed73c91c14ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:04.597635 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63aa258-9226-4f46-94bc-ed73c91c14ae service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:04.597918 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63aa258-9226-4f46-94bc-ed73c91c14ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:04.598191 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63aa258-9226-4f46-94bc-ed73c91c14ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:04.613333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63aa258-9226-4f46-94bc-ed73c91c14ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:04.615701 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63aa258-9226-4f46-94bc-ed73c91c14ae service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:04.623301 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f354993-9a08-408d-a2e8-ade393b1e1ef None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:04.629806 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1001/1991] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:05:04.630563 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94639021-403c-4192-9b2c-f9b883c571f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46aba36939c549278bcdee7a04511e27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:04.631851 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94639021-403c-4192-9b2c-f9b883c571f6 service glance] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:04.632807 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94639021-403c-4192-9b2c-f9b883c571f6 service glance] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:04.632807 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94639021-403c-4192-9b2c-f9b883c571f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:04.647264 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94639021-403c-4192-9b2c-f9b883c571f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:04.648774 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94639021-403c-4192-9b2c-f9b883c571f6 service glance] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:04.660759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 991/1992] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:05:05.517779 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b381c3-164b-4148-a984-941600e61ecd None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:05.518299 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b381c3-164b-4148-a984-941600e61ecd None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:05.518299 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b381c3-164b-4148-a984-941600e61ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:05.554691 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-a0b381c3-164b-4148-a984-941600e61ecd None None] MFA Rules not processed for user `2790457b77004defbea2825d15d8f00d`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:05.557161 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-a0b381c3-164b-4148-a984-941600e61ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:05.699988 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1002/1993] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:05.715352 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94639021-403c-4192-9b2c-f9b883c571f6 service glance] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:05.718021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-94639021-403c-4192-9b2c-f9b883c571f6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:05.798041 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:05.818837 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94639021-403c-4192-9b2c-f9b883c571f6 service glance] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:05.830522 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9ec25-554d-44bf-89bc-01668a155102 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:05.831906 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9ec25-554d-44bf-89bc-01668a155102 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:05.832866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9ec25-554d-44bf-89bc-01668a155102 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:05.833663 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9ec25-554d-44bf-89bc-01668a155102 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:05.849061 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9ec25-554d-44bf-89bc-01668a155102 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:05.851722 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9ec25-554d-44bf-89bc-01668a155102 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:05.877735 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 992/1994] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:07.425035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cccaff-8da2-49d6-83b3-6913caa5b81f None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:07.425635 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cccaff-8da2-49d6-83b3-6913caa5b81f None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:07.425736 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cccaff-8da2-49d6-83b3-6913caa5b81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:07.452922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-84cccaff-8da2-49d6-83b3-6913caa5b81f None None] MFA Rules not processed for user `2790457b77004defbea2825d15d8f00d`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:07.454631 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-84cccaff-8da2-49d6-83b3-6913caa5b81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:07.465130 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1003/1995] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:08.580923 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9ec25-554d-44bf-89bc-01668a155102 service cinder] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:08.585496 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-c7a9ec25-554d-44bf-89bc-01668a155102 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:08.610612 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9ec25-554d-44bf-89bc-01668a155102 service cinder] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:08.618623 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f59dc1-df74-43ea-b1c3-06de1b9c29c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:08.621139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f59dc1-df74-43ea-b1c3-06de1b9c29c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:08.621739 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f59dc1-df74-43ea-b1c3-06de1b9c29c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:08.622313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f59dc1-df74-43ea-b1c3-06de1b9c29c4 admin admin] PATH_INFO: `/v3/users/879c5269fd364e75bc8246de341af282` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:08.623960 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f59dc1-df74-43ea-b1c3-06de1b9c29c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=879c5269fd364e75bc8246de341af282)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:08.626092 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f59dc1-df74-43ea-b1c3-06de1b9c29c4 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:08.714434 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-91f59dc1-df74-43ea-b1c3-06de1b9c29c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '879c5269fd364e75bc8246de341af282'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:08.747592 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-91f59dc1-df74-43ea-b1c3-06de1b9c29c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '879c5269fd364e75bc8246de341af282'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:08.754483 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-91f59dc1-df74-43ea-b1c3-06de1b9c29c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '879c5269fd364e75bc8246de341af282'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:08.755247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-91f59dc1-df74-43ea-b1c3-06de1b9c29c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '879c5269fd364e75bc8246de341af282'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:08.763299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-91f59dc1-df74-43ea-b1c3-06de1b9c29c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '879c5269fd364e75bc8246de341af282'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:08.772058 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 993/1996] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:08 2022] DELETE /identity/v3/users/879c5269fd364e75bc8246de341af282 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:08.776595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1e4c2-2634-4061-92d5-2d0fd07b6030 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:08.777102 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1e4c2-2634-4061-92d5-2d0fd07b6030 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:08.777196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1e4c2-2634-4061-92d5-2d0fd07b6030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:08.795330 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-5dd1e4c2-2634-4061-92d5-2d0fd07b6030 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:08.797136 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5dd1e4c2-2634-4061-92d5-2d0fd07b6030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:08.864098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1004/1997] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:08.874737 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f59dc1-df74-43ea-b1c3-06de1b9c29c4 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:08.876214 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-91f59dc1-df74-43ea-b1c3-06de1b9c29c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:08.958772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f59dc1-df74-43ea-b1c3-06de1b9c29c4 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:08.962689 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf6731-2ef4-473f-b774-6620c06774aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:08.963394 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf6731-2ef4-473f-b774-6620c06774aa service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:08.963651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf6731-2ef4-473f-b774-6620c06774aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:08.963927 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf6731-2ef4-473f-b774-6620c06774aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:08.969557 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1e4c2-2634-4061-92d5-2d0fd07b6030 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:08.974466 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5dd1e4c2-2634-4061-92d5-2d0fd07b6030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:08.980855 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf6731-2ef4-473f-b774-6620c06774aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:08.983241 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf6731-2ef4-473f-b774-6620c06774aa service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:08.986545 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1e4c2-2634-4061-92d5-2d0fd07b6030 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:08.991496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05765e-6e7a-4531-91f6-a803b856e2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:08.992455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05765e-6e7a-4531-91f6-a803b856e2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:08.992802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05765e-6e7a-4531-91f6-a803b856e2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:08.993143 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05765e-6e7a-4531-91f6-a803b856e2b6 admin admin] PATH_INFO: `/v3/users/a465233f11144b86b490cb7a9834eb2d` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:08.994417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05765e-6e7a-4531-91f6-a803b856e2b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a465233f11144b86b490cb7a9834eb2d)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:08.995011 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 994/1998] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:05:08.996764 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05765e-6e7a-4531-91f6-a803b856e2b6 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:09.088042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:09.091516 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-ef05765e-6e7a-4531-91f6-a803b856e2b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a465233f11144b86b490cb7a9834eb2d'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:09.106086 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-ef05765e-6e7a-4531-91f6-a803b856e2b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a465233f11144b86b490cb7a9834eb2d'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:09.107294 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-ef05765e-6e7a-4531-91f6-a803b856e2b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a465233f11144b86b490cb7a9834eb2d'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:09.112305 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-ef05765e-6e7a-4531-91f6-a803b856e2b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a465233f11144b86b490cb7a9834eb2d'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:09.139640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-ef05765e-6e7a-4531-91f6-a803b856e2b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a465233f11144b86b490cb7a9834eb2d'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:09.164042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cb0af-464d-4dbf-acd4-18d30f38f0a4 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:09.164547 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cb0af-464d-4dbf-acd4-18d30f38f0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:09.164849 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cb0af-464d-4dbf-acd4-18d30f38f0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:09.167296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1005/1999] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:08 2022] DELETE /identity/v3/users/a465233f11144b86b490cb7a9834eb2d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:09.203912 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-2a2cb0af-464d-4dbf-acd4-18d30f38f0a4 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:09.205290 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-2a2cb0af-464d-4dbf-acd4-18d30f38f0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:09.317035 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 995/2000] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:09.340365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05765e-6e7a-4531-91f6-a803b856e2b6 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:09.342043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-ef05765e-6e7a-4531-91f6-a803b856e2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:09.467092 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05765e-6e7a-4531-91f6-a803b856e2b6 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:09.472373 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759a9f0-3952-4540-882c-34dc418278cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:09.473051 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759a9f0-3952-4540-882c-34dc418278cd service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:09.473627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759a9f0-3952-4540-882c-34dc418278cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:09.473948 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759a9f0-3952-4540-882c-34dc418278cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:09.487133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759a9f0-3952-4540-882c-34dc418278cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:09.491766 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759a9f0-3952-4540-882c-34dc418278cd service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:09.502169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1006/2001] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:09.608578 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cb0af-464d-4dbf-acd4-18d30f38f0a4 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:09.610037 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-2a2cb0af-464d-4dbf-acd4-18d30f38f0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:09.619060 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:09.629495 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cb0af-464d-4dbf-acd4-18d30f38f0a4 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:09.638103 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bb424-3858-40de-b6ae-a1bda2e51cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:09.639528 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bb424-3858-40de-b6ae-a1bda2e51cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:09.640567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bb424-3858-40de-b6ae-a1bda2e51cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:09.641180 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bb424-3858-40de-b6ae-a1bda2e51cec admin admin] PATH_INFO: `/v3/projects/45cd69fadbf74892899b54c56c9bb113` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:09.644268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39bb424-3858-40de-b6ae-a1bda2e51cec admin admin] RBAC: Authorizing `identity:delete_project(project_id=45cd69fadbf74892899b54c56c9bb113)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:09.648337 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39bb424-3858-40de-b6ae-a1bda2e51cec admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:09.728990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-b39bb424-3858-40de-b6ae-a1bda2e51cec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45cd69fadbf74892899b54c56c9bb113', 'request_id': 'req-b39bb424-3858-40de-b6ae-a1bda2e51cec'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:09.743688 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-b39bb424-3858-40de-b6ae-a1bda2e51cec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45cd69fadbf74892899b54c56c9bb113', 'request_id': 'req-b39bb424-3858-40de-b6ae-a1bda2e51cec'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:09.752139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-b39bb424-3858-40de-b6ae-a1bda2e51cec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45cd69fadbf74892899b54c56c9bb113', 'request_id': 'req-b39bb424-3858-40de-b6ae-a1bda2e51cec'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:09.777020 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-b39bb424-3858-40de-b6ae-a1bda2e51cec admin admin] The token cache is being invalidate because project 45cd69fadbf74892899b54c56c9bb113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:09.777371 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-b39bb424-3858-40de-b6ae-a1bda2e51cec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:09.778574 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-b39bb424-3858-40de-b6ae-a1bda2e51cec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:09.785007 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 996/2002] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:09 2022] DELETE /identity/v3/projects/45cd69fadbf74892899b54c56c9bb113 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:09.785387 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759a9f0-3952-4540-882c-34dc418278cd service neutron] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:09.802276 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759a9f0-3952-4540-882c-34dc418278cd service neutron] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:09.914462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928573cd-ada7-410c-b633-ec881f03fc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:09.915773 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928573cd-ada7-410c-b633-ec881f03fc16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:09.915980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928573cd-ada7-410c-b633-ec881f03fc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:09.916260 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928573cd-ada7-410c-b633-ec881f03fc16 admin admin] PATH_INFO: `/v3/users/a5072737b0bf46a995deec95a49bea51` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:09.917584 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928573cd-ada7-410c-b633-ec881f03fc16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5072737b0bf46a995deec95a49bea51)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:09.919589 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928573cd-ada7-410c-b633-ec881f03fc16 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:09.992848 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-928573cd-ada7-410c-b633-ec881f03fc16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5072737b0bf46a995deec95a49bea51'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:09.993213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bb424-3858-40de-b6ae-a1bda2e51cec admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:09.994800 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-b39bb424-3858-40de-b6ae-a1bda2e51cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:10.004324 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-928573cd-ada7-410c-b633-ec881f03fc16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5072737b0bf46a995deec95a49bea51'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:10.008781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bb424-3858-40de-b6ae-a1bda2e51cec admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:10.011875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-928573cd-ada7-410c-b633-ec881f03fc16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5072737b0bf46a995deec95a49bea51'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:10.013104 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-928573cd-ada7-410c-b633-ec881f03fc16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5072737b0bf46a995deec95a49bea51'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:10.013301 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7b421-c3e4-464e-9c5d-62e70f4173b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:10.014203 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7b421-c3e4-464e-9c5d-62e70f4173b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:10.014469 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7b421-c3e4-464e-9c5d-62e70f4173b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:10.014751 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7b421-c3e4-464e-9c5d-62e70f4173b3 admin admin] PATH_INFO: `/v3/projects/c38a21c7639d4fa0a25e4a216a94579c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:10.016045 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7b421-c3e4-464e-9c5d-62e70f4173b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c38a21c7639d4fa0a25e4a216a94579c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:10.018405 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7b421-c3e4-464e-9c5d-62e70f4173b3 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:10.032931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:10.038713 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-928573cd-ada7-410c-b633-ec881f03fc16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5072737b0bf46a995deec95a49bea51'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:10.059095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1007/2003] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:09 2022] DELETE /identity/v3/users/a5072737b0bf46a995deec95a49bea51 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:10.104089 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d9e7b421-c3e4-464e-9c5d-62e70f4173b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c38a21c7639d4fa0a25e4a216a94579c', 'request_id': 'req-d9e7b421-c3e4-464e-9c5d-62e70f4173b3'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:10.119379 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d9e7b421-c3e4-464e-9c5d-62e70f4173b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c38a21c7639d4fa0a25e4a216a94579c', 'request_id': 'req-d9e7b421-c3e4-464e-9c5d-62e70f4173b3'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:10.128814 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d9e7b421-c3e4-464e-9c5d-62e70f4173b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c38a21c7639d4fa0a25e4a216a94579c', 'request_id': 'req-d9e7b421-c3e4-464e-9c5d-62e70f4173b3'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:10.143372 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d9e7b421-c3e4-464e-9c5d-62e70f4173b3 admin admin] The token cache is being invalidate because project c38a21c7639d4fa0a25e4a216a94579c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:10.143692 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d9e7b421-c3e4-464e-9c5d-62e70f4173b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:10.144380 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d9e7b421-c3e4-464e-9c5d-62e70f4173b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:10.149311 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 997/2004] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:09 2022] DELETE /identity/v3/projects/c38a21c7639d4fa0a25e4a216a94579c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:10.153051 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928573cd-ada7-410c-b633-ec881f03fc16 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:10.153051 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-928573cd-ada7-410c-b633-ec881f03fc16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:10.274643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928573cd-ada7-410c-b633-ec881f03fc16 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:10.363324 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4aeb9-96b9-4123-a80b-ffc9f4a3517f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:10.364274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4aeb9-96b9-4123-a80b-ffc9f4a3517f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:10.365155 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4aeb9-96b9-4123-a80b-ffc9f4a3517f admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:10.365443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4aeb9-96b9-4123-a80b-ffc9f4a3517f admin admin] PATH_INFO: `/v3/users/6f71cc21e5e84302b7840bcd670e2a29` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:10.366740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4aeb9-96b9-4123-a80b-ffc9f4a3517f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f71cc21e5e84302b7840bcd670e2a29)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:10.369194 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4aeb9-96b9-4123-a80b-ffc9f4a3517f admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:10.452962 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-a4e4aeb9-96b9-4123-a80b-ffc9f4a3517f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f71cc21e5e84302b7840bcd670e2a29'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:10.465990 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-a4e4aeb9-96b9-4123-a80b-ffc9f4a3517f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f71cc21e5e84302b7840bcd670e2a29'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:10.466783 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-a4e4aeb9-96b9-4123-a80b-ffc9f4a3517f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f71cc21e5e84302b7840bcd670e2a29'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:10.467399 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-a4e4aeb9-96b9-4123-a80b-ffc9f4a3517f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f71cc21e5e84302b7840bcd670e2a29'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:10.477890 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7b421-c3e4-464e-9c5d-62e70f4173b3 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:10.479549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-d9e7b421-c3e4-464e-9c5d-62e70f4173b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:10.504437 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7b421-c3e4-464e-9c5d-62e70f4173b3 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:10.509373 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-a4e4aeb9-96b9-4123-a80b-ffc9f4a3517f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f71cc21e5e84302b7840bcd670e2a29'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:10.516027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5a730-5d47-4252-a478-9652a0333e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:10.519998 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5a730-5d47-4252-a478-9652a0333e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:10.519998 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5a730-5d47-4252-a478-9652a0333e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:10.519998 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5a730-5d47-4252-a478-9652a0333e94 admin admin] PATH_INFO: `/v3/projects/8fd1dfbd70134a969fc20fa9920c3397` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:10.520536 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5a730-5d47-4252-a478-9652a0333e94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fd1dfbd70134a969fc20fa9920c3397)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:10.530088 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5a730-5d47-4252-a478-9652a0333e94 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:10.553331 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1008/2005] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:10 2022] DELETE /identity/v3/users/6f71cc21e5e84302b7840bcd670e2a29 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:05:10.625680 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-57a5a730-5d47-4252-a478-9652a0333e94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fd1dfbd70134a969fc20fa9920c3397', 'request_id': 'req-57a5a730-5d47-4252-a478-9652a0333e94'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:10.636965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-57a5a730-5d47-4252-a478-9652a0333e94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fd1dfbd70134a969fc20fa9920c3397', 'request_id': 'req-57a5a730-5d47-4252-a478-9652a0333e94'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:10.642653 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=76,keystone:DELETE=21,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:10.644269 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-57a5a730-5d47-4252-a478-9652a0333e94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fd1dfbd70134a969fc20fa9920c3397', 'request_id': 'req-57a5a730-5d47-4252-a478-9652a0333e94'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:10.659009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-57a5a730-5d47-4252-a478-9652a0333e94 admin admin] The token cache is being invalidate because project 8fd1dfbd70134a969fc20fa9920c3397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:10.659727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-57a5a730-5d47-4252-a478-9652a0333e94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:10.661038 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-57a5a730-5d47-4252-a478-9652a0333e94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:10.664105 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 998/2006] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:10 2022] DELETE /identity/v3/projects/8fd1dfbd70134a969fc20fa9920c3397 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:10.670105 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d059c-6e71-489c-ab76-7d586160cbf9 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:10.670413 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d059c-6e71-489c-ab76-7d586160cbf9 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:10.670667 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d059c-6e71-489c-ab76-7d586160cbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:10.692013 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-da1d059c-6e71-489c-ab76-7d586160cbf9 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:10.693308 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-da1d059c-6e71-489c-ab76-7d586160cbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:10.700426 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:10.782944 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1009/2007] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:10.790966 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfac91-c666-4160-8c48-cecfefe37849 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:10.791499 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfac91-c666-4160-8c48-cecfefe37849 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:10.791820 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfac91-c666-4160-8c48-cecfefe37849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:10.816215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-13cfac91-c666-4160-8c48-cecfefe37849 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:10.817595 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-13cfac91-c666-4160-8c48-cecfefe37849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:10.841415 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 999/2008] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:10.845675 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d059c-6e71-489c-ab76-7d586160cbf9 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:10.857069 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d059c-6e71-489c-ab76-7d586160cbf9 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:10.864138 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba94c95-d36d-4994-8f9e-400e8086f399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:10.865377 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba94c95-d36d-4994-8f9e-400e8086f399 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:10.865740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba94c95-d36d-4994-8f9e-400e8086f399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:10.866102 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba94c95-d36d-4994-8f9e-400e8086f399 admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:10.869486 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba94c95-d36d-4994-8f9e-400e8086f399 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:05:10.869892 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba94c95-d36d-4994-8f9e-400e8086f399 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:10.871659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba94c95-d36d-4994-8f9e-400e8086f399 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:10.898267 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1010/2009] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:05:10.903458 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfac91-c666-4160-8c48-cecfefe37849 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:10.915426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfac91-c666-4160-8c48-cecfefe37849 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:10.929069 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c053e0-3739-4ea2-a36d-30885c92eda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:10.929939 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c053e0-3739-4ea2-a36d-30885c92eda1 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:10.930447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c053e0-3739-4ea2-a36d-30885c92eda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:10.930628 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c053e0-3739-4ea2-a36d-30885c92eda1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:10.931851 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c053e0-3739-4ea2-a36d-30885c92eda1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:10.933944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c053e0-3739-4ea2-a36d-30885c92eda1 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:10.973561 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1000/2010] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:10 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:10.978062 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba94c95-d36d-4994-8f9e-400e8086f399 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:10.990321 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba94c95-d36d-4994-8f9e-400e8086f399 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:11.002497 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c053e0-3739-4ea2-a36d-30885c92eda1 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:11.005867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-78c053e0-3739-4ea2-a36d-30885c92eda1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:11.106575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cd279-d33f-4297-ae41-a5020393024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:11.107342 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cd279-d33f-4297-ae41-a5020393024a admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:11.107732 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cd279-d33f-4297-ae41-a5020393024a admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:11.108074 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cd279-d33f-4297-ae41-a5020393024a admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:11.108846 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49cd279-d33f-4297-ae41-a5020393024a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:11.111741 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49cd279-d33f-4297-ae41-a5020393024a admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:11.123326 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c053e0-3739-4ea2-a36d-30885c92eda1 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:11.125899 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93271f-a442-482f-9cc7-7b39cb550c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:11.127448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93271f-a442-482f-9cc7-7b39cb550c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:11.127804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93271f-a442-482f-9cc7-7b39cb550c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:11.128161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93271f-a442-482f-9cc7-7b39cb550c93 admin admin] PATH_INFO: `/v3/projects/191106c0549f4a43bee894f0adf646c5` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:11.129984 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93271f-a442-482f-9cc7-7b39cb550c93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=191106c0549f4a43bee894f0adf646c5)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:11.132541 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93271f-a442-482f-9cc7-7b39cb550c93 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:11.143514 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1011/2011] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:10 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:11.147696 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cd279-d33f-4297-ae41-a5020393024a admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:11.160477 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cd279-d33f-4297-ae41-a5020393024a admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:11.169128 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c2daf-b5f7-4237-83ed-3bea309efbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:11.169897 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c2daf-b5f7-4237-83ed-3bea309efbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:11.170180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c2daf-b5f7-4237-83ed-3bea309efbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:11.170432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c2daf-b5f7-4237-83ed-3bea309efbd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:11.171183 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c2daf-b5f7-4237-83ed-3bea309efbd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:11.172856 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c2daf-b5f7-4237-83ed-3bea309efbd9 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:11.186723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1012/2012] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:11.190355 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c2daf-b5f7-4237-83ed-3bea309efbd9 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:11.202855 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-1d93271f-a442-482f-9cc7-7b39cb550c93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '191106c0549f4a43bee894f0adf646c5', 'request_id': 'req-1d93271f-a442-482f-9cc7-7b39cb550c93'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:11.207168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c2daf-b5f7-4237-83ed-3bea309efbd9 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:11.219348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-1d93271f-a442-482f-9cc7-7b39cb550c93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '191106c0549f4a43bee894f0adf646c5', 'request_id': 'req-1d93271f-a442-482f-9cc7-7b39cb550c93'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:11.228634 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-1d93271f-a442-482f-9cc7-7b39cb550c93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '191106c0549f4a43bee894f0adf646c5', 'request_id': 'req-1d93271f-a442-482f-9cc7-7b39cb550c93'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:11.244527 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-1d93271f-a442-482f-9cc7-7b39cb550c93 admin admin] The token cache is being invalidate because project 191106c0549f4a43bee894f0adf646c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:11.244838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-1d93271f-a442-482f-9cc7-7b39cb550c93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:11.246955 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-1d93271f-a442-482f-9cc7-7b39cb550c93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:11.248918 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1001/2013] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:11 2022] DELETE /identity/v3/projects/191106c0549f4a43bee894f0adf646c5 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:05:11.258238 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b96cb0-1d3a-4cf2-93aa-c8be922daa4a None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:11.258622 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b96cb0-1d3a-4cf2-93aa-c8be922daa4a None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:11.258978 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b96cb0-1d3a-4cf2-93aa-c8be922daa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:11.300819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-00b96cb0-1d3a-4cf2-93aa-c8be922daa4a None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:11.304149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-00b96cb0-1d3a-4cf2-93aa-c8be922daa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:11.355622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33319867-f7be-4776-b8ff-0b8c50d90978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:11.356466 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33319867-f7be-4776-b8ff-0b8c50d90978 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:11.356574 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33319867-f7be-4776-b8ff-0b8c50d90978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:11.356854 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33319867-f7be-4776-b8ff-0b8c50d90978 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:11.357608 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33319867-f7be-4776-b8ff-0b8c50d90978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:11.362196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33319867-f7be-4776-b8ff-0b8c50d90978 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:11.386975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1013/2014] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:05:11.391833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33319867-f7be-4776-b8ff-0b8c50d90978 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:11.395718 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-33319867-f7be-4776-b8ff-0b8c50d90978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:11.406868 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:11.419589 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33319867-f7be-4776-b8ff-0b8c50d90978 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:11.431845 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e105767-d8c0-4897-aa89-918e0d1f953c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:11.434488 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e105767-d8c0-4897-aa89-918e0d1f953c admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:11.434767 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e105767-d8c0-4897-aa89-918e0d1f953c admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:11.435043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e105767-d8c0-4897-aa89-918e0d1f953c admin admin] PATH_INFO: `/v3/projects/5baed6c03ad14661975318f5f2cf6d5c/users/700bf7585ea34f5eb227b0d18851fc40/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:11.437752 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1002/2015] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:11.446601 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49632a-b5ea-41a0-923f-b60cb654272c None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:11.446906 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49632a-b5ea-41a0-923f-b60cb654272c None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:11.447333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49632a-b5ea-41a0-923f-b60cb654272c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:11.449006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:11.454434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e105767-d8c0-4897-aa89-918e0d1f953c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5baed6c03ad14661975318f5f2cf6d5c, user_id=700bf7585ea34f5eb227b0d18851fc40, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:11.458368 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e105767-d8c0-4897-aa89-918e0d1f953c admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:11.473350 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-8e49632a-b5ea-41a0-923f-b60cb654272c None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:11.474669 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-8e49632a-b5ea-41a0-923f-b60cb654272c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:11.491071 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1003/2016] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:11.491888 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49632a-b5ea-41a0-923f-b60cb654272c None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:11.498980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1014/2017] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:11 2022] PUT /identity/v3/projects/5baed6c03ad14661975318f5f2cf6d5c/users/700bf7585ea34f5eb227b0d18851fc40/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:05:11.502625 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49632a-b5ea-41a0-923f-b60cb654272c None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:11.511506 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f36739-94a0-4d99-9585-85a5739bffa5 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:11.511871 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f36739-94a0-4d99-9585-85a5739bffa5 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:11.512064 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f36739-94a0-4d99-9585-85a5739bffa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:11.544920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-e7f36739-94a0-4d99-9585-85a5739bffa5 None None] MFA Rules not processed for user `700bf7585ea34f5eb227b0d18851fc40`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:11.545958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-e7f36739-94a0-4d99-9585-85a5739bffa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:11.617130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480a23b-7cbb-4166-aa6f-3648d79e32d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:11.625202 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480a23b-7cbb-4166-aa6f-3648d79e32d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:11.627100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480a23b-7cbb-4166-aa6f-3648d79e32d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:11.627709 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480a23b-7cbb-4166-aa6f-3648d79e32d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:11.628343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480a23b-7cbb-4166-aa6f-3648d79e32d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:05:11.628867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480a23b-7cbb-4166-aa6f-3648d79e32d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:11.631216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480a23b-7cbb-4166-aa6f-3648d79e32d8 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:11.669978 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1004/2018] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:05:11.676213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480a23b-7cbb-4166-aa6f-3648d79e32d8 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:11.693951 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1015/2019] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:11.700574 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f36739-94a0-4d99-9585-85a5739bffa5 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:11.715652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f36739-94a0-4d99-9585-85a5739bffa5 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:11.722278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097bd4d-6385-43b6-8bcc-c94197c791a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:11.723560 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097bd4d-6385-43b6-8bcc-c94197c791a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:11.724077 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097bd4d-6385-43b6-8bcc-c94197c791a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:11.724613 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097bd4d-6385-43b6-8bcc-c94197c791a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:11.725561 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097bd4d-6385-43b6-8bcc-c94197c791a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:11.728384 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097bd4d-6385-43b6-8bcc-c94197c791a2 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:11.742330 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480a23b-7cbb-4166-aa6f-3648d79e32d8 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:11.764490 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783efdc4-9937-4732-8f50-cb006d84d3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:11.766066 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783efdc4-9937-4732-8f50-cb006d84d3c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:11.767174 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783efdc4-9937-4732-8f50-cb006d84d3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:11.768194 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783efdc4-9937-4732-8f50-cb006d84d3c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:11.769123 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783efdc4-9937-4732-8f50-cb006d84d3c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:11.780723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783efdc4-9937-4732-8f50-cb006d84d3c5 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:11.798135 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1016/2020] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:11 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:11.799557 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097bd4d-6385-43b6-8bcc-c94197c791a2 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:11.844223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1005/2021] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:11 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:11.848484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783efdc4-9937-4732-8f50-cb006d84d3c5 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:11.941810 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783efdc4-9937-4732-8f50-cb006d84d3c5 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:11.946783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d7929-25ad-418b-a178-1a84f33d67ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:11.947528 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d7929-25ad-418b-a178-1a84f33d67ce admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:11.947854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d7929-25ad-418b-a178-1a84f33d67ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:11.948298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d7929-25ad-418b-a178-1a84f33d67ce admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:11.949004 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d7929-25ad-418b-a178-1a84f33d67ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:11.951010 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d7929-25ad-418b-a178-1a84f33d67ce admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:11.958053 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097bd4d-6385-43b6-8bcc-c94197c791a2 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:11.966607 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474602a6-2398-426b-9523-d0dc00376c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:11.967342 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474602a6-2398-426b-9523-d0dc00376c87 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:11.967674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474602a6-2398-426b-9523-d0dc00376c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:11.967936 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474602a6-2398-426b-9523-d0dc00376c87 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:11.968675 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474602a6-2398-426b-9523-d0dc00376c87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:11.971191 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474602a6-2398-426b-9523-d0dc00376c87 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:11.983803 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1006/2022] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:11 2022] POST /identity/v3/users => generated 291 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:05:11.987603 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d7929-25ad-418b-a178-1a84f33d67ce admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:12.012197 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d7929-25ad-418b-a178-1a84f33d67ce admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:12.022625 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1017/2023] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:11 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:12.023647 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474602a6-2398-426b-9523-d0dc00376c87 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:12.025923 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc8831-a32c-4560-a624-0c34cea9a0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:12.026642 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc8831-a32c-4560-a624-0c34cea9a0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:12.026931 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc8831-a32c-4560-a624-0c34cea9a0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:12.027211 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc8831-a32c-4560-a624-0c34cea9a0f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:12.028007 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc8831-a32c-4560-a624-0c34cea9a0f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:12.030674 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc8831-a32c-4560-a624-0c34cea9a0f1 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:12.041321 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474602a6-2398-426b-9523-d0dc00376c87 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:12.055200 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1007/2024] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:12.059694 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc8831-a32c-4560-a624-0c34cea9a0f1 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:12.064808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb8cbd-586d-4960-b110-5d4fc774029e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:12.064808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb8cbd-586d-4960-b110-5d4fc774029e admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:12.065076 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb8cbd-586d-4960-b110-5d4fc774029e admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:12.065322 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb8cbd-586d-4960-b110-5d4fc774029e admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:12.066067 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb8cbd-586d-4960-b110-5d4fc774029e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:12.067831 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb8cbd-586d-4960-b110-5d4fc774029e admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:12.090445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc8831-a32c-4560-a624-0c34cea9a0f1 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:12.104090 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8af49a-50fa-4834-8574-20d0c28fe927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:12.109164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8af49a-50fa-4834-8574-20d0c28fe927 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:12.109455 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8af49a-50fa-4834-8574-20d0c28fe927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:12.109740 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8af49a-50fa-4834-8574-20d0c28fe927 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:12.110533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8af49a-50fa-4834-8574-20d0c28fe927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:12.112304 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1018/2025] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:12.122257 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb8cbd-586d-4960-b110-5d4fc774029e admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:12.123622 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8af49a-50fa-4834-8574-20d0c28fe927 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:12.152782 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb8cbd-586d-4960-b110-5d4fc774029e admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:12.160490 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1008/2026] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:05:12.164569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8af49a-50fa-4834-8574-20d0c28fe927 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:12.172877 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dedc05-7f5e-4c1a-8343-dc0e8bf2c5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:12.174402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dedc05-7f5e-4c1a-8343-dc0e8bf2c5e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:12.174832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dedc05-7f5e-4c1a-8343-dc0e8bf2c5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:12.175285 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dedc05-7f5e-4c1a-8343-dc0e8bf2c5e4 admin admin] PATH_INFO: `/v3/projects/ef50a09fe1d84cff870658abffcdfd78/users/5a55c37b371f42688370ce882a435df1/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:12.193275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8af49a-50fa-4834-8574-20d0c28fe927 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:12.200427 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce4676-0bda-4b40-ac61-7ad8b9dbb12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:12.201356 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce4676-0bda-4b40-ac61-7ad8b9dbb12c admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:12.201642 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce4676-0bda-4b40-ac61-7ad8b9dbb12c admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:12.201925 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce4676-0bda-4b40-ac61-7ad8b9dbb12c admin admin] PATH_INFO: `/v3/projects/c84f751c309f412c95afd03050c8f2e0/users/c14fad66fe9b455ea0e25b4a31391d3f/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:12.206505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dedc05-7f5e-4c1a-8343-dc0e8bf2c5e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef50a09fe1d84cff870658abffcdfd78, user_id=5a55c37b371f42688370ce882a435df1, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:12.210001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dedc05-7f5e-4c1a-8343-dc0e8bf2c5e4 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:12.249774 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce4676-0bda-4b40-ac61-7ad8b9dbb12c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c84f751c309f412c95afd03050c8f2e0, user_id=c14fad66fe9b455ea0e25b4a31391d3f, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:12.253699 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1019/2027] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:12 2022] PUT /identity/v3/projects/ef50a09fe1d84cff870658abffcdfd78/users/5a55c37b371f42688370ce882a435df1/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:12.261120 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dedc05-7f5e-4c1a-8343-dc0e8bf2c5e4 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:12.261922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce4676-0bda-4b40-ac61-7ad8b9dbb12c admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:12.294268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1009/2028] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:12 2022] PUT /identity/v3/projects/c84f751c309f412c95afd03050c8f2e0/users/c14fad66fe9b455ea0e25b4a31391d3f/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:12.295248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:12.307644 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf32ff1-2b71-4d15-8e21-8ae062ccef6b None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:12.308331 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf32ff1-2b71-4d15-8e21-8ae062ccef6b None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:12.308813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf32ff1-2b71-4d15-8e21-8ae062ccef6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:12.318255 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:12.349921 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-faf32ff1-2b71-4d15-8e21-8ae062ccef6b None None] MFA Rules not processed for user `c14fad66fe9b455ea0e25b4a31391d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:12.351565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-faf32ff1-2b71-4d15-8e21-8ae062ccef6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:12.365656 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dedc05-7f5e-4c1a-8343-dc0e8bf2c5e4 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:12.513201 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7527b-e0ae-4863-a4f4-4c7b54bff53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:12.513902 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7527b-e0ae-4863-a4f4-4c7b54bff53b admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:12.514180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7527b-e0ae-4863-a4f4-4c7b54bff53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:12.515034 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7527b-e0ae-4863-a4f4-4c7b54bff53b admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:12.515373 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7527b-e0ae-4863-a4f4-4c7b54bff53b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:12.518171 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7527b-e0ae-4863-a4f4-4c7b54bff53b admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:12.556980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1010/2029] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:12.570617 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf32ff1-2b71-4d15-8e21-8ae062ccef6b None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:12.572568 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1020/2030] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:12.574123 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-faf32ff1-2b71-4d15-8e21-8ae062ccef6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:12.583670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7527b-e0ae-4863-a4f4-4c7b54bff53b admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:12.604008 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7527b-e0ae-4863-a4f4-4c7b54bff53b admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:12.621575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d80573-7e97-46a0-8244-2074f72f8463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:12.622702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d80573-7e97-46a0-8244-2074f72f8463 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:12.623135 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d80573-7e97-46a0-8244-2074f72f8463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:12.623435 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d80573-7e97-46a0-8244-2074f72f8463 admin admin] PATH_INFO: `/v3/projects/ef50a09fe1d84cff870658abffcdfd78/users/5a55c37b371f42688370ce882a435df1/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:12.627518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d80573-7e97-46a0-8244-2074f72f8463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef50a09fe1d84cff870658abffcdfd78, user_id=5a55c37b371f42688370ce882a435df1, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:12.634536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d80573-7e97-46a0-8244-2074f72f8463 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:12.662336 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1021/2031] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:12 2022] PUT /identity/v3/projects/ef50a09fe1d84cff870658abffcdfd78/users/5a55c37b371f42688370ce882a435df1/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:12.676558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642cb4e-7f02-4251-9428-415464ccf07e None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:12.676961 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642cb4e-7f02-4251-9428-415464ccf07e None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:12.677331 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642cb4e-7f02-4251-9428-415464ccf07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:12.726925 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf32ff1-2b71-4d15-8e21-8ae062ccef6b None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:12.744513 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-5642cb4e-7f02-4251-9428-415464ccf07e None None] MFA Rules not processed for user `5a55c37b371f42688370ce882a435df1`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:12.745751 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5642cb4e-7f02-4251-9428-415464ccf07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:12.803474 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbdcdc-d836-4be2-974d-a235a9078014 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:12.804318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbdcdc-d836-4be2-974d-a235a9078014 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:12.804876 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbdcdc-d836-4be2-974d-a235a9078014 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:12.805153 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbdcdc-d836-4be2-974d-a235a9078014 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:12.945100 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1022/2032] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:12.948764 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bbdcdc-d836-4be2-974d-a235a9078014 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:12.948764 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bbdcdc-d836-4be2-974d-a235a9078014 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:12.971589 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1011/2033] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:12.983913 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642cb4e-7f02-4251-9428-415464ccf07e None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:13.023188 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbdcdc-d836-4be2-974d-a235a9078014 service cinder] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:13.030874 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:13.036546 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbdcdc-d836-4be2-974d-a235a9078014 service cinder] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:13.043097 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040756a-a749-48e5-9d24-04e67692d013 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:13.044466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040756a-a749-48e5-9d24-04e67692d013 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:13.047136 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040756a-a749-48e5-9d24-04e67692d013 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:13.048036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040756a-a749-48e5-9d24-04e67692d013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:13.058213 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:13.124911 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642cb4e-7f02-4251-9428-415464ccf07e None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:13.132912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e6c85-1cf3-4ff6-8fae-3a300b8ead56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:13.134702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e6c85-1cf3-4ff6-8fae-3a300b8ead56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:13.134847 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040756a-a749-48e5-9d24-04e67692d013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:13.135028 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e6c85-1cf3-4ff6-8fae-3a300b8ead56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:13.135312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e6c85-1cf3-4ff6-8fae-3a300b8ead56 admin admin] PATH_INFO: `/v3/users/c14fad66fe9b455ea0e25b4a31391d3f` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:13.136299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040756a-a749-48e5-9d24-04e67692d013 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:13.137381 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e6c85-1cf3-4ff6-8fae-3a300b8ead56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c14fad66fe9b455ea0e25b4a31391d3f)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:13.140381 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e6c85-1cf3-4ff6-8fae-3a300b8ead56 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:13.160662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1012/2034] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:05:13.238878 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-4f2e6c85-1cf3-4ff6-8fae-3a300b8ead56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c14fad66fe9b455ea0e25b4a31391d3f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:13.249571 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-4f2e6c85-1cf3-4ff6-8fae-3a300b8ead56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c14fad66fe9b455ea0e25b4a31391d3f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:13.250408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-4f2e6c85-1cf3-4ff6-8fae-3a300b8ead56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c14fad66fe9b455ea0e25b4a31391d3f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:13.251125 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-4f2e6c85-1cf3-4ff6-8fae-3a300b8ead56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c14fad66fe9b455ea0e25b4a31391d3f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:13.267314 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-4f2e6c85-1cf3-4ff6-8fae-3a300b8ead56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c14fad66fe9b455ea0e25b4a31391d3f'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:13.290678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1023/2035] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:12 2022] DELETE /identity/v3/users/c14fad66fe9b455ea0e25b4a31391d3f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:13.295214 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1889c75-c55f-4649-8525-4fc9e8a8ab5d None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:13.295762 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1889c75-c55f-4649-8525-4fc9e8a8ab5d None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:13.296125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1889c75-c55f-4649-8525-4fc9e8a8ab5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:13.338450 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-d1889c75-c55f-4649-8525-4fc9e8a8ab5d None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:13.339754 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-d1889c75-c55f-4649-8525-4fc9e8a8ab5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:13.450098 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1013/2036] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:13.494301 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e6c85-1cf3-4ff6-8fae-3a300b8ead56 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:13.498707 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-4f2e6c85-1cf3-4ff6-8fae-3a300b8ead56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:13.673897 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e6c85-1cf3-4ff6-8fae-3a300b8ead56 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:13.680518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58fee6-45cc-49e5-ab35-ab54ec045bf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:13.683263 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58fee6-45cc-49e5-ab35-ab54ec045bf4 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:13.684868 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58fee6-45cc-49e5-ab35-ab54ec045bf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:13.685878 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58fee6-45cc-49e5-ab35-ab54ec045bf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:13.716994 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58fee6-45cc-49e5-ab35-ab54ec045bf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:13.719231 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58fee6-45cc-49e5-ab35-ab54ec045bf4 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:13.735611 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1024/2037] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:14.262857 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1889c75-c55f-4649-8525-4fc9e8a8ab5d None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:14.265542 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-d1889c75-c55f-4649-8525-4fc9e8a8ab5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:14.328353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1889c75-c55f-4649-8525-4fc9e8a8ab5d None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:14.334736 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94800a59-e756-441a-9df5-d4f463ab6ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:14.336198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94800a59-e756-441a-9df5-d4f463ab6ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:14.336707 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94800a59-e756-441a-9df5-d4f463ab6ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:14.337306 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94800a59-e756-441a-9df5-d4f463ab6ae3 admin admin] PATH_INFO: `/v3/projects/c84f751c309f412c95afd03050c8f2e0` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:14.338808 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94800a59-e756-441a-9df5-d4f463ab6ae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c84f751c309f412c95afd03050c8f2e0)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:14.343780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94800a59-e756-441a-9df5-d4f463ab6ae3 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:14.450437 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-94800a59-e756-441a-9df5-d4f463ab6ae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c84f751c309f412c95afd03050c8f2e0', 'request_id': 'req-94800a59-e756-441a-9df5-d4f463ab6ae3'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:14.470872 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-94800a59-e756-441a-9df5-d4f463ab6ae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c84f751c309f412c95afd03050c8f2e0', 'request_id': 'req-94800a59-e756-441a-9df5-d4f463ab6ae3'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:14.480893 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-94800a59-e756-441a-9df5-d4f463ab6ae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c84f751c309f412c95afd03050c8f2e0', 'request_id': 'req-94800a59-e756-441a-9df5-d4f463ab6ae3'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:14.501437 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-94800a59-e756-441a-9df5-d4f463ab6ae3 admin admin] The token cache is being invalidate because project c84f751c309f412c95afd03050c8f2e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:14.502072 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-94800a59-e756-441a-9df5-d4f463ab6ae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:14.503357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-94800a59-e756-441a-9df5-d4f463ab6ae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:14.507630 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1014/2038] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:14 2022] DELETE /identity/v3/projects/c84f751c309f412c95afd03050c8f2e0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:14.512446 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b198191-c570-4c78-afa9-6e5e5b8e6f0c None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:14.512968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b198191-c570-4c78-afa9-6e5e5b8e6f0c None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:14.513043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b198191-c570-4c78-afa9-6e5e5b8e6f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:14.537944 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-4b198191-c570-4c78-afa9-6e5e5b8e6f0c None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:14.539754 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-4b198191-c570-4c78-afa9-6e5e5b8e6f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:14.622135 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:14.650078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1025/2039] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:14.656745 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d5c34-2113-4652-b602-a0d1a00b22cc None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:14.657172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d5c34-2113-4652-b602-a0d1a00b22cc None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:14.657566 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d5c34-2113-4652-b602-a0d1a00b22cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:14.685174 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-629d5c34-2113-4652-b602-a0d1a00b22cc None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:14.686662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-629d5c34-2113-4652-b602-a0d1a00b22cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:14.698544 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1015/2040] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:14.702484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b198191-c570-4c78-afa9-6e5e5b8e6f0c None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:14.716192 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b198191-c570-4c78-afa9-6e5e5b8e6f0c None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:14.722925 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948437f7-6e57-4eda-95ef-dec42f39ad81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:14.724682 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948437f7-6e57-4eda-95ef-dec42f39ad81 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:14.725125 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948437f7-6e57-4eda-95ef-dec42f39ad81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:14.725575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948437f7-6e57-4eda-95ef-dec42f39ad81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:14.726636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948437f7-6e57-4eda-95ef-dec42f39ad81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:05:14.727104 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948437f7-6e57-4eda-95ef-dec42f39ad81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:14.729695 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948437f7-6e57-4eda-95ef-dec42f39ad81 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:14.747687 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1026/2041] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 02:05:14.753744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d5c34-2113-4652-b602-a0d1a00b22cc None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:14.765962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d5c34-2113-4652-b602-a0d1a00b22cc None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:14.773434 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c932be-f2ee-402c-9765-698adb8d1e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:14.774294 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c932be-f2ee-402c-9765-698adb8d1e9a admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:14.774804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c932be-f2ee-402c-9765-698adb8d1e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:14.775182 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c932be-f2ee-402c-9765-698adb8d1e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:14.776273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c932be-f2ee-402c-9765-698adb8d1e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:14.778496 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c932be-f2ee-402c-9765-698adb8d1e9a admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:14.801946 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:14.826742 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1016/2042] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:14 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:14.831341 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948437f7-6e57-4eda-95ef-dec42f39ad81 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:14.859391 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948437f7-6e57-4eda-95ef-dec42f39ad81 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:15.029462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378aa8d-b31c-4148-b080-f7c00f67e68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:15.030359 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378aa8d-b31c-4148-b080-f7c00f67e68c admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:15.030614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378aa8d-b31c-4148-b080-f7c00f67e68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:15.030893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378aa8d-b31c-4148-b080-f7c00f67e68c admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:15.036721 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378aa8d-b31c-4148-b080-f7c00f67e68c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:15.046364 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378aa8d-b31c-4148-b080-f7c00f67e68c admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:15.093368 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1027/2043] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:14 2022] POST /identity/v3/users => generated 287 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:15.096726 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c932be-f2ee-402c-9765-698adb8d1e9a admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:15.115450 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c932be-f2ee-402c-9765-698adb8d1e9a admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:15.125115 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c867f6b-ce1c-4f08-a520-d9316c8b6c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:15.126343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c867f6b-ce1c-4f08-a520-d9316c8b6c23 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:15.126744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c867f6b-ce1c-4f08-a520-d9316c8b6c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:15.127113 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c867f6b-ce1c-4f08-a520-d9316c8b6c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:15.128131 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c867f6b-ce1c-4f08-a520-d9316c8b6c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:15.130259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c867f6b-ce1c-4f08-a520-d9316c8b6c23 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:15.145682 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1017/2044] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:15.149749 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378aa8d-b31c-4148-b080-f7c00f67e68c admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:15.167467 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378aa8d-b31c-4148-b080-f7c00f67e68c admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:15.181443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8409619-2124-49e8-a00d-bf056337fd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:15.182142 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8409619-2124-49e8-a00d-bf056337fd39 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:15.182427 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8409619-2124-49e8-a00d-bf056337fd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:15.182705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8409619-2124-49e8-a00d-bf056337fd39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:15.184232 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8409619-2124-49e8-a00d-bf056337fd39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:15.186309 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8409619-2124-49e8-a00d-bf056337fd39 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:15.208028 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1028/2045] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:15.208630 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c867f6b-ce1c-4f08-a520-d9316c8b6c23 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:15.219860 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c867f6b-ce1c-4f08-a520-d9316c8b6c23 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:15.225127 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3cd2e-0124-404b-8630-fa874450b08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:15.226066 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3cd2e-0124-404b-8630-fa874450b08d admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:15.226349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3cd2e-0124-404b-8630-fa874450b08d admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:15.226625 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3cd2e-0124-404b-8630-fa874450b08d admin admin] PATH_INFO: `/v3/projects/b5aa5312af4d4157bcd1b8a1d13004ce/users/61814665bcc24f1c9eb4e17a7a67629b/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:15.247307 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3cd2e-0124-404b-8630-fa874450b08d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5aa5312af4d4157bcd1b8a1d13004ce, user_id=61814665bcc24f1c9eb4e17a7a67629b, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:15.250081 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3cd2e-0124-404b-8630-fa874450b08d admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:15.270818 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1018/2046] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:15 2022] PUT /identity/v3/projects/b5aa5312af4d4157bcd1b8a1d13004ce/users/61814665bcc24f1c9eb4e17a7a67629b/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:05:15.283149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736f3c3-9795-41bd-b64f-4204ac19f95f None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:15.283542 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736f3c3-9795-41bd-b64f-4204ac19f95f None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:15.284002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736f3c3-9795-41bd-b64f-4204ac19f95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:15.318592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-8736f3c3-9795-41bd-b64f-4204ac19f95f None None] MFA Rules not processed for user `61814665bcc24f1c9eb4e17a7a67629b`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:15.320691 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-8736f3c3-9795-41bd-b64f-4204ac19f95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:15.425959 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1029/2047] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:15.438905 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3cd2e-0124-404b-8630-fa874450b08d admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:15.441796 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-9ec3cd2e-0124-404b-8630-fa874450b08d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:15.549563 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3cd2e-0124-404b-8630-fa874450b08d admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:15.556608 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f68358-bd48-4e13-a90a-47af77fb4426 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:15.557557 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f68358-bd48-4e13-a90a-47af77fb4426 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:15.557997 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f68358-bd48-4e13-a90a-47af77fb4426 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:15.558388 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f68358-bd48-4e13-a90a-47af77fb4426 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:15.575302 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f68358-bd48-4e13-a90a-47af77fb4426 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:15.578452 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f68358-bd48-4e13-a90a-47af77fb4426 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:15.593971 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1019/2048] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:15.618103 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736f3c3-9795-41bd-b64f-4204ac19f95f None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:15.716910 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:15.746690 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736f3c3-9795-41bd-b64f-4204ac19f95f None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:15.752373 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3913b4-903a-400a-858b-5ab7b9eb6778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:15.753518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3913b4-903a-400a-858b-5ab7b9eb6778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:15.753800 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3913b4-903a-400a-858b-5ab7b9eb6778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:15.754071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3913b4-903a-400a-858b-5ab7b9eb6778 admin admin] PATH_INFO: `/v3/users/61814665bcc24f1c9eb4e17a7a67629b` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:15.755654 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3913b4-903a-400a-858b-5ab7b9eb6778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61814665bcc24f1c9eb4e17a7a67629b)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:15.757656 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3913b4-903a-400a-858b-5ab7b9eb6778 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:15.818669 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-be3913b4-903a-400a-858b-5ab7b9eb6778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61814665bcc24f1c9eb4e17a7a67629b'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:15.826988 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-be3913b4-903a-400a-858b-5ab7b9eb6778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61814665bcc24f1c9eb4e17a7a67629b'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:15.827725 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-be3913b4-903a-400a-858b-5ab7b9eb6778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61814665bcc24f1c9eb4e17a7a67629b'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:15.828909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-be3913b4-903a-400a-858b-5ab7b9eb6778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61814665bcc24f1c9eb4e17a7a67629b'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:15.844407 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-be3913b4-903a-400a-858b-5ab7b9eb6778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61814665bcc24f1c9eb4e17a7a67629b'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:15.868050 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1030/2049] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:15 2022] DELETE /identity/v3/users/61814665bcc24f1c9eb4e17a7a67629b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:15.874425 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86071c-b029-4b73-896d-d54482e9a71e None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:15.874917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86071c-b029-4b73-896d-d54482e9a71e None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:15.875662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86071c-b029-4b73-896d-d54482e9a71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:15.900907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-7d86071c-b029-4b73-896d-d54482e9a71e None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:15.903063 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-7d86071c-b029-4b73-896d-d54482e9a71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:16.003116 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1020/2050] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:16.017789 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3913b4-903a-400a-858b-5ab7b9eb6778 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:16.019903 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-be3913b4-903a-400a-858b-5ab7b9eb6778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:16.102177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3913b4-903a-400a-858b-5ab7b9eb6778 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:16.108561 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604a99c-d766-4cc6-b97a-759ca9c03fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:16.109306 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604a99c-d766-4cc6-b97a-759ca9c03fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:16.109674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604a99c-d766-4cc6-b97a-759ca9c03fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:16.110013 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604a99c-d766-4cc6-b97a-759ca9c03fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:16.126130 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604a99c-d766-4cc6-b97a-759ca9c03fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:16.127785 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604a99c-d766-4cc6-b97a-759ca9c03fb0 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:16.144350 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1031/2051] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:16.156499 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86071c-b029-4b73-896d-d54482e9a71e None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:16.158103 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-7d86071c-b029-4b73-896d-d54482e9a71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:16.230509 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86071c-b029-4b73-896d-d54482e9a71e None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:16.234339 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8296149-be65-45f1-b73f-3b9816984ef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:16.235019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8296149-be65-45f1-b73f-3b9816984ef5 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:16.235305 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8296149-be65-45f1-b73f-3b9816984ef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:16.235617 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8296149-be65-45f1-b73f-3b9816984ef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:16.237476 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-b8296149-be65-45f1-b73f-3b9816984ef5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:16.273650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:16.351762 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8296149-be65-45f1-b73f-3b9816984ef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:16.354567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8296149-be65-45f1-b73f-3b9816984ef5 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:16.375888 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1021/2052] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:16.658760 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604a99c-d766-4cc6-b97a-759ca9c03fb0 service neutron] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:16.660354 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-f604a99c-d766-4cc6-b97a-759ca9c03fb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:16.682269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604a99c-d766-4cc6-b97a-759ca9c03fb0 service neutron] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:16.690247 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621711a2-546f-438e-b405-60c8e01e5692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:16.691182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621711a2-546f-438e-b405-60c8e01e5692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:16.691736 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621711a2-546f-438e-b405-60c8e01e5692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:16.692096 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621711a2-546f-438e-b405-60c8e01e5692 admin admin] PATH_INFO: `/v3/projects/b5aa5312af4d4157bcd1b8a1d13004ce` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:16.693843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621711a2-546f-438e-b405-60c8e01e5692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5aa5312af4d4157bcd1b8a1d13004ce)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:16.696051 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621711a2-546f-438e-b405-60c8e01e5692 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:16.770709 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-621711a2-546f-438e-b405-60c8e01e5692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5aa5312af4d4157bcd1b8a1d13004ce', 'request_id': 'req-621711a2-546f-438e-b405-60c8e01e5692'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:16.778430 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-621711a2-546f-438e-b405-60c8e01e5692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5aa5312af4d4157bcd1b8a1d13004ce', 'request_id': 'req-621711a2-546f-438e-b405-60c8e01e5692'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:16.789125 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-621711a2-546f-438e-b405-60c8e01e5692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5aa5312af4d4157bcd1b8a1d13004ce', 'request_id': 'req-621711a2-546f-438e-b405-60c8e01e5692'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:16.790676 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:16.809927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-621711a2-546f-438e-b405-60c8e01e5692 admin admin] The token cache is being invalidate because project b5aa5312af4d4157bcd1b8a1d13004ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:16.810232 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-621711a2-546f-438e-b405-60c8e01e5692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:16.811139 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-621711a2-546f-438e-b405-60c8e01e5692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:16.816482 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1032/2053] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:16 2022] DELETE /identity/v3/projects/b5aa5312af4d4157bcd1b8a1d13004ce => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:16.819706 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093c79e-d447-468a-b774-b479f505fd75 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:16.819955 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093c79e-d447-468a-b774-b479f505fd75 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:16.820240 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093c79e-d447-468a-b774-b479f505fd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:16.859361 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-1093c79e-d447-468a-b774-b479f505fd75 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:16.860744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-1093c79e-d447-468a-b774-b479f505fd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:16.940924 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1022/2054] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:16.949121 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11669b5d-9ef0-4df2-8210-e764951f3cce None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:16.949309 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11669b5d-9ef0-4df2-8210-e764951f3cce None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:16.949582 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11669b5d-9ef0-4df2-8210-e764951f3cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:16.972246 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-11669b5d-9ef0-4df2-8210-e764951f3cce None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:16.973728 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-11669b5d-9ef0-4df2-8210-e764951f3cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:16.985069 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1033/2055] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:16.989256 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093c79e-d447-468a-b774-b479f505fd75 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:17.001021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093c79e-d447-468a-b774-b479f505fd75 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:17.006309 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27152ca6-716a-42cd-8d29-637f7d27ad0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:17.007067 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27152ca6-716a-42cd-8d29-637f7d27ad0e admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:17.007466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27152ca6-716a-42cd-8d29-637f7d27ad0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:17.008104 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27152ca6-716a-42cd-8d29-637f7d27ad0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:17.008665 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27152ca6-716a-42cd-8d29-637f7d27ad0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:05:17.009044 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27152ca6-716a-42cd-8d29-637f7d27ad0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:17.010872 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27152ca6-716a-42cd-8d29-637f7d27ad0e admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:17.043256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11669b5d-9ef0-4df2-8210-e764951f3cce None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:17.045091 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1023/2056] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:05:17.064579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11669b5d-9ef0-4df2-8210-e764951f3cce None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:17.080350 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a9ad5-f2bc-49dd-87f3-0d882321c57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:17.081160 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a9ad5-f2bc-49dd-87f3-0d882321c57d admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:17.081542 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a9ad5-f2bc-49dd-87f3-0d882321c57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:17.081917 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a9ad5-f2bc-49dd-87f3-0d882321c57d admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:17.082738 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a9ad5-f2bc-49dd-87f3-0d882321c57d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:17.100432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a9ad5-f2bc-49dd-87f3-0d882321c57d admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:17.153743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1034/2057] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:17 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:17.159047 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27152ca6-716a-42cd-8d29-637f7d27ad0e admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:17.171071 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27152ca6-716a-42cd-8d29-637f7d27ad0e admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:17.252311 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414e065-25b0-4a82-a6e3-13053d4fa4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:17.253741 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414e065-25b0-4a82-a6e3-13053d4fa4f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:17.254176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414e065-25b0-4a82-a6e3-13053d4fa4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:17.254819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414e065-25b0-4a82-a6e3-13053d4fa4f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:17.255914 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414e065-25b0-4a82-a6e3-13053d4fa4f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:17.257879 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414e065-25b0-4a82-a6e3-13053d4fa4f5 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:17.283519 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1024/2058] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:17 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:17.287947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a9ad5-f2bc-49dd-87f3-0d882321c57d admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:17.299447 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a9ad5-f2bc-49dd-87f3-0d882321c57d admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:17.309701 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eba38c-a54c-4516-918c-4416037eaa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:17.310400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eba38c-a54c-4516-918c-4416037eaa16 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:17.310681 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eba38c-a54c-4516-918c-4416037eaa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:17.311295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eba38c-a54c-4516-918c-4416037eaa16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:17.311787 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eba38c-a54c-4516-918c-4416037eaa16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:17.313420 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eba38c-a54c-4516-918c-4416037eaa16 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:17.327453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1035/2059] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:05:17.329794 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414e065-25b0-4a82-a6e3-13053d4fa4f5 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:17.341860 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414e065-25b0-4a82-a6e3-13053d4fa4f5 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:17.349443 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308e451-5435-453d-981a-652ef61e3e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:17.350371 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308e451-5435-453d-981a-652ef61e3e13 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:17.350905 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308e451-5435-453d-981a-652ef61e3e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:17.351277 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308e451-5435-453d-981a-652ef61e3e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:17.352215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308e451-5435-453d-981a-652ef61e3e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:17.354094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308e451-5435-453d-981a-652ef61e3e13 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:17.366688 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1025/2060] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:17.369999 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eba38c-a54c-4516-918c-4416037eaa16 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:17.384022 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eba38c-a54c-4516-918c-4416037eaa16 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:17.392858 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ef484-2e02-4222-aa89-74e0980fa6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:17.393901 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ef484-2e02-4222-aa89-74e0980fa6c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:17.394277 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ef484-2e02-4222-aa89-74e0980fa6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:17.394646 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ef484-2e02-4222-aa89-74e0980fa6c4 admin admin] PATH_INFO: `/v3/projects/71271125dcf94b47b76f37e2def8d448/users/307f1779c55045d196597f81d1cc294c/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:17.413177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ef484-2e02-4222-aa89-74e0980fa6c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71271125dcf94b47b76f37e2def8d448, user_id=307f1779c55045d196597f81d1cc294c, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:17.416725 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ef484-2e02-4222-aa89-74e0980fa6c4 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:17.445836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1036/2061] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:17 2022] PUT /identity/v3/projects/71271125dcf94b47b76f37e2def8d448/users/307f1779c55045d196597f81d1cc294c/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:17.457308 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208bc44-d2b6-4e2f-9250-95983aeff192 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:17.458116 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208bc44-d2b6-4e2f-9250-95983aeff192 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:17.458741 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208bc44-d2b6-4e2f-9250-95983aeff192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:17.492622 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-5208bc44-d2b6-4e2f-9250-95983aeff192 None None] MFA Rules not processed for user `307f1779c55045d196597f81d1cc294c`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:17.494247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-5208bc44-d2b6-4e2f-9250-95983aeff192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:17.505072 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:17.580985 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1026/2062] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:17.592244 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ef484-2e02-4222-aa89-74e0980fa6c4 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:17.594218 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-c05ef484-2e02-4222-aa89-74e0980fa6c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:17.662082 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ef484-2e02-4222-aa89-74e0980fa6c4 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:17.666503 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c173b-d35a-4f26-a2b5-597921ce6a69 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46aba36939c549278bcdee7a04511e27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:17.667292 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c173b-d35a-4f26-a2b5-597921ce6a69 service glance] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:17.667664 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c173b-d35a-4f26-a2b5-597921ce6a69 service glance] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:17.667983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c173b-d35a-4f26-a2b5-597921ce6a69 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:17.680236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c173b-d35a-4f26-a2b5-597921ce6a69 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:17.681718 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c173b-d35a-4f26-a2b5-597921ce6a69 service glance] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:17.693165 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1037/2063] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:05:19.044400 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f5545-8367-408a-adee-08fc14a66cfe None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:19.044919 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f5545-8367-408a-adee-08fc14a66cfe None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:19.045039 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f5545-8367-408a-adee-08fc14a66cfe None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:19.046365 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1027/2064] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 23 02:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 02:05:19.057638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230186f2-bdf0-4451-a8c0-f19023f81234 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:19.058137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230186f2-bdf0-4451-a8c0-f19023f81234 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:19.058229 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230186f2-bdf0-4451-a8c0-f19023f81234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:19.080521 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-230186f2-bdf0-4451-a8c0-f19023f81234 None None] MFA Rules not processed for user `9756f5b9de8a4f23b365a96d309d86ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:19.081765 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-230186f2-bdf0-4451-a8c0-f19023f81234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:19.112715 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f5545-8367-408a-adee-08fc14a66cfe None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:19.115777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-3f3f5545-8367-408a-adee-08fc14a66cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:19.169277 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1038/2065] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 23 02:05:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:19.183725 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230186f2-bdf0-4451-a8c0-f19023f81234 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:19.185563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-230186f2-bdf0-4451-a8c0-f19023f81234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:19.199592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230186f2-bdf0-4451-a8c0-f19023f81234 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:19.203760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f5545-8367-408a-adee-08fc14a66cfe None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:19.206688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2a0c9-c2cc-4303-bda9-da08d8790500 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9756f5b9de8a4f23b365a96d309d86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:19.207372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2a0c9-c2cc-4303-bda9-da08d8790500 service placement] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:19.207912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2a0c9-c2cc-4303-bda9-da08d8790500 service placement] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:19.209044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2a0c9-c2cc-4303-bda9-da08d8790500 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:19.209731 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03916a7-2e7d-4bd2-8f83-143165df1edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:19.210724 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03916a7-2e7d-4bd2-8f83-143165df1edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:19.211074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03916a7-2e7d-4bd2-8f83-143165df1edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:19.211505 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03916a7-2e7d-4bd2-8f83-143165df1edc admin admin] PATH_INFO: `/v3/users/976a75d631554ef2974c6ee763015635` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:19.214245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03916a7-2e7d-4bd2-8f83-143165df1edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=976a75d631554ef2974c6ee763015635)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:19.216393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03916a7-2e7d-4bd2-8f83-143165df1edc admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:19.224840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2a0c9-c2cc-4303-bda9-da08d8790500 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:19.232503 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2a0c9-c2cc-4303-bda9-da08d8790500 service placement] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:19.259814 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1039/2066] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:05:19.313611 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e03916a7-2e7d-4bd2-8f83-143165df1edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '976a75d631554ef2974c6ee763015635'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:19.337816 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e03916a7-2e7d-4bd2-8f83-143165df1edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '976a75d631554ef2974c6ee763015635'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:19.347771 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e03916a7-2e7d-4bd2-8f83-143165df1edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '976a75d631554ef2974c6ee763015635'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:19.349696 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e03916a7-2e7d-4bd2-8f83-143165df1edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '976a75d631554ef2974c6ee763015635'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:19.370383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e03916a7-2e7d-4bd2-8f83-143165df1edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '976a75d631554ef2974c6ee763015635'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:19.379195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1028/2067] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:19 2022] DELETE /identity/v3/users/976a75d631554ef2974c6ee763015635 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:19.617830 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2a0c9-c2cc-4303-bda9-da08d8790500 service placement] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:19.653694 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2a0c9-c2cc-4303-bda9-da08d8790500 service placement] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:19.669041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:19.744182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e755f-49c5-4e0f-9758-1de07241ad54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:19.745219 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e755f-49c5-4e0f-9758-1de07241ad54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:19.745498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e755f-49c5-4e0f-9758-1de07241ad54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:19.745769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e755f-49c5-4e0f-9758-1de07241ad54 admin admin] PATH_INFO: `/v3/projects/5abd2e32df72475caa91467e2f131d50` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:19.747215 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e755f-49c5-4e0f-9758-1de07241ad54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5abd2e32df72475caa91467e2f131d50)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:19.749220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e755f-49c5-4e0f-9758-1de07241ad54 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:19.813237 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-5e3e755f-49c5-4e0f-9758-1de07241ad54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5abd2e32df72475caa91467e2f131d50', 'request_id': 'req-5e3e755f-49c5-4e0f-9758-1de07241ad54'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:19.820628 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-5e3e755f-49c5-4e0f-9758-1de07241ad54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5abd2e32df72475caa91467e2f131d50', 'request_id': 'req-5e3e755f-49c5-4e0f-9758-1de07241ad54'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:19.831346 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-5e3e755f-49c5-4e0f-9758-1de07241ad54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5abd2e32df72475caa91467e2f131d50', 'request_id': 'req-5e3e755f-49c5-4e0f-9758-1de07241ad54'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:19.843228 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-5e3e755f-49c5-4e0f-9758-1de07241ad54 admin admin] The token cache is being invalidate because project 5abd2e32df72475caa91467e2f131d50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:19.843647 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-5e3e755f-49c5-4e0f-9758-1de07241ad54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:19.844332 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-5e3e755f-49c5-4e0f-9758-1de07241ad54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:19.845938 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1040/2068] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:19 2022] DELETE /identity/v3/projects/5abd2e32df72475caa91467e2f131d50 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:19.851067 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4d83f-05cc-4016-92f4-c39e6eb6053f None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:19.851397 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4d83f-05cc-4016-92f4-c39e6eb6053f None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:19.851705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4d83f-05cc-4016-92f4-c39e6eb6053f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:19.869687 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-53e4d83f-05cc-4016-92f4-c39e6eb6053f None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:19.870885 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-53e4d83f-05cc-4016-92f4-c39e6eb6053f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:19.900063 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:19.941739 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1029/2069] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:19.949487 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8334e-306f-4170-8bf6-f316ecea8a31 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:19.949774 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8334e-306f-4170-8bf6-f316ecea8a31 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:19.950075 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8334e-306f-4170-8bf6-f316ecea8a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:19.969058 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-fcf8334e-306f-4170-8bf6-f316ecea8a31 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:19.970323 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-fcf8334e-306f-4170-8bf6-f316ecea8a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:19.978787 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1041/2070] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:05:19.983562 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4d83f-05cc-4016-92f4-c39e6eb6053f None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:19.994202 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4d83f-05cc-4016-92f4-c39e6eb6053f None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:19.999260 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86ffd2-068e-424a-bbe8-1945cd2b77f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:19.999973 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86ffd2-068e-424a-bbe8-1945cd2b77f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:20.000254 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86ffd2-068e-424a-bbe8-1945cd2b77f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:20.000522 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86ffd2-068e-424a-bbe8-1945cd2b77f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:20.001257 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86ffd2-068e-424a-bbe8-1945cd2b77f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:05:20.001564 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86ffd2-068e-424a-bbe8-1945cd2b77f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:20.003175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86ffd2-068e-424a-bbe8-1945cd2b77f7 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:20.019130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1030/2071] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:05:20.021111 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8334e-306f-4170-8bf6-f316ecea8a31 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:20.035362 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8334e-306f-4170-8bf6-f316ecea8a31 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:20.039971 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f06c58-14b4-48cc-8c9c-8c7839ae5170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:20.040667 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06c58-14b4-48cc-8c9c-8c7839ae5170 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:20.040949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06c58-14b4-48cc-8c9c-8c7839ae5170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:20.041219 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06c58-14b4-48cc-8c9c-8c7839ae5170 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:20.041943 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f06c58-14b4-48cc-8c9c-8c7839ae5170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:20.043958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f06c58-14b4-48cc-8c9c-8c7839ae5170 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:20.071994 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1042/2072] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:20 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:05:20.076074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86ffd2-068e-424a-bbe8-1945cd2b77f7 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:20.086860 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86ffd2-068e-424a-bbe8-1945cd2b77f7 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:20.147778 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4a804-477d-4fe1-9bc5-4b9bbfc0c8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:20.148464 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4a804-477d-4fe1-9bc5-4b9bbfc0c8b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:20.148749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4a804-477d-4fe1-9bc5-4b9bbfc0c8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:20.149025 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4a804-477d-4fe1-9bc5-4b9bbfc0c8b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:20.149770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4a804-477d-4fe1-9bc5-4b9bbfc0c8b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:20.151799 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4a804-477d-4fe1-9bc5-4b9bbfc0c8b1 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:20.173880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1031/2073] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:20 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:05:20.178253 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f06c58-14b4-48cc-8c9c-8c7839ae5170 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:20.189044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f06c58-14b4-48cc-8c9c-8c7839ae5170 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:20.193811 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f832f7-9253-4ea0-9b86-d7ad7f612e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:20.194482 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f832f7-9253-4ea0-9b86-d7ad7f612e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:20.194763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f832f7-9253-4ea0-9b86-d7ad7f612e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:20.195035 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f832f7-9253-4ea0-9b86-d7ad7f612e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:20.195806 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f832f7-9253-4ea0-9b86-d7ad7f612e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:20.197422 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f832f7-9253-4ea0-9b86-d7ad7f612e10 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:20.208150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1043/2074] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:20.212261 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4a804-477d-4fe1-9bc5-4b9bbfc0c8b1 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:20.222226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4a804-477d-4fe1-9bc5-4b9bbfc0c8b1 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:20.227596 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c7d16-da44-4097-a22c-2ecc93d691b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:20.228284 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c7d16-da44-4097-a22c-2ecc93d691b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:20.228624 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c7d16-da44-4097-a22c-2ecc93d691b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:20.228869 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c7d16-da44-4097-a22c-2ecc93d691b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:20.229595 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c7d16-da44-4097-a22c-2ecc93d691b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:20.231237 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c7d16-da44-4097-a22c-2ecc93d691b9 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:20.243367 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1032/2075] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:20.246517 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f832f7-9253-4ea0-9b86-d7ad7f612e10 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:20.257301 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f832f7-9253-4ea0-9b86-d7ad7f612e10 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:20.262128 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a496d5-f32f-4714-905c-c1c0c12b58b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:20.263019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a496d5-f32f-4714-905c-c1c0c12b58b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:20.263299 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a496d5-f32f-4714-905c-c1c0c12b58b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:20.263735 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a496d5-f32f-4714-905c-c1c0c12b58b8 admin admin] PATH_INFO: `/v3/projects/94666adfe68f486e819867cd63a8b946/users/83c79e6503a44f7b8a8d05376bb9fd52/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:20.278934 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a496d5-f32f-4714-905c-c1c0c12b58b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94666adfe68f486e819867cd63a8b946, user_id=83c79e6503a44f7b8a8d05376bb9fd52, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:20.281666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a496d5-f32f-4714-905c-c1c0c12b58b8 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:20.296836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1044/2076] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:20 2022] PUT /identity/v3/projects/94666adfe68f486e819867cd63a8b946/users/83c79e6503a44f7b8a8d05376bb9fd52/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:20.307777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d26128-a68e-411d-8682-4c1e5174e081 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:20.308071 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d26128-a68e-411d-8682-4c1e5174e081 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:20.308396 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d26128-a68e-411d-8682-4c1e5174e081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:20.336340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-b1d26128-a68e-411d-8682-4c1e5174e081 None None] MFA Rules not processed for user `83c79e6503a44f7b8a8d05376bb9fd52`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:20.337556 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-b1d26128-a68e-411d-8682-4c1e5174e081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:20.407320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1033/2077] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:20.412019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a496d5-f32f-4714-905c-c1c0c12b58b8 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:20.458684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:20.483798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a496d5-f32f-4714-905c-c1c0c12b58b8 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:20.488836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366116b-dfa0-4472-9142-dae4e175239e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:20.489599 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366116b-dfa0-4472-9142-dae4e175239e admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:20.489914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366116b-dfa0-4472-9142-dae4e175239e admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:20.490188 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366116b-dfa0-4472-9142-dae4e175239e admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:20.490929 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366116b-dfa0-4472-9142-dae4e175239e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:20.493284 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366116b-dfa0-4472-9142-dae4e175239e admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:20.521932 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1045/2078] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:20 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:20.525506 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d26128-a68e-411d-8682-4c1e5174e081 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:20.538792 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d26128-a68e-411d-8682-4c1e5174e081 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:20.562260 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:20.605375 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1316b-fe61-4c2e-bf7d-ff8f42e2870f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:20.606080 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1316b-fe61-4c2e-bf7d-ff8f42e2870f admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:20.606359 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1316b-fe61-4c2e-bf7d-ff8f42e2870f admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:20.606631 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1316b-fe61-4c2e-bf7d-ff8f42e2870f admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:20.607363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1316b-fe61-4c2e-bf7d-ff8f42e2870f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:20.609350 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1316b-fe61-4c2e-bf7d-ff8f42e2870f admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:20.629697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1034/2079] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:20 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:20.633798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366116b-dfa0-4472-9142-dae4e175239e admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:20.644405 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366116b-dfa0-4472-9142-dae4e175239e admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:20.649954 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efc230-abe7-4def-9933-383f1abbf0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:20.650630 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efc230-abe7-4def-9933-383f1abbf0ce admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:20.650938 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efc230-abe7-4def-9933-383f1abbf0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:20.651207 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efc230-abe7-4def-9933-383f1abbf0ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:20.652000 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efc230-abe7-4def-9933-383f1abbf0ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:20.653619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efc230-abe7-4def-9933-383f1abbf0ce admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:20.664902 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1046/2080] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:20.669211 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1316b-fe61-4c2e-bf7d-ff8f42e2870f admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:20.680306 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1316b-fe61-4c2e-bf7d-ff8f42e2870f admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:20.688600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3da3c-822d-452e-a82b-e5991c5c3c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:20.688600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3da3c-822d-452e-a82b-e5991c5c3c4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:20.688600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3da3c-822d-452e-a82b-e5991c5c3c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:20.688953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3da3c-822d-452e-a82b-e5991c5c3c4d admin admin] PATH_INFO: `/v3/projects/a35a2323bd824db684489aaaf09f9ca0/users/da0e5193abc24256961d60faf937d450/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:20.711066 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3da3c-822d-452e-a82b-e5991c5c3c4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a35a2323bd824db684489aaaf09f9ca0, user_id=da0e5193abc24256961d60faf937d450, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:20.711066 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3da3c-822d-452e-a82b-e5991c5c3c4d admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:20.725324 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1035/2081] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:20 2022] PUT /identity/v3/projects/a35a2323bd824db684489aaaf09f9ca0/users/da0e5193abc24256961d60faf937d450/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:20.729539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efc230-abe7-4def-9933-383f1abbf0ce admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:20.739853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efc230-abe7-4def-9933-383f1abbf0ce admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:20.810996 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b44cfc-3c81-45a7-8600-b71e00a2e7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:20.811701 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b44cfc-3c81-45a7-8600-b71e00a2e7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:20.811985 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b44cfc-3c81-45a7-8600-b71e00a2e7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:20.812262 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b44cfc-3c81-45a7-8600-b71e00a2e7a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:20.813014 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b44cfc-3c81-45a7-8600-b71e00a2e7a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:20.815804 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b44cfc-3c81-45a7-8600-b71e00a2e7a4 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:20.830033 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1047/2082] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:20.834492 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3da3c-822d-452e-a82b-e5991c5c3c4d admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:20.846349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3da3c-822d-452e-a82b-e5991c5c3c4d admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:20.851811 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cabdb5-cac0-4d7d-b2ed-3510a1ecf1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:20.852971 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cabdb5-cac0-4d7d-b2ed-3510a1ecf1cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:20.853366 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cabdb5-cac0-4d7d-b2ed-3510a1ecf1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:20.853794 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cabdb5-cac0-4d7d-b2ed-3510a1ecf1cc admin admin] PATH_INFO: `/v3/projects/a35a2323bd824db684489aaaf09f9ca0/users/da0e5193abc24256961d60faf937d450/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:20.856352 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cabdb5-cac0-4d7d-b2ed-3510a1ecf1cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a35a2323bd824db684489aaaf09f9ca0, user_id=da0e5193abc24256961d60faf937d450, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:20.862534 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cabdb5-cac0-4d7d-b2ed-3510a1ecf1cc admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:20.876492 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1036/2083] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:20 2022] PUT /identity/v3/projects/a35a2323bd824db684489aaaf09f9ca0/users/da0e5193abc24256961d60faf937d450/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:20.888043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4331c-8987-4610-b87a-dc7008ef726b None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:20.888405 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4331c-8987-4610-b87a-dc7008ef726b None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:20.888751 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4331c-8987-4610-b87a-dc7008ef726b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:20.920218 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-d4a4331c-8987-4610-b87a-dc7008ef726b None None] MFA Rules not processed for user `da0e5193abc24256961d60faf937d450`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:20.921436 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-d4a4331c-8987-4610-b87a-dc7008ef726b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:20.995978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1048/2084] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:21.007442 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cabdb5-cac0-4d7d-b2ed-3510a1ecf1cc admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:21.009486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-57cabdb5-cac0-4d7d-b2ed-3510a1ecf1cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:21.072654 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cabdb5-cac0-4d7d-b2ed-3510a1ecf1cc admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:21.076600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66452f-e713-48e3-8104-e102e273cb25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:21.077355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66452f-e713-48e3-8104-e102e273cb25 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:21.077525 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66452f-e713-48e3-8104-e102e273cb25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:21.077800 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66452f-e713-48e3-8104-e102e273cb25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:21.087246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66452f-e713-48e3-8104-e102e273cb25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:21.088748 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66452f-e713-48e3-8104-e102e273cb25 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:21.098839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1037/2085] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:21.512994 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4331c-8987-4610-b87a-dc7008ef726b None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:21.556525 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:21.594667 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4331c-8987-4610-b87a-dc7008ef726b None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:21.599986 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22963ea5-db70-40fd-9a4d-96a6deec4096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:21.600871 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22963ea5-db70-40fd-9a4d-96a6deec4096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:21.601147 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22963ea5-db70-40fd-9a4d-96a6deec4096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:21.602824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22963ea5-db70-40fd-9a4d-96a6deec4096 admin admin] PATH_INFO: `/v3/users/83c79e6503a44f7b8a8d05376bb9fd52` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:21.602824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22963ea5-db70-40fd-9a4d-96a6deec4096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83c79e6503a44f7b8a8d05376bb9fd52)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:21.604645 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22963ea5-db70-40fd-9a4d-96a6deec4096 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:21.655375 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-22963ea5-db70-40fd-9a4d-96a6deec4096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83c79e6503a44f7b8a8d05376bb9fd52'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:21.662314 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-22963ea5-db70-40fd-9a4d-96a6deec4096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83c79e6503a44f7b8a8d05376bb9fd52'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:21.663033 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-22963ea5-db70-40fd-9a4d-96a6deec4096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83c79e6503a44f7b8a8d05376bb9fd52'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:21.663675 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-22963ea5-db70-40fd-9a4d-96a6deec4096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83c79e6503a44f7b8a8d05376bb9fd52'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:21.676210 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-22963ea5-db70-40fd-9a4d-96a6deec4096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83c79e6503a44f7b8a8d05376bb9fd52'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:21.695240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1049/2086] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:21 2022] DELETE /identity/v3/users/83c79e6503a44f7b8a8d05376bb9fd52 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:21.700369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b140f-2775-4bfa-acd6-e072ed32e7c3 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:21.700369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b140f-2775-4bfa-acd6-e072ed32e7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:21.700570 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b140f-2775-4bfa-acd6-e072ed32e7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:21.720983 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-b93b140f-2775-4bfa-acd6-e072ed32e7c3 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:21.722388 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-b93b140f-2775-4bfa-acd6-e072ed32e7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:21.788876 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1038/2087] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:05:21.799204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22963ea5-db70-40fd-9a4d-96a6deec4096 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:21.800773 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-22963ea5-db70-40fd-9a4d-96a6deec4096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:21.864381 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22963ea5-db70-40fd-9a4d-96a6deec4096 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:21.870317 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ea297-291c-452b-a55a-d758224d78ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:21.871275 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ea297-291c-452b-a55a-d758224d78ce service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:21.871694 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ea297-291c-452b-a55a-d758224d78ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:21.872082 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ea297-291c-452b-a55a-d758224d78ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:21.884748 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ea297-291c-452b-a55a-d758224d78ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:21.886196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ea297-291c-452b-a55a-d758224d78ce service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:21.898341 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1050/2088] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:22.235895 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b140f-2775-4bfa-acd6-e072ed32e7c3 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:22.237463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-b93b140f-2775-4bfa-acd6-e072ed32e7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:22.253389 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b140f-2775-4bfa-acd6-e072ed32e7c3 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:22.258649 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70cca8-4abf-4c2b-856e-3c1b0abc9ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:22.259630 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70cca8-4abf-4c2b-856e-3c1b0abc9ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:22.259976 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70cca8-4abf-4c2b-856e-3c1b0abc9ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:22.260313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70cca8-4abf-4c2b-856e-3c1b0abc9ea2 admin admin] PATH_INFO: `/v3/projects/94666adfe68f486e819867cd63a8b946` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:22.261610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70cca8-4abf-4c2b-856e-3c1b0abc9ea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94666adfe68f486e819867cd63a8b946)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:22.263665 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70cca8-4abf-4c2b-856e-3c1b0abc9ea2 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:22.284618 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:22.323444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-1d70cca8-4abf-4c2b-856e-3c1b0abc9ea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94666adfe68f486e819867cd63a8b946', 'request_id': 'req-1d70cca8-4abf-4c2b-856e-3c1b0abc9ea2'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:22.334033 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-1d70cca8-4abf-4c2b-856e-3c1b0abc9ea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94666adfe68f486e819867cd63a8b946', 'request_id': 'req-1d70cca8-4abf-4c2b-856e-3c1b0abc9ea2'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:22.340866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-1d70cca8-4abf-4c2b-856e-3c1b0abc9ea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94666adfe68f486e819867cd63a8b946', 'request_id': 'req-1d70cca8-4abf-4c2b-856e-3c1b0abc9ea2'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:22.352717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-1d70cca8-4abf-4c2b-856e-3c1b0abc9ea2 admin admin] The token cache is being invalidate because project 94666adfe68f486e819867cd63a8b946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:22.352951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-1d70cca8-4abf-4c2b-856e-3c1b0abc9ea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:22.354037 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-1d70cca8-4abf-4c2b-856e-3c1b0abc9ea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:22.357774 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1039/2089] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:22 2022] DELETE /identity/v3/projects/94666adfe68f486e819867cd63a8b946 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:22.361970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ea297-291c-452b-a55a-d758224d78ce service neutron] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:22.373227 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ea297-291c-452b-a55a-d758224d78ce service neutron] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:22.432510 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:22.441712 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9332f5e-13f3-4b42-9a0d-b1a701471598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:22.442190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9332f5e-13f3-4b42-9a0d-b1a701471598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:22.442766 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9332f5e-13f3-4b42-9a0d-b1a701471598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:22.443184 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9332f5e-13f3-4b42-9a0d-b1a701471598 admin admin] PATH_INFO: `/v3/users/da0e5193abc24256961d60faf937d450` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:22.444701 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9332f5e-13f3-4b42-9a0d-b1a701471598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da0e5193abc24256961d60faf937d450)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:22.447540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9332f5e-13f3-4b42-9a0d-b1a701471598 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:22.510389 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-d9332f5e-13f3-4b42-9a0d-b1a701471598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da0e5193abc24256961d60faf937d450'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:22.518851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-d9332f5e-13f3-4b42-9a0d-b1a701471598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da0e5193abc24256961d60faf937d450'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:22.519650 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-d9332f5e-13f3-4b42-9a0d-b1a701471598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da0e5193abc24256961d60faf937d450'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:22.520456 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-d9332f5e-13f3-4b42-9a0d-b1a701471598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da0e5193abc24256961d60faf937d450'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:22.533576 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-d9332f5e-13f3-4b42-9a0d-b1a701471598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da0e5193abc24256961d60faf937d450'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:22.549835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1051/2090] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:22 2022] DELETE /identity/v3/users/da0e5193abc24256961d60faf937d450 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:22.880388 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70cca8-4abf-4c2b-856e-3c1b0abc9ea2 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:22.881888 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-1d70cca8-4abf-4c2b-856e-3c1b0abc9ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:22.900277 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70cca8-4abf-4c2b-856e-3c1b0abc9ea2 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:22.978959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5787a8-3fbb-453f-936c-adb6cce2991e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:22.979948 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5787a8-3fbb-453f-936c-adb6cce2991e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:22.980237 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5787a8-3fbb-453f-936c-adb6cce2991e admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:22.980559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5787a8-3fbb-453f-936c-adb6cce2991e admin admin] PATH_INFO: `/v3/projects/a35a2323bd824db684489aaaf09f9ca0` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:22.982128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5787a8-3fbb-453f-936c-adb6cce2991e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a35a2323bd824db684489aaaf09f9ca0)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:22.984995 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5787a8-3fbb-453f-936c-adb6cce2991e admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:23.041475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-ac5787a8-3fbb-453f-936c-adb6cce2991e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a35a2323bd824db684489aaaf09f9ca0', 'request_id': 'req-ac5787a8-3fbb-453f-936c-adb6cce2991e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:23.049920 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-ac5787a8-3fbb-453f-936c-adb6cce2991e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a35a2323bd824db684489aaaf09f9ca0', 'request_id': 'req-ac5787a8-3fbb-453f-936c-adb6cce2991e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:23.057051 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-ac5787a8-3fbb-453f-936c-adb6cce2991e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a35a2323bd824db684489aaaf09f9ca0', 'request_id': 'req-ac5787a8-3fbb-453f-936c-adb6cce2991e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:23.068989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-ac5787a8-3fbb-453f-936c-adb6cce2991e admin admin] The token cache is being invalidate because project a35a2323bd824db684489aaaf09f9ca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:23.069310 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-ac5787a8-3fbb-453f-936c-adb6cce2991e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:23.069955 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-ac5787a8-3fbb-453f-936c-adb6cce2991e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:23.071787 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1040/2091] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:22 2022] DELETE /identity/v3/projects/a35a2323bd824db684489aaaf09f9ca0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:23.077193 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8c8bb-a83c-49b1-b31b-58220aa1bf24 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:23.077484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8c8bb-a83c-49b1-b31b-58220aa1bf24 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:23.077764 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8c8bb-a83c-49b1-b31b-58220aa1bf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:23.096715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-abd8c8bb-a83c-49b1-b31b-58220aa1bf24 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:23.097969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-abd8c8bb-a83c-49b1-b31b-58220aa1bf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:23.160061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1052/2092] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:05:23.167928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164234d6-3768-4692-b931-b3a4d8a25535 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:23.168220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164234d6-3768-4692-b931-b3a4d8a25535 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:23.168503 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164234d6-3768-4692-b931-b3a4d8a25535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:23.189941 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-164234d6-3768-4692-b931-b3a4d8a25535 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:23.191183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-164234d6-3768-4692-b931-b3a4d8a25535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:23.200083 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1041/2093] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:05:23.204622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8c8bb-a83c-49b1-b31b-58220aa1bf24 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:23.216878 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8c8bb-a83c-49b1-b31b-58220aa1bf24 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:23.221596 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e1010-e491-4a59-8fae-2db9f2adfdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:23.222274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e1010-e491-4a59-8fae-2db9f2adfdf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:23.222556 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e1010-e491-4a59-8fae-2db9f2adfdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:23.222831 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e1010-e491-4a59-8fae-2db9f2adfdf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:23.223738 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e1010-e491-4a59-8fae-2db9f2adfdf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:05:23.224269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e1010-e491-4a59-8fae-2db9f2adfdf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:23.225590 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e1010-e491-4a59-8fae-2db9f2adfdf2 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:23.242216 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1053/2094] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:05:23.243340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164234d6-3768-4692-b931-b3a4d8a25535 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:23.253754 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164234d6-3768-4692-b931-b3a4d8a25535 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:23.259773 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497fda9-e014-41f5-b430-b12cf425273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:23.260462 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497fda9-e014-41f5-b430-b12cf425273b admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:23.260747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497fda9-e014-41f5-b430-b12cf425273b admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:23.261028 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497fda9-e014-41f5-b430-b12cf425273b admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:23.261856 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497fda9-e014-41f5-b430-b12cf425273b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:23.267582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497fda9-e014-41f5-b430-b12cf425273b admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:23.300480 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1042/2095] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:23 2022] POST /identity/v3/projects => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:23.305010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e1010-e491-4a59-8fae-2db9f2adfdf2 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:23.316166 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e1010-e491-4a59-8fae-2db9f2adfdf2 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:23.394129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30526868-1ae8-4cbe-99a9-c8531752aae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:23.394817 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30526868-1ae8-4cbe-99a9-c8531752aae7 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:23.395153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30526868-1ae8-4cbe-99a9-c8531752aae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:23.396236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30526868-1ae8-4cbe-99a9-c8531752aae7 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:23.397017 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30526868-1ae8-4cbe-99a9-c8531752aae7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:23.399500 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30526868-1ae8-4cbe-99a9-c8531752aae7 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:23.409246 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:23.430638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1054/2096] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:23 2022] POST /identity/v3/users => generated 284 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:05:23.432382 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497fda9-e014-41f5-b430-b12cf425273b admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:23.442060 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:23.446200 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497fda9-e014-41f5-b430-b12cf425273b admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:23.452388 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e73dd2-ec9a-4db8-a517-7a72209d4745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:23.453303 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e73dd2-ec9a-4db8-a517-7a72209d4745 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:23.454308 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e73dd2-ec9a-4db8-a517-7a72209d4745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:23.454635 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e73dd2-ec9a-4db8-a517-7a72209d4745 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:23.455528 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e73dd2-ec9a-4db8-a517-7a72209d4745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:23.457754 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e73dd2-ec9a-4db8-a517-7a72209d4745 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:23.468852 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1043/2097] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:23.473003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30526868-1ae8-4cbe-99a9-c8531752aae7 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:23.484209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30526868-1ae8-4cbe-99a9-c8531752aae7 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:23.488886 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c850d-648d-45fb-a450-e7526e43628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:23.489656 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c850d-648d-45fb-a450-e7526e43628c admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:23.490207 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c850d-648d-45fb-a450-e7526e43628c admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:23.490305 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c850d-648d-45fb-a450-e7526e43628c admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:23.491018 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c850d-648d-45fb-a450-e7526e43628c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:23.492853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c850d-648d-45fb-a450-e7526e43628c admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:23.504110 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1055/2098] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:23.508500 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e73dd2-ec9a-4db8-a517-7a72209d4745 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:23.518645 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e73dd2-ec9a-4db8-a517-7a72209d4745 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:23.523855 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449b28f-973c-402d-9fc5-7323d4c319fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:23.524742 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449b28f-973c-402d-9fc5-7323d4c319fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:23.525026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449b28f-973c-402d-9fc5-7323d4c319fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:23.525305 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449b28f-973c-402d-9fc5-7323d4c319fa admin admin] PATH_INFO: `/v3/projects/5ec76a46824c4219a4a38d071cad2c83/users/30522c1b4efc4200a903662b9ca2577e/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:23.541540 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449b28f-973c-402d-9fc5-7323d4c319fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec76a46824c4219a4a38d071cad2c83, user_id=30522c1b4efc4200a903662b9ca2577e, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:23.545133 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449b28f-973c-402d-9fc5-7323d4c319fa admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:23.560450 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1044/2099] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:23 2022] PUT /identity/v3/projects/5ec76a46824c4219a4a38d071cad2c83/users/30522c1b4efc4200a903662b9ca2577e/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:23.571185 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130d3da-cafd-4366-9e74-2afffb88fb3b None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:23.571703 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130d3da-cafd-4366-9e74-2afffb88fb3b None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:23.571818 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130d3da-cafd-4366-9e74-2afffb88fb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:23.601308 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-2130d3da-cafd-4366-9e74-2afffb88fb3b None None] MFA Rules not processed for user `30522c1b4efc4200a903662b9ca2577e`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:23.602552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-2130d3da-cafd-4366-9e74-2afffb88fb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:23.669852 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1056/2100] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:23.674731 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449b28f-973c-402d-9fc5-7323d4c319fa admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:23.743642 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449b28f-973c-402d-9fc5-7323d4c319fa admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:23.749341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26141cc-4c17-4ab8-a295-edacc05f45d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:23.750022 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26141cc-4c17-4ab8-a295-edacc05f45d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:23.750309 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26141cc-4c17-4ab8-a295-edacc05f45d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:23.750584 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26141cc-4c17-4ab8-a295-edacc05f45d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:23.751315 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26141cc-4c17-4ab8-a295-edacc05f45d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:23.753313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26141cc-4c17-4ab8-a295-edacc05f45d3 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:23.782165 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1045/2101] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:23 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:23.786210 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130d3da-cafd-4366-9e74-2afffb88fb3b None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:23.797599 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130d3da-cafd-4366-9e74-2afffb88fb3b None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:23.861298 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3d059-ffbb-40f2-bab6-41c76030c520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:23.861984 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3d059-ffbb-40f2-bab6-41c76030c520 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:23.862269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3d059-ffbb-40f2-bab6-41c76030c520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:23.862581 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3d059-ffbb-40f2-bab6-41c76030c520 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:23.863265 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3d059-ffbb-40f2-bab6-41c76030c520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:23.865534 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3d059-ffbb-40f2-bab6-41c76030c520 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:23.889231 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1057/2102] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:23 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:23.894637 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26141cc-4c17-4ab8-a295-edacc05f45d3 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:23.905280 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26141cc-4c17-4ab8-a295-edacc05f45d3 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:23.910237 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5a00d-b240-4e81-b7c9-ec75554cc667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:23.911054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5a00d-b240-4e81-b7c9-ec75554cc667 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:23.911425 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5a00d-b240-4e81-b7c9-ec75554cc667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:23.911786 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5a00d-b240-4e81-b7c9-ec75554cc667 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:23.912660 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c5a00d-b240-4e81-b7c9-ec75554cc667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:23.914340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c5a00d-b240-4e81-b7c9-ec75554cc667 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:23.927480 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1046/2103] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:23.932540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3d059-ffbb-40f2-bab6-41c76030c520 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:23.946593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3d059-ffbb-40f2-bab6-41c76030c520 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:23.952475 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb2061-fea7-47cc-9405-690819916330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:23.953377 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb2061-fea7-47cc-9405-690819916330 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:23.953656 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb2061-fea7-47cc-9405-690819916330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:23.953929 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb2061-fea7-47cc-9405-690819916330 admin admin] PATH_INFO: `/v3/projects/415dd20befc84358b5c7a341117f5897/users/542331c7b34b4637bcca1e9a2bc664b2/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:23.971125 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb2061-fea7-47cc-9405-690819916330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=415dd20befc84358b5c7a341117f5897, user_id=542331c7b34b4637bcca1e9a2bc664b2, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:23.973937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb2061-fea7-47cc-9405-690819916330 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:23.990975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1058/2104] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:23 2022] PUT /identity/v3/projects/415dd20befc84358b5c7a341117f5897/users/542331c7b34b4637bcca1e9a2bc664b2/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:23.995525 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5a00d-b240-4e81-b7c9-ec75554cc667 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:24.010591 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5a00d-b240-4e81-b7c9-ec75554cc667 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:24.074767 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba14423-4bf8-4506-9bf3-9c6743e87cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:24.075605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba14423-4bf8-4506-9bf3-9c6743e87cea admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:24.075956 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba14423-4bf8-4506-9bf3-9c6743e87cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:24.076301 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba14423-4bf8-4506-9bf3-9c6743e87cea admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:24.077112 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba14423-4bf8-4506-9bf3-9c6743e87cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:24.078802 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba14423-4bf8-4506-9bf3-9c6743e87cea admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:24.089797 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1047/2105] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:24.094009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb2061-fea7-47cc-9405-690819916330 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:24.105471 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb2061-fea7-47cc-9405-690819916330 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:24.110665 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb476b5b-5814-4138-bb37-c9bd962fcb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:24.111621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb476b5b-5814-4138-bb37-c9bd962fcb3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:24.111963 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb476b5b-5814-4138-bb37-c9bd962fcb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:24.112504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb476b5b-5814-4138-bb37-c9bd962fcb3a admin admin] PATH_INFO: `/v3/projects/415dd20befc84358b5c7a341117f5897/users/542331c7b34b4637bcca1e9a2bc664b2/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:24.114575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb476b5b-5814-4138-bb37-c9bd962fcb3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=415dd20befc84358b5c7a341117f5897, user_id=542331c7b34b4637bcca1e9a2bc664b2, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:24.117346 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb476b5b-5814-4138-bb37-c9bd962fcb3a admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:24.129015 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1059/2106] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:24 2022] PUT /identity/v3/projects/415dd20befc84358b5c7a341117f5897/users/542331c7b34b4637bcca1e9a2bc664b2/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:24.140612 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac5149-2d94-4b8e-bc78-ad5bd11477fb None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:24.140938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac5149-2d94-4b8e-bc78-ad5bd11477fb None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:24.141340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac5149-2d94-4b8e-bc78-ad5bd11477fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:24.169253 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-c0ac5149-2d94-4b8e-bc78-ad5bd11477fb None None] MFA Rules not processed for user `542331c7b34b4637bcca1e9a2bc664b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:24.170468 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-c0ac5149-2d94-4b8e-bc78-ad5bd11477fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:24.201258 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:24.248564 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1048/2107] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:24 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:24.260694 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb476b5b-5814-4138-bb37-c9bd962fcb3a admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:24.262965 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-eb476b5b-5814-4138-bb37-c9bd962fcb3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:24.293492 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:24.332177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb476b5b-5814-4138-bb37-c9bd962fcb3a admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:24.337134 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97d488-f8d6-41c6-a1d6-5feae90651cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:24.337797 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97d488-f8d6-41c6-a1d6-5feae90651cc service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:24.338076 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97d488-f8d6-41c6-a1d6-5feae90651cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:24.338379 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97d488-f8d6-41c6-a1d6-5feae90651cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:24.349862 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97d488-f8d6-41c6-a1d6-5feae90651cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:24.351580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97d488-f8d6-41c6-a1d6-5feae90651cc service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:24.361429 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1060/2108] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:24 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:24.434854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac5149-2d94-4b8e-bc78-ad5bd11477fb None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:24.438160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-c0ac5149-2d94-4b8e-bc78-ad5bd11477fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:24.454018 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac5149-2d94-4b8e-bc78-ad5bd11477fb None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:24.459816 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0342f6f-666c-4242-9bcb-25f8ba71a3d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:24.460818 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0342f6f-666c-4242-9bcb-25f8ba71a3d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:24.461302 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0342f6f-666c-4242-9bcb-25f8ba71a3d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:24.461821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0342f6f-666c-4242-9bcb-25f8ba71a3d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:24.605863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0342f6f-666c-4242-9bcb-25f8ba71a3d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:24.607388 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0342f6f-666c-4242-9bcb-25f8ba71a3d7 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:24.617909 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1049/2109] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:24 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:28.065589 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97d488-f8d6-41c6-a1d6-5feae90651cc service cinder] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:28.136815 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97d488-f8d6-41c6-a1d6-5feae90651cc service cinder] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:28.142516 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956ce4b-2f80-4f14-b1ed-df2c2a0e7da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:28.143396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956ce4b-2f80-4f14-b1ed-df2c2a0e7da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:28.143694 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956ce4b-2f80-4f14-b1ed-df2c2a0e7da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:28.144039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956ce4b-2f80-4f14-b1ed-df2c2a0e7da2 admin admin] PATH_INFO: `/v3/users/30522c1b4efc4200a903662b9ca2577e` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:28.145832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956ce4b-2f80-4f14-b1ed-df2c2a0e7da2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30522c1b4efc4200a903662b9ca2577e)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:28.148975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956ce4b-2f80-4f14-b1ed-df2c2a0e7da2 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:28.198831 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-a956ce4b-2f80-4f14-b1ed-df2c2a0e7da2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30522c1b4efc4200a903662b9ca2577e'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:28.205628 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-a956ce4b-2f80-4f14-b1ed-df2c2a0e7da2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30522c1b4efc4200a903662b9ca2577e'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:28.206295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-a956ce4b-2f80-4f14-b1ed-df2c2a0e7da2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30522c1b4efc4200a903662b9ca2577e'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:28.206910 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-a956ce4b-2f80-4f14-b1ed-df2c2a0e7da2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30522c1b4efc4200a903662b9ca2577e'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:28.223947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-a956ce4b-2f80-4f14-b1ed-df2c2a0e7da2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30522c1b4efc4200a903662b9ca2577e'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:28.239467 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1061/2110] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:28 2022] DELETE /identity/v3/users/30522c1b4efc4200a903662b9ca2577e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:28.244112 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d80b8-5b77-4fc0-8406-1b163a37ab0b None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:28.244571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d80b8-5b77-4fc0-8406-1b163a37ab0b None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:28.244661 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d80b8-5b77-4fc0-8406-1b163a37ab0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:28.262486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-b21d80b8-5b77-4fc0-8406-1b163a37ab0b None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:28.263725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-b21d80b8-5b77-4fc0-8406-1b163a37ab0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:28.323216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1050/2111] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:05:28.333069 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956ce4b-2f80-4f14-b1ed-df2c2a0e7da2 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:28.334577 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-a956ce4b-2f80-4f14-b1ed-df2c2a0e7da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:28.392349 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:28.405406 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956ce4b-2f80-4f14-b1ed-df2c2a0e7da2 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:28.410022 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7b0d1-b1e0-4e0a-b5b4-20dda1d538fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:28.410726 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7b0d1-b1e0-4e0a-b5b4-20dda1d538fb service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:28.411456 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7b0d1-b1e0-4e0a-b5b4-20dda1d538fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:28.411879 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7b0d1-b1e0-4e0a-b5b4-20dda1d538fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:28.422395 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7b0d1-b1e0-4e0a-b5b4-20dda1d538fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:28.424200 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7b0d1-b1e0-4e0a-b5b4-20dda1d538fb service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:28.434856 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1062/2112] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:05:28.766243 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d80b8-5b77-4fc0-8406-1b163a37ab0b None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:28.768473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-b21d80b8-5b77-4fc0-8406-1b163a37ab0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:28.806574 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d80b8-5b77-4fc0-8406-1b163a37ab0b None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:28.813228 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52aa26d-7c88-4978-b13d-b50eb75b50d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:28.814494 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aa26d-7c88-4978-b13d-b50eb75b50d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:28.814975 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aa26d-7c88-4978-b13d-b50eb75b50d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:28.815458 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aa26d-7c88-4978-b13d-b50eb75b50d8 admin admin] PATH_INFO: `/v3/projects/5ec76a46824c4219a4a38d071cad2c83` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:28.818065 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52aa26d-7c88-4978-b13d-b50eb75b50d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ec76a46824c4219a4a38d071cad2c83)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:28.822431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52aa26d-7c88-4978-b13d-b50eb75b50d8 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:28.883475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d52aa26d-7c88-4978-b13d-b50eb75b50d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ec76a46824c4219a4a38d071cad2c83', 'request_id': 'req-d52aa26d-7c88-4978-b13d-b50eb75b50d8'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:28.894499 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d52aa26d-7c88-4978-b13d-b50eb75b50d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ec76a46824c4219a4a38d071cad2c83', 'request_id': 'req-d52aa26d-7c88-4978-b13d-b50eb75b50d8'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:28.899156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:28.904563 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d52aa26d-7c88-4978-b13d-b50eb75b50d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ec76a46824c4219a4a38d071cad2c83', 'request_id': 'req-d52aa26d-7c88-4978-b13d-b50eb75b50d8'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:28.919208 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d52aa26d-7c88-4978-b13d-b50eb75b50d8 admin admin] The token cache is being invalidate because project 5ec76a46824c4219a4a38d071cad2c83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:28.919531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d52aa26d-7c88-4978-b13d-b50eb75b50d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:28.920186 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d52aa26d-7c88-4978-b13d-b50eb75b50d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:28.922291 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1051/2113] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:28 2022] DELETE /identity/v3/projects/5ec76a46824c4219a4a38d071cad2c83 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:28.930010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7b0d1-b1e0-4e0a-b5b4-20dda1d538fb service neutron] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:28.941655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7b0d1-b1e0-4e0a-b5b4-20dda1d538fb service neutron] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:29.021304 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e37ef6-647c-41ba-842e-6515b84c6313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:29.022196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e37ef6-647c-41ba-842e-6515b84c6313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:29.022474 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e37ef6-647c-41ba-842e-6515b84c6313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:29.022884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e37ef6-647c-41ba-842e-6515b84c6313 admin admin] PATH_INFO: `/v3/users/542331c7b34b4637bcca1e9a2bc664b2` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:29.024123 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e37ef6-647c-41ba-842e-6515b84c6313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=542331c7b34b4637bcca1e9a2bc664b2)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:29.026061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e37ef6-647c-41ba-842e-6515b84c6313 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:29.096919 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-d4e37ef6-647c-41ba-842e-6515b84c6313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '542331c7b34b4637bcca1e9a2bc664b2'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:29.105484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-d4e37ef6-647c-41ba-842e-6515b84c6313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '542331c7b34b4637bcca1e9a2bc664b2'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:29.106369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-d4e37ef6-647c-41ba-842e-6515b84c6313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '542331c7b34b4637bcca1e9a2bc664b2'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:29.107193 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-d4e37ef6-647c-41ba-842e-6515b84c6313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '542331c7b34b4637bcca1e9a2bc664b2'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:29.122650 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-d4e37ef6-647c-41ba-842e-6515b84c6313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '542331c7b34b4637bcca1e9a2bc664b2'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:29.138955 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1063/2114] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:28 2022] DELETE /identity/v3/users/542331c7b34b4637bcca1e9a2bc664b2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:29.451163 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52aa26d-7c88-4978-b13d-b50eb75b50d8 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:29.452738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-d52aa26d-7c88-4978-b13d-b50eb75b50d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:29.466446 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52aa26d-7c88-4978-b13d-b50eb75b50d8 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:29.525400 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300c120-a57c-49e2-b482-f4afdde7384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:29.526293 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300c120-a57c-49e2-b482-f4afdde7384e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:29.526583 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300c120-a57c-49e2-b482-f4afdde7384e admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:29.526852 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300c120-a57c-49e2-b482-f4afdde7384e admin admin] PATH_INFO: `/v3/projects/415dd20befc84358b5c7a341117f5897` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:29.528162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300c120-a57c-49e2-b482-f4afdde7384e admin admin] RBAC: Authorizing `identity:delete_project(project_id=415dd20befc84358b5c7a341117f5897)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:29.530164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300c120-a57c-49e2-b482-f4afdde7384e admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:29.582284 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-5300c120-a57c-49e2-b482-f4afdde7384e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '415dd20befc84358b5c7a341117f5897', 'request_id': 'req-5300c120-a57c-49e2-b482-f4afdde7384e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:29.591211 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-5300c120-a57c-49e2-b482-f4afdde7384e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '415dd20befc84358b5c7a341117f5897', 'request_id': 'req-5300c120-a57c-49e2-b482-f4afdde7384e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:29.596923 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-5300c120-a57c-49e2-b482-f4afdde7384e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '415dd20befc84358b5c7a341117f5897', 'request_id': 'req-5300c120-a57c-49e2-b482-f4afdde7384e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:29.608460 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-5300c120-a57c-49e2-b482-f4afdde7384e admin admin] The token cache is being invalidate because project 415dd20befc84358b5c7a341117f5897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:29.608740 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-5300c120-a57c-49e2-b482-f4afdde7384e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:29.609397 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-5300c120-a57c-49e2-b482-f4afdde7384e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:29.610971 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1052/2115] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:29 2022] DELETE /identity/v3/projects/415dd20befc84358b5c7a341117f5897 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:05:29.616402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bf192-b54b-4baa-8f5f-4c3f5ca2a385 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:29.616943 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bf192-b54b-4baa-8f5f-4c3f5ca2a385 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:29.617393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bf192-b54b-4baa-8f5f-4c3f5ca2a385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:29.638467 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-6d1bf192-b54b-4baa-8f5f-4c3f5ca2a385 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:29.639719 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-6d1bf192-b54b-4baa-8f5f-4c3f5ca2a385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:29.711294 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1064/2116] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:29.719837 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb57761-9ae9-4e45-b22c-12d67eeaa1d9 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:29.720125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb57761-9ae9-4e45-b22c-12d67eeaa1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:29.720427 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb57761-9ae9-4e45-b22c-12d67eeaa1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:29.740268 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-5bb57761-9ae9-4e45-b22c-12d67eeaa1d9 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:29.741500 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-5bb57761-9ae9-4e45-b22c-12d67eeaa1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:29.750790 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1053/2117] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:29.755354 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bf192-b54b-4baa-8f5f-4c3f5ca2a385 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:29.765308 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bf192-b54b-4baa-8f5f-4c3f5ca2a385 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:29.770517 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5967ed-5afe-4e81-a6ea-0c70749fb692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:29.771191 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5967ed-5afe-4e81-a6ea-0c70749fb692 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:29.771477 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5967ed-5afe-4e81-a6ea-0c70749fb692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:29.771911 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5967ed-5afe-4e81-a6ea-0c70749fb692 admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:29.772771 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5967ed-5afe-4e81-a6ea-0c70749fb692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:05:29.773080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5967ed-5afe-4e81-a6ea-0c70749fb692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:29.774773 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5967ed-5afe-4e81-a6ea-0c70749fb692 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:29.776580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:29.792631 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1065/2118] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:05:29.793762 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb57761-9ae9-4e45-b22c-12d67eeaa1d9 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:29.804823 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb57761-9ae9-4e45-b22c-12d67eeaa1d9 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:29.810216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8feab06-e395-4e35-b8bb-06bc5662f0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:29.811028 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8feab06-e395-4e35-b8bb-06bc5662f0b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:29.811131 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8feab06-e395-4e35-b8bb-06bc5662f0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:29.811465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8feab06-e395-4e35-b8bb-06bc5662f0b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:29.812150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8feab06-e395-4e35-b8bb-06bc5662f0b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:29.814106 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8feab06-e395-4e35-b8bb-06bc5662f0b1 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:29.815167 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5967ed-5afe-4e81-a6ea-0c70749fb692 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:29.817187 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-9f5967ed-5afe-4e81-a6ea-0c70749fb692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:29.830399 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5967ed-5afe-4e81-a6ea-0c70749fb692 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:29.836101 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dea38-c523-4b25-9954-3b5cc2583705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:29.837018 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dea38-c523-4b25-9954-3b5cc2583705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:29.837267 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dea38-c523-4b25-9954-3b5cc2583705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:29.837518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dea38-c523-4b25-9954-3b5cc2583705 admin admin] PATH_INFO: `/v3/users/700bf7585ea34f5eb227b0d18851fc40` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:29.838797 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1dea38-c523-4b25-9954-3b5cc2583705 admin admin] RBAC: Authorizing `identity:delete_user(user_id=700bf7585ea34f5eb227b0d18851fc40)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:29.840796 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1dea38-c523-4b25-9954-3b5cc2583705 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:29.842673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1054/2119] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:29 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:05:29.846967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8feab06-e395-4e35-b8bb-06bc5662f0b1 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:29.894260 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-4f1dea38-c523-4b25-9954-3b5cc2583705 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '700bf7585ea34f5eb227b0d18851fc40'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:29.898442 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:29.902172 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-4f1dea38-c523-4b25-9954-3b5cc2583705 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '700bf7585ea34f5eb227b0d18851fc40'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:29.902944 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-4f1dea38-c523-4b25-9954-3b5cc2583705 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '700bf7585ea34f5eb227b0d18851fc40'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:29.903580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-4f1dea38-c523-4b25-9954-3b5cc2583705 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '700bf7585ea34f5eb227b0d18851fc40'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:29.924842 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8feab06-e395-4e35-b8bb-06bc5662f0b1 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:29.930842 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd045b-25a6-409a-b010-5e12bcb4af3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:29.931810 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd045b-25a6-409a-b010-5e12bcb4af3a admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:29.932119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd045b-25a6-409a-b010-5e12bcb4af3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:29.932405 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd045b-25a6-409a-b010-5e12bcb4af3a admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:29.933410 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd045b-25a6-409a-b010-5e12bcb4af3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:29.933524 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-4f1dea38-c523-4b25-9954-3b5cc2583705 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '700bf7585ea34f5eb227b0d18851fc40'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:29.935352 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd045b-25a6-409a-b010-5e12bcb4af3a admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:29.954981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1066/2120] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:29 2022] DELETE /identity/v3/users/700bf7585ea34f5eb227b0d18851fc40 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:29.961292 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396a816-d13f-4468-bd64-1ba77df8466b None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:29.961691 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396a816-d13f-4468-bd64-1ba77df8466b None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:29.962065 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396a816-d13f-4468-bd64-1ba77df8466b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:29.974395 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1055/2121] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:29 2022] POST /identity/v3/users => generated 291 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:05:29.979443 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd045b-25a6-409a-b010-5e12bcb4af3a admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:29.981161 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-e4fd045b-25a6-409a-b010-5e12bcb4af3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:29.986110 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-c396a816-d13f-4468-bd64-1ba77df8466b None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:29.987307 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-c396a816-d13f-4468-bd64-1ba77df8466b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:29.994736 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd045b-25a6-409a-b010-5e12bcb4af3a admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:30.060932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbad434-4605-4808-8d7c-485a3aaaf332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:30.061775 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbad434-4605-4808-8d7c-485a3aaaf332 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:30.062157 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbad434-4605-4808-8d7c-485a3aaaf332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:30.062663 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbad434-4605-4808-8d7c-485a3aaaf332 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:30.063696 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbad434-4605-4808-8d7c-485a3aaaf332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:30.065611 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbad434-4605-4808-8d7c-485a3aaaf332 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:30.068953 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1067/2122] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:30.078134 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1056/2123] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:05:30.080124 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396a816-d13f-4468-bd64-1ba77df8466b None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:30.081667 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-c396a816-d13f-4468-bd64-1ba77df8466b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:30.082014 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbad434-4605-4808-8d7c-485a3aaaf332 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:30.092761 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbad434-4605-4808-8d7c-485a3aaaf332 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:30.097651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1111b68-fb58-40b0-ae29-63174fc0e56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:30.098389 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1111b68-fb58-40b0-ae29-63174fc0e56e admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:30.098885 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1111b68-fb58-40b0-ae29-63174fc0e56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:30.099351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1111b68-fb58-40b0-ae29-63174fc0e56e admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:30.100130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1111b68-fb58-40b0-ae29-63174fc0e56e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:30.101754 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1111b68-fb58-40b0-ae29-63174fc0e56e admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:30.116405 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1057/2124] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:30.120177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1111b68-fb58-40b0-ae29-63174fc0e56e admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:30.133855 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1111b68-fb58-40b0-ae29-63174fc0e56e admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:30.138525 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c05e4-dc54-4852-b926-147734841857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:30.139453 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c05e4-dc54-4852-b926-147734841857 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:30.139743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c05e4-dc54-4852-b926-147734841857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:30.140021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c05e4-dc54-4852-b926-147734841857 admin admin] PATH_INFO: `/v3/projects/947f3fa17d5b444e84530f589f25f59c/users/88f9cf638c0c46d7ac8802d7d5f29c67/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:30.146671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396a816-d13f-4468-bd64-1ba77df8466b None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:30.150289 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6739b78-91ac-492d-8b18-6ad43333b733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:30.150947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6739b78-91ac-492d-8b18-6ad43333b733 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:30.151226 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6739b78-91ac-492d-8b18-6ad43333b733 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:30.151525 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6739b78-91ac-492d-8b18-6ad43333b733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:30.159027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c05e4-dc54-4852-b926-147734841857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=947f3fa17d5b444e84530f589f25f59c, user_id=88f9cf638c0c46d7ac8802d7d5f29c67, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:30.160219 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c05e4-dc54-4852-b926-147734841857 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:30.166495 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6739b78-91ac-492d-8b18-6ad43333b733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:30.168537 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6739b78-91ac-492d-8b18-6ad43333b733 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:30.178223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1058/2125] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:30 2022] PUT /identity/v3/projects/947f3fa17d5b444e84530f589f25f59c/users/88f9cf638c0c46d7ac8802d7d5f29c67/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:05:30.179796 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1068/2126] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:05:30.189404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e3ec5-8b64-4c31-90f7-441bb3f1edde None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:30.189694 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e3ec5-8b64-4c31-90f7-441bb3f1edde None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:30.189970 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e3ec5-8b64-4c31-90f7-441bb3f1edde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:30.219961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-445e3ec5-8b64-4c31-90f7-441bb3f1edde None None] MFA Rules not processed for user `88f9cf638c0c46d7ac8802d7d5f29c67`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:30.221238 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-445e3ec5-8b64-4c31-90f7-441bb3f1edde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:30.309468 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1059/2127] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:30.314348 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6739b78-91ac-492d-8b18-6ad43333b733 service neutron] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:30.325549 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6739b78-91ac-492d-8b18-6ad43333b733 service neutron] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:30.332144 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:30.429296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f06ba-b0b9-48ad-b538-7efa64b03be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:30.430640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f06ba-b0b9-48ad-b538-7efa64b03be7 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:30.431054 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f06ba-b0b9-48ad-b538-7efa64b03be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:30.431464 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f06ba-b0b9-48ad-b538-7efa64b03be7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:30.432621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f06ba-b0b9-48ad-b538-7efa64b03be7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:30.434934 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f06ba-b0b9-48ad-b538-7efa64b03be7 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:30.468205 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1069/2128] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:30 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:05:30.472742 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e3ec5-8b64-4c31-90f7-441bb3f1edde None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:30.488799 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e3ec5-8b64-4c31-90f7-441bb3f1edde None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:30.530754 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:30.588710 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf0522-8060-4fc4-b3e8-67b9386f5790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:30.589587 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf0522-8060-4fc4-b3e8-67b9386f5790 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:30.590206 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf0522-8060-4fc4-b3e8-67b9386f5790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:30.590584 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf0522-8060-4fc4-b3e8-67b9386f5790 admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:30.591465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf0522-8060-4fc4-b3e8-67b9386f5790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:30.593701 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf0522-8060-4fc4-b3e8-67b9386f5790 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:30.607268 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f06ba-b0b9-48ad-b538-7efa64b03be7 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:30.609622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-140f06ba-b0b9-48ad-b538-7efa64b03be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:30.648723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1060/2129] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:30 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:30.649916 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f06ba-b0b9-48ad-b538-7efa64b03be7 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:30.653775 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf0522-8060-4fc4-b3e8-67b9386f5790 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:30.655893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba6f91-a460-46cb-aee4-a4e2468758e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:30.657040 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba6f91-a460-46cb-aee4-a4e2468758e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:30.657422 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba6f91-a460-46cb-aee4-a4e2468758e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:30.657969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba6f91-a460-46cb-aee4-a4e2468758e7 admin admin] PATH_INFO: `/v3/projects/5baed6c03ad14661975318f5f2cf6d5c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:30.659678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba6f91-a460-46cb-aee4-a4e2468758e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5baed6c03ad14661975318f5f2cf6d5c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:30.663817 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba6f91-a460-46cb-aee4-a4e2468758e7 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:30.669719 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf0522-8060-4fc4-b3e8-67b9386f5790 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:30.675008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eed59d-fcce-4c72-857c-8b13a84e8ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:30.675737 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eed59d-fcce-4c72-857c-8b13a84e8ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:30.676012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eed59d-fcce-4c72-857c-8b13a84e8ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:30.676340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eed59d-fcce-4c72-857c-8b13a84e8ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:30.677247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eed59d-fcce-4c72-857c-8b13a84e8ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:30.679024 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eed59d-fcce-4c72-857c-8b13a84e8ffe admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:30.689680 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1061/2130] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:05:30.694513 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eed59d-fcce-4c72-857c-8b13a84e8ffe admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:30.705827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eed59d-fcce-4c72-857c-8b13a84e8ffe admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:30.720118 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-29ba6f91-a460-46cb-aee4-a4e2468758e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5baed6c03ad14661975318f5f2cf6d5c', 'request_id': 'req-29ba6f91-a460-46cb-aee4-a4e2468758e7'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:30.729020 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-29ba6f91-a460-46cb-aee4-a4e2468758e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5baed6c03ad14661975318f5f2cf6d5c', 'request_id': 'req-29ba6f91-a460-46cb-aee4-a4e2468758e7'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:30.737896 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-29ba6f91-a460-46cb-aee4-a4e2468758e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5baed6c03ad14661975318f5f2cf6d5c', 'request_id': 'req-29ba6f91-a460-46cb-aee4-a4e2468758e7'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:30.752975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-29ba6f91-a460-46cb-aee4-a4e2468758e7 admin admin] The token cache is being invalidate because project 5baed6c03ad14661975318f5f2cf6d5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:30.752975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-29ba6f91-a460-46cb-aee4-a4e2468758e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:30.752975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-29ba6f91-a460-46cb-aee4-a4e2468758e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:30.752975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1070/2131] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:30 2022] DELETE /identity/v3/projects/5baed6c03ad14661975318f5f2cf6d5c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:05:30.757372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba6f91-a460-46cb-aee4-a4e2468758e7 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:30.758940 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-29ba6f91-a460-46cb-aee4-a4e2468758e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:30.771042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a04a5-8e73-43b9-8cbd-6dac31fd3f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:30.771995 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a04a5-8e73-43b9-8cbd-6dac31fd3f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:30.772279 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a04a5-8e73-43b9-8cbd-6dac31fd3f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:30.772557 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a04a5-8e73-43b9-8cbd-6dac31fd3f90 admin admin] PATH_INFO: `/v3/projects/c26b7b85a66945e9b3fe133a3b58c6cc/users/8023b1226aca4352b4df5a4cf3d31d41/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:30.787928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a04a5-8e73-43b9-8cbd-6dac31fd3f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26b7b85a66945e9b3fe133a3b58c6cc, user_id=8023b1226aca4352b4df5a4cf3d31d41, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:30.790682 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a04a5-8e73-43b9-8cbd-6dac31fd3f90 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:30.805297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1062/2132] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:30 2022] PUT /identity/v3/projects/c26b7b85a66945e9b3fe133a3b58c6cc/users/8023b1226aca4352b4df5a4cf3d31d41/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:05:30.809793 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a04a5-8e73-43b9-8cbd-6dac31fd3f90 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:30.811472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-101a04a5-8e73-43b9-8cbd-6dac31fd3f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:30.827958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba6f91-a460-46cb-aee4-a4e2468758e7 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:30.848759 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:30.888746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a04a5-8e73-43b9-8cbd-6dac31fd3f90 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:30.890793 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb766a44-67ee-42c3-b600-9ba838753d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:30.891720 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb766a44-67ee-42c3-b600-9ba838753d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:30.892002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb766a44-67ee-42c3-b600-9ba838753d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:30.892409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb766a44-67ee-42c3-b600-9ba838753d7f admin admin] PATH_INFO: `/v3/users/5a55c37b371f42688370ce882a435df1` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:30.893816 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb766a44-67ee-42c3-b600-9ba838753d7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a55c37b371f42688370ce882a435df1)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:30.894476 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49822601-21e0-4602-b1ad-36683d311bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:30.895281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49822601-21e0-4602-b1ad-36683d311bfe admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:30.895580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49822601-21e0-4602-b1ad-36683d311bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:30.895885 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49822601-21e0-4602-b1ad-36683d311bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:30.895996 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb766a44-67ee-42c3-b600-9ba838753d7f admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:30.896787 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49822601-21e0-4602-b1ad-36683d311bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:30.898440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49822601-21e0-4602-b1ad-36683d311bfe admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:30.912195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1063/2133] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:05:30.913628 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49822601-21e0-4602-b1ad-36683d311bfe admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:30.935685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49822601-21e0-4602-b1ad-36683d311bfe admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:30.941524 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda67b5-fe18-4f23-a41e-36ef86e28608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:30.942654 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda67b5-fe18-4f23-a41e-36ef86e28608 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:30.942964 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda67b5-fe18-4f23-a41e-36ef86e28608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:30.943246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda67b5-fe18-4f23-a41e-36ef86e28608 admin admin] PATH_INFO: `/v3/projects/c26b7b85a66945e9b3fe133a3b58c6cc/users/8023b1226aca4352b4df5a4cf3d31d41/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:30.946927 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda67b5-fe18-4f23-a41e-36ef86e28608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26b7b85a66945e9b3fe133a3b58c6cc, user_id=8023b1226aca4352b4df5a4cf3d31d41, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:30.949695 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda67b5-fe18-4f23-a41e-36ef86e28608 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:30.955350 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-cb766a44-67ee-42c3-b600-9ba838753d7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a55c37b371f42688370ce882a435df1'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:30.961736 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1064/2134] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:30 2022] PUT /identity/v3/projects/c26b7b85a66945e9b3fe133a3b58c6cc/users/8023b1226aca4352b4df5a4cf3d31d41/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:05:30.965554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-cb766a44-67ee-42c3-b600-9ba838753d7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a55c37b371f42688370ce882a435df1'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:30.966295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-cb766a44-67ee-42c3-b600-9ba838753d7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a55c37b371f42688370ce882a435df1'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:30.968248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-cb766a44-67ee-42c3-b600-9ba838753d7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a55c37b371f42688370ce882a435df1'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:30.972693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1cfb2-2026-46b7-9a04-7fd90efd9305 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:30.973032 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1cfb2-2026-46b7-9a04-7fd90efd9305 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:30.973322 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1cfb2-2026-46b7-9a04-7fd90efd9305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:30.985367 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-cb766a44-67ee-42c3-b600-9ba838753d7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a55c37b371f42688370ce882a435df1'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:31.004463 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1071/2135] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:30 2022] DELETE /identity/v3/users/5a55c37b371f42688370ce882a435df1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:05:31.008621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-67e1cfb2-2026-46b7-9a04-7fd90efd9305 None None] MFA Rules not processed for user `8023b1226aca4352b4df5a4cf3d31d41`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:31.009925 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-67e1cfb2-2026-46b7-9a04-7fd90efd9305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:31.011839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:31.115066 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1065/2136] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:05:31.129892 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb766a44-67ee-42c3-b600-9ba838753d7f admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:31.131580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-cb766a44-67ee-42c3-b600-9ba838753d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:31.227191 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb766a44-67ee-42c3-b600-9ba838753d7f admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:31.231649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c8f79-dca9-4e33-9e25-d99f9e34d087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:31.232490 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c8f79-dca9-4e33-9e25-d99f9e34d087 service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:31.232808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c8f79-dca9-4e33-9e25-d99f9e34d087 service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:31.233103 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c8f79-dca9-4e33-9e25-d99f9e34d087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:31.243975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c8f79-dca9-4e33-9e25-d99f9e34d087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:31.245991 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c8f79-dca9-4e33-9e25-d99f9e34d087 service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:31.263912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1072/2137] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:05:31.354876 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1cfb2-2026-46b7-9a04-7fd90efd9305 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:31.358543 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-67e1cfb2-2026-46b7-9a04-7fd90efd9305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:31.464151 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1cfb2-2026-46b7-9a04-7fd90efd9305 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:31.468982 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b57c5-a327-495a-9d9e-9df8e068d2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:31.469928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b57c5-a327-495a-9d9e-9df8e068d2cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:31.470334 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b57c5-a327-495a-9d9e-9df8e068d2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:31.470800 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b57c5-a327-495a-9d9e-9df8e068d2cc admin admin] PATH_INFO: `/v3/projects/ef50a09fe1d84cff870658abffcdfd78` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:31.472307 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b57c5-a327-495a-9d9e-9df8e068d2cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef50a09fe1d84cff870658abffcdfd78)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:31.475204 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b57c5-a327-495a-9d9e-9df8e068d2cc admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:31.538278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-6a2b57c5-a327-495a-9d9e-9df8e068d2cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef50a09fe1d84cff870658abffcdfd78', 'request_id': 'req-6a2b57c5-a327-495a-9d9e-9df8e068d2cc'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:31.547946 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-6a2b57c5-a327-495a-9d9e-9df8e068d2cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef50a09fe1d84cff870658abffcdfd78', 'request_id': 'req-6a2b57c5-a327-495a-9d9e-9df8e068d2cc'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:31.560945 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-6a2b57c5-a327-495a-9d9e-9df8e068d2cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef50a09fe1d84cff870658abffcdfd78', 'request_id': 'req-6a2b57c5-a327-495a-9d9e-9df8e068d2cc'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:31.581629 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-6a2b57c5-a327-495a-9d9e-9df8e068d2cc admin admin] The token cache is being invalidate because project ef50a09fe1d84cff870658abffcdfd78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:31.581927 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-6a2b57c5-a327-495a-9d9e-9df8e068d2cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:31.582856 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-6a2b57c5-a327-495a-9d9e-9df8e068d2cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:31.584903 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1066/2138] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:31 2022] DELETE /identity/v3/projects/ef50a09fe1d84cff870658abffcdfd78 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:31.589775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea9dd4-8f5f-4133-aa88-36e7a8a5f10c None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:31.590379 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea9dd4-8f5f-4133-aa88-36e7a8a5f10c None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:31.590846 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea9dd4-8f5f-4133-aa88-36e7a8a5f10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:31.611605 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-41ea9dd4-8f5f-4133-aa88-36e7a8a5f10c None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:31.613019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-41ea9dd4-8f5f-4133-aa88-36e7a8a5f10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:31.702721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b57c5-a327-495a-9d9e-9df8e068d2cc admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:31.705252 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-6a2b57c5-a327-495a-9d9e-9df8e068d2cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:31.738259 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:31.769561 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1073/2139] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:31.772827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:31.784318 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5947d65-b827-4af4-845d-f2585d691a61 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:31.784621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5947d65-b827-4af4-845d-f2585d691a61 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:31.786902 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5947d65-b827-4af4-845d-f2585d691a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:31.814484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-d5947d65-b827-4af4-845d-f2585d691a61 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:31.816315 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-d5947d65-b827-4af4-845d-f2585d691a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:31.829953 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1074/2140] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:31.836605 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5947d65-b827-4af4-845d-f2585d691a61 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:31.847071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5947d65-b827-4af4-845d-f2585d691a61 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:31.852624 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b57c5-a327-495a-9d9e-9df8e068d2cc admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:31.853882 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc14278-7e63-4fef-91a0-ac66c73565df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:31.854573 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc14278-7e63-4fef-91a0-ac66c73565df admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:31.854835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc14278-7e63-4fef-91a0-ac66c73565df admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:31.855108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc14278-7e63-4fef-91a0-ac66c73565df admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:31.855899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc14278-7e63-4fef-91a0-ac66c73565df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:05:31.856204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc14278-7e63-4fef-91a0-ac66c73565df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:31.857173 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b08f60-5724-4960-820b-639f51809fc6 tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8023b1226aca4352b4df5a4cf3d31d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c26b7b85a66945e9b3fe133a3b58c6cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:31.857832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc14278-7e63-4fef-91a0-ac66c73565df admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:31.857950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b08f60-5724-4960-820b-639f51809fc6 tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:31.858113 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b08f60-5724-4960-820b-639f51809fc6 tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:31.858392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b08f60-5724-4960-820b-639f51809fc6 tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:31.859155 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b08f60-5724-4960-820b-639f51809fc6 tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:05:31.859501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b08f60-5724-4960-820b-639f51809fc6 tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:31.861388 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b08f60-5724-4960-820b-639f51809fc6 tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:31.875509 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1075/2141] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:05:31.877872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc14278-7e63-4fef-91a0-ac66c73565df admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:31.879469 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1067/2142] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:05:31.884058 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b08f60-5724-4960-820b-639f51809fc6 tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:31.889053 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc14278-7e63-4fef-91a0-ac66c73565df admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:31.894571 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb2e47-bfc3-4eda-bc5b-cffed217926a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:31.895376 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb2e47-bfc3-4eda-bc5b-cffed217926a admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:31.895852 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb2e47-bfc3-4eda-bc5b-cffed217926a admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:31.895976 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b08f60-5724-4960-820b-639f51809fc6 tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:31.896157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb2e47-bfc3-4eda-bc5b-cffed217926a admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:31.896939 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb2e47-bfc3-4eda-bc5b-cffed217926a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:31.898973 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb2e47-bfc3-4eda-bc5b-cffed217926a admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:31.906693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e0ede-cf72-4db1-8be8-18f977068f9d tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8023b1226aca4352b4df5a4cf3d31d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c26b7b85a66945e9b3fe133a3b58c6cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:31.907745 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e0ede-cf72-4db1-8be8-18f977068f9d tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:31.908760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e0ede-cf72-4db1-8be8-18f977068f9d tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:31.909328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e0ede-cf72-4db1-8be8-18f977068f9d tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:31.910135 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e0ede-cf72-4db1-8be8-18f977068f9d tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:31.912556 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e0ede-cf72-4db1-8be8-18f977068f9d tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:31.960793 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1068/2143] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:31 2022] POST /identity/v3/projects => generated 355 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:31.961822 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e0ede-cf72-4db1-8be8-18f977068f9d tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:31.964537 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1076/2144] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:31 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:31.969026 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb2e47-bfc3-4eda-bc5b-cffed217926a admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:32.030960 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e0ede-cf72-4db1-8be8-18f977068f9d tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:32.032145 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb2e47-bfc3-4eda-bc5b-cffed217926a admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:32.037541 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080943f-5806-4586-94b8-e9e8f914787d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:32.038234 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080943f-5806-4586-94b8-e9e8f914787d admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:32.038512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080943f-5806-4586-94b8-e9e8f914787d admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:32.038816 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080943f-5806-4586-94b8-e9e8f914787d admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:32.039547 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080943f-5806-4586-94b8-e9e8f914787d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:32.041522 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080943f-5806-4586-94b8-e9e8f914787d admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:32.072179 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1077/2145] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:31 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:32.073357 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080943f-5806-4586-94b8-e9e8f914787d admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:32.091383 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080943f-5806-4586-94b8-e9e8f914787d admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:32.097196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df456e-2d4c-4eb5-93a9-0d36fda7ef27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:32.097431 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df456e-2d4c-4eb5-93a9-0d36fda7ef27 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:32.097713 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df456e-2d4c-4eb5-93a9-0d36fda7ef27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:32.098061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df456e-2d4c-4eb5-93a9-0d36fda7ef27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:32.098805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df456e-2d4c-4eb5-93a9-0d36fda7ef27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:32.100958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df456e-2d4c-4eb5-93a9-0d36fda7ef27 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:32.113201 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1078/2146] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:32.116760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cca8b-ea47-4b1c-a836-f45f1774faad tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8023b1226aca4352b4df5a4cf3d31d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c26b7b85a66945e9b3fe133a3b58c6cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:32.116942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df456e-2d4c-4eb5-93a9-0d36fda7ef27 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:32.117453 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cca8b-ea47-4b1c-a836-f45f1774faad tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:32.117750 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cca8b-ea47-4b1c-a836-f45f1774faad tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:32.118054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cca8b-ea47-4b1c-a836-f45f1774faad tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:32.118881 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59cca8b-ea47-4b1c-a836-f45f1774faad tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:05:32.119233 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59cca8b-ea47-4b1c-a836-f45f1774faad tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:32.121103 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59cca8b-ea47-4b1c-a836-f45f1774faad tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:32.132158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df456e-2d4c-4eb5-93a9-0d36fda7ef27 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:32.136230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1069/2147] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:05:32.140414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d2690-2f99-4d7b-9524-5bd0ff3b3f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:32.140971 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d2690-2f99-4d7b-9524-5bd0ff3b3f71 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:32.141265 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d2690-2f99-4d7b-9524-5bd0ff3b3f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:32.142032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d2690-2f99-4d7b-9524-5bd0ff3b3f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:32.142463 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d2690-2f99-4d7b-9524-5bd0ff3b3f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:32.145410 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d2690-2f99-4d7b-9524-5bd0ff3b3f71 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:32.157537 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1079/2148] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:05:32.162817 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cca8b-ea47-4b1c-a836-f45f1774faad tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:32.176190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d2690-2f99-4d7b-9524-5bd0ff3b3f71 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:32.182445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cca8b-ea47-4b1c-a836-f45f1774faad tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:32.187314 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d2690-2f99-4d7b-9524-5bd0ff3b3f71 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:32.189151 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270a9cd-7399-44ad-acc0-33d9b7886adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:32.190418 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270a9cd-7399-44ad-acc0-33d9b7886adf admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:32.190847 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270a9cd-7399-44ad-acc0-33d9b7886adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:32.191365 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270a9cd-7399-44ad-acc0-33d9b7886adf admin admin] PATH_INFO: `/v3/projects/665d818bf9714dd7820669579af82795/users/6c22158da5fc45a5b80010e32b38689c/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:32.192247 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354c851-ff4a-4c26-af39-276add568040 tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8023b1226aca4352b4df5a4cf3d31d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c26b7b85a66945e9b3fe133a3b58c6cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:32.193129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354c851-ff4a-4c26-af39-276add568040 tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:32.193541 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354c851-ff4a-4c26-af39-276add568040 tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:32.193820 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354c851-ff4a-4c26-af39-276add568040 tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] PATH_INFO: `/v3/projects/8c9d15f9c8e54a7f9544f081a4c132f0` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:32.195109 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354c851-ff4a-4c26-af39-276add568040 tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8c9d15f9c8e54a7f9544f081a4c132f0)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:32.197208 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354c851-ff4a-4c26-af39-276add568040 tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:32.209435 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270a9cd-7399-44ad-acc0-33d9b7886adf admin admin] RBAC: Authorizing `identity:create_grant(project_id=665d818bf9714dd7820669579af82795, user_id=6c22158da5fc45a5b80010e32b38689c, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:32.212400 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270a9cd-7399-44ad-acc0-33d9b7886adf admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:32.230197 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1070/2149] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:32 2022] PUT /identity/v3/projects/665d818bf9714dd7820669579af82795/users/6c22158da5fc45a5b80010e32b38689c/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:05:32.235739 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d6f47-1abb-4a0c-a454-2bceb27a57de None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:32.236103 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d6f47-1abb-4a0c-a454-2bceb27a57de None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:32.236402 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d6f47-1abb-4a0c-a454-2bceb27a57de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:32.255496 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-532d6f47-1abb-4a0c-a454-2bceb27a57de None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:32.256352 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f354c851-ff4a-4c26-af39-276add568040 tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c9d15f9c8e54a7f9544f081a4c132f0', 'request_id': 'req-f354c851-ff4a-4c26-af39-276add568040'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:32.256803 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-532d6f47-1abb-4a0c-a454-2bceb27a57de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:32.263115 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f354c851-ff4a-4c26-af39-276add568040 tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c9d15f9c8e54a7f9544f081a4c132f0', 'request_id': 'req-f354c851-ff4a-4c26-af39-276add568040'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:32.271844 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:32.273303 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f354c851-ff4a-4c26-af39-276add568040 tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c9d15f9c8e54a7f9544f081a4c132f0', 'request_id': 'req-f354c851-ff4a-4c26-af39-276add568040'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:32.279146 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:32.287715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f354c851-ff4a-4c26-af39-276add568040 tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] The token cache is being invalidate because project 8c9d15f9c8e54a7f9544f081a4c132f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:32.288527 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f354c851-ff4a-4c26-af39-276add568040 tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:32.289288 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f354c851-ff4a-4c26-af39-276add568040 tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:32.291154 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1080/2150] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:32 2022] DELETE /identity/v3/projects/8c9d15f9c8e54a7f9544f081a4c132f0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:32.331696 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1071/2151] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:32.342483 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354c851-ff4a-4c26-af39-276add568040 tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:32.343980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-f354c851-ff4a-4c26-af39-276add568040 tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:32.408783 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354c851-ff4a-4c26-af39-276add568040 tempest-VolumeQuotaClassesTest-166493305 tempest-VolumeQuotaClassesTest-166493305-project-admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:32.411629 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c6010-3df3-40d3-a192-09d531cbe6f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:32.412311 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c6010-3df3-40d3-a192-09d531cbe6f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:32.412594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c6010-3df3-40d3-a192-09d531cbe6f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:32.412872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c6010-3df3-40d3-a192-09d531cbe6f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:32.422882 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c6010-3df3-40d3-a192-09d531cbe6f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:32.424725 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c6010-3df3-40d3-a192-09d531cbe6f3 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:32.435640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1081/2152] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:32.537213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d6f47-1abb-4a0c-a454-2bceb27a57de None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:32.539985 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-532d6f47-1abb-4a0c-a454-2bceb27a57de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:32.555597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d6f47-1abb-4a0c-a454-2bceb27a57de None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:32.560609 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24afe7-2b98-468b-bfe0-0ff30ef6df1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:32.561512 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24afe7-2b98-468b-bfe0-0ff30ef6df1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:32.561822 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24afe7-2b98-468b-bfe0-0ff30ef6df1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:32.562103 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24afe7-2b98-468b-bfe0-0ff30ef6df1e admin admin] PATH_INFO: `/v3/users/88f9cf638c0c46d7ac8802d7d5f29c67` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:32.563589 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24afe7-2b98-468b-bfe0-0ff30ef6df1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=88f9cf638c0c46d7ac8802d7d5f29c67)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:32.565769 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24afe7-2b98-468b-bfe0-0ff30ef6df1e admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:32.632312 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-ef24afe7-2b98-468b-bfe0-0ff30ef6df1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88f9cf638c0c46d7ac8802d7d5f29c67'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:32.654788 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-ef24afe7-2b98-468b-bfe0-0ff30ef6df1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88f9cf638c0c46d7ac8802d7d5f29c67'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:32.663169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-ef24afe7-2b98-468b-bfe0-0ff30ef6df1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88f9cf638c0c46d7ac8802d7d5f29c67'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:32.663919 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-ef24afe7-2b98-468b-bfe0-0ff30ef6df1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88f9cf638c0c46d7ac8802d7d5f29c67'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:32.675925 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-ef24afe7-2b98-468b-bfe0-0ff30ef6df1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88f9cf638c0c46d7ac8802d7d5f29c67'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:32.684463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1072/2153] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:32 2022] DELETE /identity/v3/users/88f9cf638c0c46d7ac8802d7d5f29c67 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:32.689264 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22c707-8f5a-45af-bf9f-64a177e00d19 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:32.689666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22c707-8f5a-45af-bf9f-64a177e00d19 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:32.690011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22c707-8f5a-45af-bf9f-64a177e00d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:32.716672 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-5e22c707-8f5a-45af-bf9f-64a177e00d19 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:32.717970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5e22c707-8f5a-45af-bf9f-64a177e00d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:32.788768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1082/2154] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:32.807770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24afe7-2b98-468b-bfe0-0ff30ef6df1e admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:32.810723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-ef24afe7-2b98-468b-bfe0-0ff30ef6df1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:32.869137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539ecc7-2c42-4b87-ab84-71114a6006ca None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:32.869508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539ecc7-2c42-4b87-ab84-71114a6006ca None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:32.869682 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539ecc7-2c42-4b87-ab84-71114a6006ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:32.893668 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-5539ecc7-2c42-4b87-ab84-71114a6006ca None None] MFA Rules not processed for user `2790457b77004defbea2825d15d8f00d`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:32.895601 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5539ecc7-2c42-4b87-ab84-71114a6006ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:32.916914 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24afe7-2b98-468b-bfe0-0ff30ef6df1e admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:32.932463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58caaa5-3918-4f0c-a0ab-feed4feda8cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:32.933794 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58caaa5-3918-4f0c-a0ab-feed4feda8cc service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:32.934051 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58caaa5-3918-4f0c-a0ab-feed4feda8cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:32.935813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58caaa5-3918-4f0c-a0ab-feed4feda8cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:32.948808 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58caaa5-3918-4f0c-a0ab-feed4feda8cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:32.950822 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58caaa5-3918-4f0c-a0ab-feed4feda8cc service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:32.967560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1073/2155] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:32.982540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1083/2156] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:05:33.475550 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a802f3-e5f9-407b-85e2-ae22d7cac8e7 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:33.475846 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a802f3-e5f9-407b-85e2-ae22d7cac8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:33.476127 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a802f3-e5f9-407b-85e2-ae22d7cac8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:33.520966 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-a9a802f3-e5f9-407b-85e2-ae22d7cac8e7 None None] MFA Rules not processed for user `6c22158da5fc45a5b80010e32b38689c`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:33.522258 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a9a802f3-e5f9-407b-85e2-ae22d7cac8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:33.531538 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539ecc7-2c42-4b87-ab84-71114a6006ca None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:33.533272 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5539ecc7-2c42-4b87-ab84-71114a6006ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:33.558212 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539ecc7-2c42-4b87-ab84-71114a6006ca None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:33.569742 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:33.576701 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fd85d-5b36-4669-9d0a-3a555e450b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:33.577777 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fd85d-5b36-4669-9d0a-3a555e450b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:33.578205 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fd85d-5b36-4669-9d0a-3a555e450b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:33.578638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fd85d-5b36-4669-9d0a-3a555e450b49 admin admin] PATH_INFO: `/v3/projects/947f3fa17d5b444e84530f589f25f59c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:33.580047 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370fd85d-5b36-4669-9d0a-3a555e450b49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=947f3fa17d5b444e84530f589f25f59c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:33.582813 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370fd85d-5b36-4669-9d0a-3a555e450b49 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:33.638318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1074/2157] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:33.644502 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a802f3-e5f9-407b-85e2-ae22d7cac8e7 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:33.645315 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:33.647141 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a9a802f3-e5f9-407b-85e2-ae22d7cac8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:33.651113 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-370fd85d-5b36-4669-9d0a-3a555e450b49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947f3fa17d5b444e84530f589f25f59c', 'request_id': 'req-370fd85d-5b36-4669-9d0a-3a555e450b49'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:33.659322 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-370fd85d-5b36-4669-9d0a-3a555e450b49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947f3fa17d5b444e84530f589f25f59c', 'request_id': 'req-370fd85d-5b36-4669-9d0a-3a555e450b49'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:33.672319 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a802f3-e5f9-407b-85e2-ae22d7cac8e7 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:33.672644 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-370fd85d-5b36-4669-9d0a-3a555e450b49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947f3fa17d5b444e84530f589f25f59c', 'request_id': 'req-370fd85d-5b36-4669-9d0a-3a555e450b49'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:33.692416 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-370fd85d-5b36-4669-9d0a-3a555e450b49 admin admin] The token cache is being invalidate because project 947f3fa17d5b444e84530f589f25f59c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:33.693182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-370fd85d-5b36-4669-9d0a-3a555e450b49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:33.693974 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-370fd85d-5b36-4669-9d0a-3a555e450b49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:33.696019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1084/2158] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:33 2022] DELETE /identity/v3/projects/947f3fa17d5b444e84530f589f25f59c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:33.699974 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fd85d-5b36-4669-9d0a-3a555e450b49 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:33.701808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-370fd85d-5b36-4669-9d0a-3a555e450b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:33.762997 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c6102-dfdc-48a2-b583-a75620a8f1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:33.763716 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c6102-dfdc-48a2-b583-a75620a8f1b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:33.764357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c6102-dfdc-48a2-b583-a75620a8f1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:33.764687 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c6102-dfdc-48a2-b583-a75620a8f1b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:33.765826 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c6102-dfdc-48a2-b583-a75620a8f1b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:33.767908 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c6102-dfdc-48a2-b583-a75620a8f1b7 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:33.795794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fd85d-5b36-4669-9d0a-3a555e450b49 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:33.803692 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f43798-1f08-4f2e-9df8-c1024faf79ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:33.804671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f43798-1f08-4f2e-9df8-c1024faf79ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:33.805025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f43798-1f08-4f2e-9df8-c1024faf79ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:33.805389 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f43798-1f08-4f2e-9df8-c1024faf79ac admin admin] PATH_INFO: `/v3/users/8023b1226aca4352b4df5a4cf3d31d41` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:33.806704 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f43798-1f08-4f2e-9df8-c1024faf79ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=8023b1226aca4352b4df5a4cf3d31d41)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:33.808819 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f43798-1f08-4f2e-9df8-c1024faf79ac admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:33.815531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1075/2159] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:33 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:33.820169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c6102-dfdc-48a2-b583-a75620a8f1b7 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:33.822154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-801c6102-dfdc-48a2-b583-a75620a8f1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:33.870690 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-03f43798-1f08-4f2e-9df8-c1024faf79ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8023b1226aca4352b4df5a4cf3d31d41'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:33.880973 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-03f43798-1f08-4f2e-9df8-c1024faf79ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8023b1226aca4352b4df5a4cf3d31d41'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:33.881801 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-03f43798-1f08-4f2e-9df8-c1024faf79ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8023b1226aca4352b4df5a4cf3d31d41'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:33.883543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-03f43798-1f08-4f2e-9df8-c1024faf79ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8023b1226aca4352b4df5a4cf3d31d41'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:33.907001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-03f43798-1f08-4f2e-9df8-c1024faf79ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8023b1226aca4352b4df5a4cf3d31d41'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:33.929124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c6102-dfdc-48a2-b583-a75620a8f1b7 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:33.935389 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1085/2160] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:33 2022] DELETE /identity/v3/users/8023b1226aca4352b4df5a4cf3d31d41 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:33.991884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:34.000501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590f6ad-01c8-42eb-b8ca-b55f6d2a5ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:34.001367 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590f6ad-01c8-42eb-b8ca-b55f6d2a5ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:34.001690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590f6ad-01c8-42eb-b8ca-b55f6d2a5ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:34.001918 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590f6ad-01c8-42eb-b8ca-b55f6d2a5ab4 admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:34.002651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590f6ad-01c8-42eb-b8ca-b55f6d2a5ab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:34.005148 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590f6ad-01c8-42eb-b8ca-b55f6d2a5ab4 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:34.030423 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1076/2161] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:33 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:05:34.034247 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f43798-1f08-4f2e-9df8-c1024faf79ac admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:34.036391 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-03f43798-1f08-4f2e-9df8-c1024faf79ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:34.051206 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f43798-1f08-4f2e-9df8-c1024faf79ac admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:34.058786 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcb79b-91f4-402b-a2fa-84e9c20feb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:34.059640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcb79b-91f4-402b-a2fa-84e9c20feb5f admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:34.059927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcb79b-91f4-402b-a2fa-84e9c20feb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:34.060202 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcb79b-91f4-402b-a2fa-84e9c20feb5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:34.060988 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfcb79b-91f4-402b-a2fa-84e9c20feb5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:34.062745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfcb79b-91f4-402b-a2fa-84e9c20feb5f admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:34.077495 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1086/2162] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:34.082062 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590f6ad-01c8-42eb-b8ca-b55f6d2a5ab4 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:34.093771 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590f6ad-01c8-42eb-b8ca-b55f6d2a5ab4 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:34.100197 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a7934-ca51-43c2-a60e-241f47e1379a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:34.101210 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a7934-ca51-43c2-a60e-241f47e1379a admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:34.101620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a7934-ca51-43c2-a60e-241f47e1379a admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:34.102176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a7934-ca51-43c2-a60e-241f47e1379a admin admin] PATH_INFO: `/v3/projects/5b4cb4b1e0164ec9a7b1ebe356819e1f/users/080d04b2b98b40008269a0f6b13507d3/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:34.120169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a7934-ca51-43c2-a60e-241f47e1379a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b4cb4b1e0164ec9a7b1ebe356819e1f, user_id=080d04b2b98b40008269a0f6b13507d3, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:34.122782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a7934-ca51-43c2-a60e-241f47e1379a admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:34.144575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1077/2163] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:34 2022] PUT /identity/v3/projects/5b4cb4b1e0164ec9a7b1ebe356819e1f/users/080d04b2b98b40008269a0f6b13507d3/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:34.149824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcb79b-91f4-402b-a2fa-84e9c20feb5f admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:34.161730 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcb79b-91f4-402b-a2fa-84e9c20feb5f admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:34.216429 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:34.258730 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47434a-0272-45cc-91b2-d85673d457bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:34.259579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47434a-0272-45cc-91b2-d85673d457bb admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:34.259934 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47434a-0272-45cc-91b2-d85673d457bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:34.260284 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47434a-0272-45cc-91b2-d85673d457bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:34.261091 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47434a-0272-45cc-91b2-d85673d457bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:34.262861 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47434a-0272-45cc-91b2-d85673d457bb admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:34.277101 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1087/2164] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:34.282400 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a7934-ca51-43c2-a60e-241f47e1379a admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:34.303973 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a7934-ca51-43c2-a60e-241f47e1379a admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:34.316021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e65420-87a7-4982-8576-7f4e32cf998f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:34.318495 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e65420-87a7-4982-8576-7f4e32cf998f admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:34.318784 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e65420-87a7-4982-8576-7f4e32cf998f admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:34.319068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e65420-87a7-4982-8576-7f4e32cf998f admin admin] PATH_INFO: `/v3/projects/5b4cb4b1e0164ec9a7b1ebe356819e1f/users/080d04b2b98b40008269a0f6b13507d3/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:34.329611 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e65420-87a7-4982-8576-7f4e32cf998f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b4cb4b1e0164ec9a7b1ebe356819e1f, user_id=080d04b2b98b40008269a0f6b13507d3, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:34.336179 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e65420-87a7-4982-8576-7f4e32cf998f admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:34.346532 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47434a-0272-45cc-91b2-d85673d457bb admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:34.349364 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-bf47434a-0272-45cc-91b2-d85673d457bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:34.351555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1078/2165] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:34 2022] PUT /identity/v3/projects/5b4cb4b1e0164ec9a7b1ebe356819e1f/users/080d04b2b98b40008269a0f6b13507d3/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:34.377554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47434a-0272-45cc-91b2-d85673d457bb admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:34.460797 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778217eb-00ae-4954-b0a5-3614fe17e31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:34.462145 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778217eb-00ae-4954-b0a5-3614fe17e31b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:34.462621 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778217eb-00ae-4954-b0a5-3614fe17e31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:34.463053 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778217eb-00ae-4954-b0a5-3614fe17e31b admin admin] PATH_INFO: `/v3/projects/c26b7b85a66945e9b3fe133a3b58c6cc` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:34.465358 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778217eb-00ae-4954-b0a5-3614fe17e31b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c26b7b85a66945e9b3fe133a3b58c6cc)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:34.468896 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778217eb-00ae-4954-b0a5-3614fe17e31b admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:34.526518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-778217eb-00ae-4954-b0a5-3614fe17e31b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c26b7b85a66945e9b3fe133a3b58c6cc', 'request_id': 'req-778217eb-00ae-4954-b0a5-3614fe17e31b'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:34.533012 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-778217eb-00ae-4954-b0a5-3614fe17e31b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c26b7b85a66945e9b3fe133a3b58c6cc', 'request_id': 'req-778217eb-00ae-4954-b0a5-3614fe17e31b'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:34.543845 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-778217eb-00ae-4954-b0a5-3614fe17e31b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c26b7b85a66945e9b3fe133a3b58c6cc', 'request_id': 'req-778217eb-00ae-4954-b0a5-3614fe17e31b'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:34.557472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-778217eb-00ae-4954-b0a5-3614fe17e31b admin admin] The token cache is being invalidate because project c26b7b85a66945e9b3fe133a3b58c6cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:34.557702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-778217eb-00ae-4954-b0a5-3614fe17e31b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:34.558386 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-778217eb-00ae-4954-b0a5-3614fe17e31b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:34.560885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1088/2166] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:34 2022] DELETE /identity/v3/projects/c26b7b85a66945e9b3fe133a3b58c6cc => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:05:34.566378 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027d7ed-1abb-4ba7-90aa-aef04a4aaab6 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:34.566695 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027d7ed-1abb-4ba7-90aa-aef04a4aaab6 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:34.566986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027d7ed-1abb-4ba7-90aa-aef04a4aaab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:34.587097 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-4027d7ed-1abb-4ba7-90aa-aef04a4aaab6 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:34.588446 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-4027d7ed-1abb-4ba7-90aa-aef04a4aaab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:34.657846 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1079/2167] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:34.666904 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a04aac-b7fb-491a-99b4-549165d9da01 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:34.667204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a04aac-b7fb-491a-99b4-549165d9da01 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:34.667505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a04aac-b7fb-491a-99b4-549165d9da01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:34.689627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-60a04aac-b7fb-491a-99b4-549165d9da01 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:34.690914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-60a04aac-b7fb-491a-99b4-549165d9da01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:34.699471 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1089/2168] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:34.704550 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027d7ed-1abb-4ba7-90aa-aef04a4aaab6 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:34.717845 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027d7ed-1abb-4ba7-90aa-aef04a4aaab6 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:34.725071 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62599f29-dddb-4844-887d-ac076c07c75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:34.725773 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62599f29-dddb-4844-887d-ac076c07c75d admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:34.726057 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62599f29-dddb-4844-887d-ac076c07c75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:34.726441 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62599f29-dddb-4844-887d-ac076c07c75d admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:34.728349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62599f29-dddb-4844-887d-ac076c07c75d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:05:34.728676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62599f29-dddb-4844-887d-ac076c07c75d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:34.730314 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62599f29-dddb-4844-887d-ac076c07c75d admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:34.746986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1080/2169] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:05:34.748291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a04aac-b7fb-491a-99b4-549165d9da01 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:34.758118 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a04aac-b7fb-491a-99b4-549165d9da01 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:34.763200 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbfaac-c297-44c0-a26f-0a7152ed1721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:34.763909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbfaac-c297-44c0-a26f-0a7152ed1721 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:34.764199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbfaac-c297-44c0-a26f-0a7152ed1721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:34.764476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbfaac-c297-44c0-a26f-0a7152ed1721 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:34.765173 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dbfaac-c297-44c0-a26f-0a7152ed1721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:34.767112 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dbfaac-c297-44c0-a26f-0a7152ed1721 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:34.797319 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1090/2170] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:34 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:05:34.802051 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62599f29-dddb-4844-887d-ac076c07c75d admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:34.815044 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62599f29-dddb-4844-887d-ac076c07c75d admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:34.880265 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02ae1f-e4ce-4df8-add2-17f0cb328ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:34.881016 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02ae1f-e4ce-4df8-add2-17f0cb328ecf admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:34.881296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02ae1f-e4ce-4df8-add2-17f0cb328ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:34.881570 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02ae1f-e4ce-4df8-add2-17f0cb328ecf admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:34.882282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02ae1f-e4ce-4df8-add2-17f0cb328ecf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:34.884953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02ae1f-e4ce-4df8-add2-17f0cb328ecf admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:34.911993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1081/2171] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:34 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:34.916521 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbfaac-c297-44c0-a26f-0a7152ed1721 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:34.937022 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbfaac-c297-44c0-a26f-0a7152ed1721 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:34.943014 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ec491-e2ab-494e-be68-71f7097c7a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:34.943662 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ec491-e2ab-494e-be68-71f7097c7a86 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:34.943940 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ec491-e2ab-494e-be68-71f7097c7a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:34.944238 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ec491-e2ab-494e-be68-71f7097c7a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:34.944974 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ec491-e2ab-494e-be68-71f7097c7a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:34.946736 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ec491-e2ab-494e-be68-71f7097c7a86 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:34.964209 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02ae1f-e4ce-4df8-add2-17f0cb328ecf admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:34.971961 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1091/2172] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:34.978190 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02ae1f-e4ce-4df8-add2-17f0cb328ecf admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:34.992515 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45cb17-d164-455f-820e-c68969e0b2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:34.993305 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45cb17-d164-455f-820e-c68969e0b2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:34.993604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45cb17-d164-455f-820e-c68969e0b2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:34.993880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45cb17-d164-455f-820e-c68969e0b2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:34.994989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45cb17-d164-455f-820e-c68969e0b2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:34.996744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45cb17-d164-455f-820e-c68969e0b2a1 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:35.014075 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1082/2173] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:05:35.016080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ec491-e2ab-494e-be68-71f7097c7a86 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:35.028784 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ec491-e2ab-494e-be68-71f7097c7a86 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:35.039219 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4831e-99af-420c-8a35-d1934dc99872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:35.041315 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4831e-99af-420c-8a35-d1934dc99872 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:35.042994 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4831e-99af-420c-8a35-d1934dc99872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:35.043275 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4831e-99af-420c-8a35-d1934dc99872 admin admin] PATH_INFO: `/v3/projects/494e8d5fcde94916be0f243aa50831ba/users/efef63ce8b2e4169aeda79cf33b62b58/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:35.089093 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4831e-99af-420c-8a35-d1934dc99872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=494e8d5fcde94916be0f243aa50831ba, user_id=efef63ce8b2e4169aeda79cf33b62b58, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:35.093277 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4831e-99af-420c-8a35-d1934dc99872 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:35.110743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:35.127336 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b21da-7514-441c-9916-e20fdf2812e3 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:35.128056 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b21da-7514-441c-9916-e20fdf2812e3 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:35.130020 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b21da-7514-441c-9916-e20fdf2812e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:35.144850 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1092/2174] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:35 2022] PUT /identity/v3/projects/494e8d5fcde94916be0f243aa50831ba/users/efef63ce8b2e4169aeda79cf33b62b58/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:35.157083 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad7c50-6b4e-4f5f-8573-16315b9fabf6 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:35.157377 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad7c50-6b4e-4f5f-8573-16315b9fabf6 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:35.157829 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad7c50-6b4e-4f5f-8573-16315b9fabf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:35.178587 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:35.182395 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-a47b21da-7514-441c-9916-e20fdf2812e3 None None] MFA Rules not processed for user `080d04b2b98b40008269a0f6b13507d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:35.184498 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a47b21da-7514-441c-9916-e20fdf2812e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:35.216083 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-36ad7c50-6b4e-4f5f-8573-16315b9fabf6 None None] MFA Rules not processed for user `efef63ce8b2e4169aeda79cf33b62b58`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:35.220923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-36ad7c50-6b4e-4f5f-8573-16315b9fabf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:35.337269 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1083/2175] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:35.363004 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012311e3-11f1-4c6b-91b8-e4f55aa58c8a None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:35.364217 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012311e3-11f1-4c6b-91b8-e4f55aa58c8a None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:35.365257 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012311e3-11f1-4c6b-91b8-e4f55aa58c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:35.391808 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-012311e3-11f1-4c6b-91b8-e4f55aa58c8a None None] MFA Rules not processed for user `6c22158da5fc45a5b80010e32b38689c`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:35.393156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-012311e3-11f1-4c6b-91b8-e4f55aa58c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:35.404997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1093/2176] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:05:35.406152 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad7c50-6b4e-4f5f-8573-16315b9fabf6 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:35.486562 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1084/2177] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:05:35.493840 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012311e3-11f1-4c6b-91b8-e4f55aa58c8a None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:35.496002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-012311e3-11f1-4c6b-91b8-e4f55aa58c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:35.503870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad7c50-6b4e-4f5f-8573-16315b9fabf6 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:35.510795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef60b75-9df6-4e3e-86a4-3118f971221a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:35.511606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef60b75-9df6-4e3e-86a4-3118f971221a admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:35.511892 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef60b75-9df6-4e3e-86a4-3118f971221a admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:35.512170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef60b75-9df6-4e3e-86a4-3118f971221a admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:35.512971 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef60b75-9df6-4e3e-86a4-3118f971221a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:35.515448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef60b75-9df6-4e3e-86a4-3118f971221a admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:35.546897 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1094/2178] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:35 2022] POST /identity/v3/projects => generated 391 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:35.551001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef60b75-9df6-4e3e-86a4-3118f971221a admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:35.596998 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012311e3-11f1-4c6b-91b8-e4f55aa58c8a None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:35.620539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef60b75-9df6-4e3e-86a4-3118f971221a admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:35.626261 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21b33e-72ff-4dfc-b86a-9070a3a25c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:35.627043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21b33e-72ff-4dfc-b86a-9070a3a25c8e admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:35.627391 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21b33e-72ff-4dfc-b86a-9070a3a25c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:35.627873 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21b33e-72ff-4dfc-b86a-9070a3a25c8e admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:35.628830 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21b33e-72ff-4dfc-b86a-9070a3a25c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:35.631202 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21b33e-72ff-4dfc-b86a-9070a3a25c8e admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:35.642069 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:35.658678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1095/2179] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:35 2022] POST /identity/v3/users => generated 302 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:05:35.662538 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21b33e-72ff-4dfc-b86a-9070a3a25c8e admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:35.669523 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:35.674272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f400a-8a24-4576-b83d-9e2fcc3b2ed9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:35.674958 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f400a-8a24-4576-b83d-9e2fcc3b2ed9 service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:35.676019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f400a-8a24-4576-b83d-9e2fcc3b2ed9 service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:35.676301 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f400a-8a24-4576-b83d-9e2fcc3b2ed9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:35.678393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-737f400a-8a24-4576-b83d-9e2fcc3b2ed9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:35.679837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21b33e-72ff-4dfc-b86a-9070a3a25c8e admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:35.690857 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7de88b-b187-4262-9ca2-7b69a85287e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:35.691869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7de88b-b187-4262-9ca2-7b69a85287e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:35.692229 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7de88b-b187-4262-9ca2-7b69a85287e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:35.692578 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7de88b-b187-4262-9ca2-7b69a85287e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:35.693399 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7de88b-b187-4262-9ca2-7b69a85287e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:35.695097 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7de88b-b187-4262-9ca2-7b69a85287e7 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:35.708342 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1096/2180] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:35.712843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7de88b-b187-4262-9ca2-7b69a85287e7 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:35.724161 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7de88b-b187-4262-9ca2-7b69a85287e7 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:35.728873 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96991642-14cc-4a1a-94b0-4ba7483a9111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:35.729779 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96991642-14cc-4a1a-94b0-4ba7483a9111 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:35.730064 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96991642-14cc-4a1a-94b0-4ba7483a9111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:35.730341 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96991642-14cc-4a1a-94b0-4ba7483a9111 admin admin] PATH_INFO: `/v3/projects/8af6f74892c34df4a53672f63d0f00f2/users/28d1daa1a90c4c7c9150270b9a04b77e/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:35.745685 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96991642-14cc-4a1a-94b0-4ba7483a9111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8af6f74892c34df4a53672f63d0f00f2, user_id=28d1daa1a90c4c7c9150270b9a04b77e, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:35.748457 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96991642-14cc-4a1a-94b0-4ba7483a9111 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:35.750422 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f400a-8a24-4576-b83d-9e2fcc3b2ed9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:35.751613 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f400a-8a24-4576-b83d-9e2fcc3b2ed9 service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:35.762849 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1085/2181] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:35.764933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1097/2182] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:35 2022] PUT /identity/v3/projects/8af6f74892c34df4a53672f63d0f00f2/users/28d1daa1a90c4c7c9150270b9a04b77e/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:05:35.768816 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f400a-8a24-4576-b83d-9e2fcc3b2ed9 service nova] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:35.783138 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f400a-8a24-4576-b83d-9e2fcc3b2ed9 service nova] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:35.848972 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1254076-f196-42b7-983c-0549aab7a852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:35.849669 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1254076-f196-42b7-983c-0549aab7a852 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:35.849952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1254076-f196-42b7-983c-0549aab7a852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:35.850225 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1254076-f196-42b7-983c-0549aab7a852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:35.850967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1254076-f196-42b7-983c-0549aab7a852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:35.852765 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1254076-f196-42b7-983c-0549aab7a852 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:35.865822 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1086/2183] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:35.867245 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96991642-14cc-4a1a-94b0-4ba7483a9111 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:35.877507 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96991642-14cc-4a1a-94b0-4ba7483a9111 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:35.882586 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75824257-4823-46eb-ab76-87d0a7a5e9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:35.883636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75824257-4823-46eb-ab76-87d0a7a5e9c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:35.883997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75824257-4823-46eb-ab76-87d0a7a5e9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:35.884348 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75824257-4823-46eb-ab76-87d0a7a5e9c6 admin admin] PATH_INFO: `/v3/projects/8af6f74892c34df4a53672f63d0f00f2/users/28d1daa1a90c4c7c9150270b9a04b77e/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:35.886396 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75824257-4823-46eb-ab76-87d0a7a5e9c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8af6f74892c34df4a53672f63d0f00f2, user_id=28d1daa1a90c4c7c9150270b9a04b77e, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:35.889125 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75824257-4823-46eb-ab76-87d0a7a5e9c6 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:35.901383 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1098/2184] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:35 2022] PUT /identity/v3/projects/8af6f74892c34df4a53672f63d0f00f2/users/28d1daa1a90c4c7c9150270b9a04b77e/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:35.912426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae8936-9d1c-4ada-8ee9-e21c54fa763a None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:35.912852 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae8936-9d1c-4ada-8ee9-e21c54fa763a None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:35.912961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae8936-9d1c-4ada-8ee9-e21c54fa763a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:35.944284 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-70ae8936-9d1c-4ada-8ee9-e21c54fa763a None None] MFA Rules not processed for user `28d1daa1a90c4c7c9150270b9a04b77e`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:35.945496 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-70ae8936-9d1c-4ada-8ee9-e21c54fa763a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:36.016064 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:36.023630 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1087/2185] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:36.032372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75824257-4823-46eb-ab76-87d0a7a5e9c6 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:36.034626 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-75824257-4823-46eb-ab76-87d0a7a5e9c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:36.105401 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75824257-4823-46eb-ab76-87d0a7a5e9c6 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:36.109918 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29638697-a76e-42b9-bc11-2417c8be9a04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:36.110600 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29638697-a76e-42b9-bc11-2417c8be9a04 service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:36.110917 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29638697-a76e-42b9-bc11-2417c8be9a04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:36.111191 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29638697-a76e-42b9-bc11-2417c8be9a04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:36.122160 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29638697-a76e-42b9-bc11-2417c8be9a04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:36.123718 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29638697-a76e-42b9-bc11-2417c8be9a04 service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:36.135428 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1099/2186] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:36.186964 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae8936-9d1c-4ada-8ee9-e21c54fa763a None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:36.188623 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-70ae8936-9d1c-4ada-8ee9-e21c54fa763a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:36.203208 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae8936-9d1c-4ada-8ee9-e21c54fa763a None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:36.207801 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc438122-9b48-41e8-ab0e-45e6aaf55c31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:36.208663 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc438122-9b48-41e8-ab0e-45e6aaf55c31 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:36.209016 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc438122-9b48-41e8-ab0e-45e6aaf55c31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:36.209365 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc438122-9b48-41e8-ab0e-45e6aaf55c31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:36.300274 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc438122-9b48-41e8-ab0e-45e6aaf55c31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:36.303722 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc438122-9b48-41e8-ab0e-45e6aaf55c31 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:36.315600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1088/2187] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:37.661199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29638697-a76e-42b9-bc11-2417c8be9a04 service cinder] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:37.662745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-29638697-a76e-42b9-bc11-2417c8be9a04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:37.734526 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29638697-a76e-42b9-bc11-2417c8be9a04 service cinder] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:37.740284 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df09c24-7809-441a-bd00-d55cd6de6192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:37.742038 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df09c24-7809-441a-bd00-d55cd6de6192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:37.742038 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df09c24-7809-441a-bd00-d55cd6de6192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:37.742038 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df09c24-7809-441a-bd00-d55cd6de6192 admin admin] PATH_INFO: `/v3/users/5e1654abac01497fab5fbbcfec987ee9` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:37.743271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df09c24-7809-441a-bd00-d55cd6de6192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e1654abac01497fab5fbbcfec987ee9)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:37.745433 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df09c24-7809-441a-bd00-d55cd6de6192 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:37.800001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-5df09c24-7809-441a-bd00-d55cd6de6192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e1654abac01497fab5fbbcfec987ee9'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:37.808245 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-5df09c24-7809-441a-bd00-d55cd6de6192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e1654abac01497fab5fbbcfec987ee9'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:37.809081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-5df09c24-7809-441a-bd00-d55cd6de6192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e1654abac01497fab5fbbcfec987ee9'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:37.809712 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-5df09c24-7809-441a-bd00-d55cd6de6192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e1654abac01497fab5fbbcfec987ee9'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:37.812378 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:37.830013 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-5df09c24-7809-441a-bd00-d55cd6de6192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e1654abac01497fab5fbbcfec987ee9'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:37.851036 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1100/2188] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:37 2022] DELETE /identity/v3/users/5e1654abac01497fab5fbbcfec987ee9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:37.856113 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df1471-5d91-4180-93ae-6172f16784d7 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:37.858165 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df1471-5d91-4180-93ae-6172f16784d7 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:37.858342 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df1471-5d91-4180-93ae-6172f16784d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:37.878604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-88df1471-5d91-4180-93ae-6172f16784d7 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:37.880226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-88df1471-5d91-4180-93ae-6172f16784d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:37.946721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1089/2189] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:37.956781 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df09c24-7809-441a-bd00-d55cd6de6192 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:37.965038 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5df09c24-7809-441a-bd00-d55cd6de6192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:38.025889 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df09c24-7809-441a-bd00-d55cd6de6192 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:38.029933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd22dad-63a2-4af8-bcdc-ab92a5f88542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:38.030595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd22dad-63a2-4af8-bcdc-ab92a5f88542 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:38.030975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd22dad-63a2-4af8-bcdc-ab92a5f88542 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:38.031291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd22dad-63a2-4af8-bcdc-ab92a5f88542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:38.043287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd22dad-63a2-4af8-bcdc-ab92a5f88542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:38.044844 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd22dad-63a2-4af8-bcdc-ab92a5f88542 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:38.056611 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1101/2190] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:38.328078 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df1471-5d91-4180-93ae-6172f16784d7 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:38.329619 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-88df1471-5d91-4180-93ae-6172f16784d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:38.343209 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df1471-5d91-4180-93ae-6172f16784d7 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:38.348098 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af949d37-48ff-471c-8329-81b2f617f104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:38.348978 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af949d37-48ff-471c-8329-81b2f617f104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:38.349233 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af949d37-48ff-471c-8329-81b2f617f104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:38.349520 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af949d37-48ff-471c-8329-81b2f617f104 admin admin] PATH_INFO: `/v3/projects/0a3c60d0bc85442085b716e51024da6e` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:38.350741 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af949d37-48ff-471c-8329-81b2f617f104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a3c60d0bc85442085b716e51024da6e)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:38.353740 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af949d37-48ff-471c-8329-81b2f617f104 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:38.410367 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-af949d37-48ff-471c-8329-81b2f617f104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a3c60d0bc85442085b716e51024da6e', 'request_id': 'req-af949d37-48ff-471c-8329-81b2f617f104'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:38.417965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-af949d37-48ff-471c-8329-81b2f617f104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a3c60d0bc85442085b716e51024da6e', 'request_id': 'req-af949d37-48ff-471c-8329-81b2f617f104'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:38.424239 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-af949d37-48ff-471c-8329-81b2f617f104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a3c60d0bc85442085b716e51024da6e', 'request_id': 'req-af949d37-48ff-471c-8329-81b2f617f104'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:38.435883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-af949d37-48ff-471c-8329-81b2f617f104 admin admin] The token cache is being invalidate because project 0a3c60d0bc85442085b716e51024da6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:38.436168 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-af949d37-48ff-471c-8329-81b2f617f104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:38.436806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-af949d37-48ff-471c-8329-81b2f617f104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:38.438723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1090/2191] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:38 2022] DELETE /identity/v3/projects/0a3c60d0bc85442085b716e51024da6e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:38.444606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25ec51-51ea-48a5-8995-10125e24963f None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:38.446168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25ec51-51ea-48a5-8995-10125e24963f None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:38.446446 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25ec51-51ea-48a5-8995-10125e24963f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:38.464548 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-7e25ec51-51ea-48a5-8995-10125e24963f None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:38.465784 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-7e25ec51-51ea-48a5-8995-10125e24963f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:38.532944 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1102/2192] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:38.542169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bceba-1981-409d-b24b-b9e5150d5847 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:38.542524 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bceba-1981-409d-b24b-b9e5150d5847 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:38.542896 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bceba-1981-409d-b24b-b9e5150d5847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:38.573076 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-614bceba-1981-409d-b24b-b9e5150d5847 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:38.575037 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-614bceba-1981-409d-b24b-b9e5150d5847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:38.583714 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1091/2193] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:38.588423 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25ec51-51ea-48a5-8995-10125e24963f None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:38.600072 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25ec51-51ea-48a5-8995-10125e24963f None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:38.606092 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6f0f4-2865-46c6-99b3-67f015a92352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:38.606858 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6f0f4-2865-46c6-99b3-67f015a92352 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:38.607112 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6f0f4-2865-46c6-99b3-67f015a92352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:38.607384 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6f0f4-2865-46c6-99b3-67f015a92352 admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:38.608319 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6f0f4-2865-46c6-99b3-67f015a92352 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:05:38.608745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6f0f4-2865-46c6-99b3-67f015a92352 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:38.610360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6f0f4-2865-46c6-99b3-67f015a92352 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:38.626772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1103/2194] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:05:38.632167 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614bceba-1981-409d-b24b-b9e5150d5847 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:38.643682 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614bceba-1981-409d-b24b-b9e5150d5847 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:38.650239 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64bf59-5f15-44a2-8177-bbfbfd4fdd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:38.650935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64bf59-5f15-44a2-8177-bbfbfd4fdd64 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:38.651222 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64bf59-5f15-44a2-8177-bbfbfd4fdd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:38.651956 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64bf59-5f15-44a2-8177-bbfbfd4fdd64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:38.652862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64bf59-5f15-44a2-8177-bbfbfd4fdd64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:38.654812 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64bf59-5f15-44a2-8177-bbfbfd4fdd64 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:38.670800 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:38.692010 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1092/2195] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:38 2022] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:38.693448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6f0f4-2865-46c6-99b3-67f015a92352 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:38.704285 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6f0f4-2865-46c6-99b3-67f015a92352 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:38.782217 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcac04-f899-4f2f-b977-7f67d5a2ab89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:38.782925 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcac04-f899-4f2f-b977-7f67d5a2ab89 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:38.783251 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcac04-f899-4f2f-b977-7f67d5a2ab89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:38.783572 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcac04-f899-4f2f-b977-7f67d5a2ab89 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:38.784252 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcac04-f899-4f2f-b977-7f67d5a2ab89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:38.786519 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcac04-f899-4f2f-b977-7f67d5a2ab89 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:38.796917 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:38.813737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1104/2196] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:38 2022] POST /identity/v3/users => generated 296 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:38.817601 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64bf59-5f15-44a2-8177-bbfbfd4fdd64 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:38.828249 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64bf59-5f15-44a2-8177-bbfbfd4fdd64 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:38.833530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc713be9-3def-4230-81aa-9728d0208b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:38.834215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc713be9-3def-4230-81aa-9728d0208b19 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:38.834502 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc713be9-3def-4230-81aa-9728d0208b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:38.835150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc713be9-3def-4230-81aa-9728d0208b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:38.835546 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc713be9-3def-4230-81aa-9728d0208b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:38.837165 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc713be9-3def-4230-81aa-9728d0208b19 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:38.849079 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1093/2197] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:05:38.853361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcac04-f899-4f2f-b977-7f67d5a2ab89 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:38.864243 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcac04-f899-4f2f-b977-7f67d5a2ab89 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:38.869660 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6e270-2892-4423-9cb4-38fc56eb8c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:38.870439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6e270-2892-4423-9cb4-38fc56eb8c19 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:38.870794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6e270-2892-4423-9cb4-38fc56eb8c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:38.871081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6e270-2892-4423-9cb4-38fc56eb8c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:38.871948 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6e270-2892-4423-9cb4-38fc56eb8c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:38.873659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6e270-2892-4423-9cb4-38fc56eb8c19 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:38.886848 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1105/2198] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:38.891326 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc713be9-3def-4230-81aa-9728d0208b19 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:38.901594 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc713be9-3def-4230-81aa-9728d0208b19 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:38.906306 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bada2-49ff-4560-9673-b8edb0f9f9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:38.907200 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bada2-49ff-4560-9673-b8edb0f9f9d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:38.907520 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bada2-49ff-4560-9673-b8edb0f9f9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:38.907803 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bada2-49ff-4560-9673-b8edb0f9f9d0 admin admin] PATH_INFO: `/v3/projects/4e7bf560bc304ec9a7582adedf2c8cd1/users/f1bd40095831445cacf4bb7ccbcd2fbc/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:38.924092 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9bada2-49ff-4560-9673-b8edb0f9f9d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e7bf560bc304ec9a7582adedf2c8cd1, user_id=f1bd40095831445cacf4bb7ccbcd2fbc, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:38.926849 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9bada2-49ff-4560-9673-b8edb0f9f9d0 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:38.945769 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1094/2199] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:38 2022] PUT /identity/v3/projects/4e7bf560bc304ec9a7582adedf2c8cd1/users/f1bd40095831445cacf4bb7ccbcd2fbc/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:38.957163 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd119f94-83e4-4433-bf19-4aa374043e18 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:38.957448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd119f94-83e4-4433-bf19-4aa374043e18 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:38.957723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd119f94-83e4-4433-bf19-4aa374043e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:38.985769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-fd119f94-83e4-4433-bf19-4aa374043e18 None None] MFA Rules not processed for user `f1bd40095831445cacf4bb7ccbcd2fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:38.987134 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-fd119f94-83e4-4433-bf19-4aa374043e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:39.055594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1106/2200] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:05:39.068375 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bada2-49ff-4560-9673-b8edb0f9f9d0 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:39.070469 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-0e9bada2-49ff-4560-9673-b8edb0f9f9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:39.132911 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bada2-49ff-4560-9673-b8edb0f9f9d0 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:39.136762 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787f290-2a49-4293-85c6-c11b3a5b32b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:39.137580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787f290-2a49-4293-85c6-c11b3a5b32b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:39.137869 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787f290-2a49-4293-85c6-c11b3a5b32b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:39.138175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787f290-2a49-4293-85c6-c11b3a5b32b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:39.148258 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787f290-2a49-4293-85c6-c11b3a5b32b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:39.149719 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787f290-2a49-4293-85c6-c11b3a5b32b5 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:39.158995 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1095/2201] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:39.806034 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd119f94-83e4-4433-bf19-4aa374043e18 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:39.807882 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-fd119f94-83e4-4433-bf19-4aa374043e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:39.877055 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd119f94-83e4-4433-bf19-4aa374043e18 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:39.882246 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c367b9-92d3-4aea-950f-01e709237fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:39.883179 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c367b9-92d3-4aea-950f-01e709237fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:39.883719 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c367b9-92d3-4aea-950f-01e709237fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:39.883921 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c367b9-92d3-4aea-950f-01e709237fa0 admin admin] PATH_INFO: `/v3/users/efef63ce8b2e4169aeda79cf33b62b58` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:39.884966 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c367b9-92d3-4aea-950f-01e709237fa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efef63ce8b2e4169aeda79cf33b62b58)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:39.887029 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c367b9-92d3-4aea-950f-01e709237fa0 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:39.940986 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-68c367b9-92d3-4aea-950f-01e709237fa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efef63ce8b2e4169aeda79cf33b62b58'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:39.952925 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-68c367b9-92d3-4aea-950f-01e709237fa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efef63ce8b2e4169aeda79cf33b62b58'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:39.953644 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-68c367b9-92d3-4aea-950f-01e709237fa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efef63ce8b2e4169aeda79cf33b62b58'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:39.954252 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-68c367b9-92d3-4aea-950f-01e709237fa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efef63ce8b2e4169aeda79cf33b62b58'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:39.966155 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-68c367b9-92d3-4aea-950f-01e709237fa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efef63ce8b2e4169aeda79cf33b62b58'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:39.968741 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:39.984783 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1107/2202] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:39 2022] DELETE /identity/v3/users/efef63ce8b2e4169aeda79cf33b62b58 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:39.989843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2c5d9-a3db-45b6-98a3-9f2031cbce88 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:39.990561 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2c5d9-a3db-45b6-98a3-9f2031cbce88 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:39.990903 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2c5d9-a3db-45b6-98a3-9f2031cbce88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:40.009295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-c8a2c5d9-a3db-45b6-98a3-9f2031cbce88 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:40.010516 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-c8a2c5d9-a3db-45b6-98a3-9f2031cbce88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:40.072099 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1096/2203] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:40.081890 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c367b9-92d3-4aea-950f-01e709237fa0 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:40.083495 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-68c367b9-92d3-4aea-950f-01e709237fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:40.140615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c367b9-92d3-4aea-950f-01e709237fa0 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:40.145116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe229f2-f62f-4fbd-935b-ea8b40525157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:40.145769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe229f2-f62f-4fbd-935b-ea8b40525157 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:40.146048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe229f2-f62f-4fbd-935b-ea8b40525157 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:40.146318 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe229f2-f62f-4fbd-935b-ea8b40525157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:40.155658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe229f2-f62f-4fbd-935b-ea8b40525157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:40.157109 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe229f2-f62f-4fbd-935b-ea8b40525157 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:40.166897 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1108/2204] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:40.476444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2c5d9-a3db-45b6-98a3-9f2031cbce88 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:40.477991 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-c8a2c5d9-a3db-45b6-98a3-9f2031cbce88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:40.492272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2c5d9-a3db-45b6-98a3-9f2031cbce88 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:40.498613 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8e430-9420-4763-98ac-03d0c3fe60c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:40.499541 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8e430-9420-4763-98ac-03d0c3fe60c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:40.499826 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8e430-9420-4763-98ac-03d0c3fe60c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:40.500104 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8e430-9420-4763-98ac-03d0c3fe60c3 admin admin] PATH_INFO: `/v3/projects/494e8d5fcde94916be0f243aa50831ba` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:40.501305 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8e430-9420-4763-98ac-03d0c3fe60c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=494e8d5fcde94916be0f243aa50831ba)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:40.503225 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8e430-9420-4763-98ac-03d0c3fe60c3 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:40.553894 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-b5e8e430-9420-4763-98ac-03d0c3fe60c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '494e8d5fcde94916be0f243aa50831ba', 'request_id': 'req-b5e8e430-9420-4763-98ac-03d0c3fe60c3'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:40.562408 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-b5e8e430-9420-4763-98ac-03d0c3fe60c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '494e8d5fcde94916be0f243aa50831ba', 'request_id': 'req-b5e8e430-9420-4763-98ac-03d0c3fe60c3'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:40.563679 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:40.570617 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-b5e8e430-9420-4763-98ac-03d0c3fe60c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '494e8d5fcde94916be0f243aa50831ba', 'request_id': 'req-b5e8e430-9420-4763-98ac-03d0c3fe60c3'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:40.585098 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-b5e8e430-9420-4763-98ac-03d0c3fe60c3 admin admin] The token cache is being invalidate because project 494e8d5fcde94916be0f243aa50831ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:40.585393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-b5e8e430-9420-4763-98ac-03d0c3fe60c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:40.586072 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-b5e8e430-9420-4763-98ac-03d0c3fe60c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:40.587754 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1097/2205] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:40 2022] DELETE /identity/v3/projects/494e8d5fcde94916be0f243aa50831ba => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:40.593293 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe229f2-f62f-4fbd-935b-ea8b40525157 service neutron] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:40.603311 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe229f2-f62f-4fbd-935b-ea8b40525157 service neutron] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:40.675706 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62584ba7-6c2c-49d6-86cc-5677e2504a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:40.676642 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62584ba7-6c2c-49d6-86cc-5677e2504a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:40.676925 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62584ba7-6c2c-49d6-86cc-5677e2504a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:40.677202 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62584ba7-6c2c-49d6-86cc-5677e2504a7e admin admin] PATH_INFO: `/v3/users/28d1daa1a90c4c7c9150270b9a04b77e` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:40.678437 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62584ba7-6c2c-49d6-86cc-5677e2504a7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=28d1daa1a90c4c7c9150270b9a04b77e)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:40.680435 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62584ba7-6c2c-49d6-86cc-5677e2504a7e admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:40.731749 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-62584ba7-6c2c-49d6-86cc-5677e2504a7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28d1daa1a90c4c7c9150270b9a04b77e'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:40.738691 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-62584ba7-6c2c-49d6-86cc-5677e2504a7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28d1daa1a90c4c7c9150270b9a04b77e'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:40.739354 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-62584ba7-6c2c-49d6-86cc-5677e2504a7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28d1daa1a90c4c7c9150270b9a04b77e'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:40.739985 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-62584ba7-6c2c-49d6-86cc-5677e2504a7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28d1daa1a90c4c7c9150270b9a04b77e'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:40.751802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-62584ba7-6c2c-49d6-86cc-5677e2504a7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28d1daa1a90c4c7c9150270b9a04b77e'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:40.766481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1109/2206] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:40 2022] DELETE /identity/v3/users/28d1daa1a90c4c7c9150270b9a04b77e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:41.044640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8e430-9420-4763-98ac-03d0c3fe60c3 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:41.046752 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-b5e8e430-9420-4763-98ac-03d0c3fe60c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:41.078272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8e430-9420-4763-98ac-03d0c3fe60c3 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:41.143899 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe8a57-d18b-45b5-bfa1-dd7a16dd60da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:41.145011 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe8a57-d18b-45b5-bfa1-dd7a16dd60da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:41.145500 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe8a57-d18b-45b5-bfa1-dd7a16dd60da admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:41.146000 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe8a57-d18b-45b5-bfa1-dd7a16dd60da admin admin] PATH_INFO: `/v3/projects/8af6f74892c34df4a53672f63d0f00f2` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:41.147218 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe8a57-d18b-45b5-bfa1-dd7a16dd60da admin admin] RBAC: Authorizing `identity:delete_project(project_id=8af6f74892c34df4a53672f63d0f00f2)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:41.149224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe8a57-d18b-45b5-bfa1-dd7a16dd60da admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:41.200602 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-cdfe8a57-d18b-45b5-bfa1-dd7a16dd60da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8af6f74892c34df4a53672f63d0f00f2', 'request_id': 'req-cdfe8a57-d18b-45b5-bfa1-dd7a16dd60da'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:41.209637 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-cdfe8a57-d18b-45b5-bfa1-dd7a16dd60da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8af6f74892c34df4a53672f63d0f00f2', 'request_id': 'req-cdfe8a57-d18b-45b5-bfa1-dd7a16dd60da'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:41.215890 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-cdfe8a57-d18b-45b5-bfa1-dd7a16dd60da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8af6f74892c34df4a53672f63d0f00f2', 'request_id': 'req-cdfe8a57-d18b-45b5-bfa1-dd7a16dd60da'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:41.227468 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-cdfe8a57-d18b-45b5-bfa1-dd7a16dd60da admin admin] The token cache is being invalidate because project 8af6f74892c34df4a53672f63d0f00f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:41.227745 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-cdfe8a57-d18b-45b5-bfa1-dd7a16dd60da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:41.228397 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-cdfe8a57-d18b-45b5-bfa1-dd7a16dd60da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:41.229968 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1098/2207] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:41 2022] DELETE /identity/v3/projects/8af6f74892c34df4a53672f63d0f00f2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:05:41.235838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf2189-c9e1-45e2-9b36-83958e4ec613 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:41.236300 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf2189-c9e1-45e2-9b36-83958e4ec613 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:41.236458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf2189-c9e1-45e2-9b36-83958e4ec613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:41.255557 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-08bf2189-c9e1-45e2-9b36-83958e4ec613 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:41.256815 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-08bf2189-c9e1-45e2-9b36-83958e4ec613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:41.266993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:41.322589 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1110/2208] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:41.330748 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bb201-b7ac-49cc-8f5e-017dd5b3161e None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:41.331037 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bb201-b7ac-49cc-8f5e-017dd5b3161e None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:41.331329 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bb201-b7ac-49cc-8f5e-017dd5b3161e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:41.351461 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-df7bb201-b7ac-49cc-8f5e-017dd5b3161e None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:41.352717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-df7bb201-b7ac-49cc-8f5e-017dd5b3161e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:41.365614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1099/2209] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:41.367612 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf2189-c9e1-45e2-9b36-83958e4ec613 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:41.382227 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf2189-c9e1-45e2-9b36-83958e4ec613 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:41.387710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1f548-8a02-47c6-9b41-6e741dcf008b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:41.388408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1f548-8a02-47c6-9b41-6e741dcf008b admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:41.388683 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1f548-8a02-47c6-9b41-6e741dcf008b admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:41.389028 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1f548-8a02-47c6-9b41-6e741dcf008b admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:41.390214 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1f548-8a02-47c6-9b41-6e741dcf008b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:05:41.390690 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1f548-8a02-47c6-9b41-6e741dcf008b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:41.392507 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1f548-8a02-47c6-9b41-6e741dcf008b admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:41.411996 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1111/2210] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:05:41.416791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bb201-b7ac-49cc-8f5e-017dd5b3161e None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:41.427856 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bb201-b7ac-49cc-8f5e-017dd5b3161e None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:41.433455 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206f00f-62fc-4cdf-9df9-9bd940da7cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:41.434152 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206f00f-62fc-4cdf-9df9-9bd940da7cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:41.434458 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206f00f-62fc-4cdf-9df9-9bd940da7cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:41.434766 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206f00f-62fc-4cdf-9df9-9bd940da7cd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:41.435553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206f00f-62fc-4cdf-9df9-9bd940da7cd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:41.437703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206f00f-62fc-4cdf-9df9-9bd940da7cd7 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:41.465324 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1100/2211] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:41 2022] POST /identity/v3/projects => generated 407 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:41.469775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1f548-8a02-47c6-9b41-6e741dcf008b admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:41.480405 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1f548-8a02-47c6-9b41-6e741dcf008b admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:41.540417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75452b40-6326-4eda-8308-9f0867544b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:41.541098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75452b40-6326-4eda-8308-9f0867544b34 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:41.541381 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75452b40-6326-4eda-8308-9f0867544b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:41.541659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75452b40-6326-4eda-8308-9f0867544b34 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:41.542356 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75452b40-6326-4eda-8308-9f0867544b34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:41.544400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75452b40-6326-4eda-8308-9f0867544b34 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:41.573413 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1112/2212] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:41 2022] POST /identity/v3/users => generated 304 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:41.579403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206f00f-62fc-4cdf-9df9-9bd940da7cd7 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:41.590792 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206f00f-62fc-4cdf-9df9-9bd940da7cd7 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:41.595673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505aa186-aa00-44d1-830c-6529dfe52a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:41.596340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505aa186-aa00-44d1-830c-6529dfe52a96 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:41.596623 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505aa186-aa00-44d1-830c-6529dfe52a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:41.596890 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505aa186-aa00-44d1-830c-6529dfe52a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:41.597838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505aa186-aa00-44d1-830c-6529dfe52a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:41.599487 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505aa186-aa00-44d1-830c-6529dfe52a96 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:41.609906 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1101/2213] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:41.614118 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75452b40-6326-4eda-8308-9f0867544b34 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:41.624929 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75452b40-6326-4eda-8308-9f0867544b34 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:41.630226 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5da79-a9d6-4642-a6b8-45c07750c238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:41.630904 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5da79-a9d6-4642-a6b8-45c07750c238 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:41.631182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5da79-a9d6-4642-a6b8-45c07750c238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:41.631455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5da79-a9d6-4642-a6b8-45c07750c238 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:41.632223 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5da79-a9d6-4642-a6b8-45c07750c238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:41.633872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5da79-a9d6-4642-a6b8-45c07750c238 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:41.644656 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1113/2214] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:41.649243 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505aa186-aa00-44d1-830c-6529dfe52a96 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:41.659622 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505aa186-aa00-44d1-830c-6529dfe52a96 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:41.664502 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba2bf6-d25d-4140-8b54-ffc949d1e882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:41.665395 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba2bf6-d25d-4140-8b54-ffc949d1e882 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:41.665655 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba2bf6-d25d-4140-8b54-ffc949d1e882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:41.665947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba2bf6-d25d-4140-8b54-ffc949d1e882 admin admin] PATH_INFO: `/v3/projects/e456d5bcf0a14377b69382844d0ded36/users/2cf62822fc48451991600872c10e0379/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:41.681752 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba2bf6-d25d-4140-8b54-ffc949d1e882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e456d5bcf0a14377b69382844d0ded36, user_id=2cf62822fc48451991600872c10e0379, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:41.684457 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba2bf6-d25d-4140-8b54-ffc949d1e882 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:41.698201 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1102/2215] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:41 2022] PUT /identity/v3/projects/e456d5bcf0a14377b69382844d0ded36/users/2cf62822fc48451991600872c10e0379/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:41.709464 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d9d54-9373-4280-851d-f8c9df1a8ca9 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:41.709754 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d9d54-9373-4280-851d-f8c9df1a8ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:41.710092 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d9d54-9373-4280-851d-f8c9df1a8ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:41.740351 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-5f7d9d54-9373-4280-851d-f8c9df1a8ca9 None None] MFA Rules not processed for user `2cf62822fc48451991600872c10e0379`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:41.741566 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5f7d9d54-9373-4280-851d-f8c9df1a8ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:41.813608 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1114/2216] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:41 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:41.818704 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba2bf6-d25d-4140-8b54-ffc949d1e882 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:41.834274 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:41.907554 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba2bf6-d25d-4140-8b54-ffc949d1e882 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:41.912879 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2cafd-05da-4f3b-8620-11f4f8a1ebb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:41.913773 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2cafd-05da-4f3b-8620-11f4f8a1ebb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:41.914141 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2cafd-05da-4f3b-8620-11f4f8a1ebb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:41.914464 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2cafd-05da-4f3b-8620-11f4f8a1ebb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:41.915146 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2cafd-05da-4f3b-8620-11f4f8a1ebb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:41.917303 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2cafd-05da-4f3b-8620-11f4f8a1ebb5 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:41.958253 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1103/2217] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:41 2022] POST /identity/v3/projects => generated 409 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:41.960901 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d9d54-9373-4280-851d-f8c9df1a8ca9 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:41.977676 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d9d54-9373-4280-851d-f8c9df1a8ca9 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:41.987591 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:42.045889 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dad6ed-17df-41cc-8083-7571658382e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:42.046686 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dad6ed-17df-41cc-8083-7571658382e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:42.046969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dad6ed-17df-41cc-8083-7571658382e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:42.047239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dad6ed-17df-41cc-8083-7571658382e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:42.047968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dad6ed-17df-41cc-8083-7571658382e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:42.050579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dad6ed-17df-41cc-8083-7571658382e9 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:42.090967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1115/2218] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:41 2022] POST /identity/v3/users => generated 311 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:42.094954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2cafd-05da-4f3b-8620-11f4f8a1ebb5 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:42.106292 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2cafd-05da-4f3b-8620-11f4f8a1ebb5 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:42.122546 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890a829-fc15-48e0-ad3b-c705442d77e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:42.123255 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890a829-fc15-48e0-ad3b-c705442d77e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:42.123588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890a829-fc15-48e0-ad3b-c705442d77e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:42.123870 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890a829-fc15-48e0-ad3b-c705442d77e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:42.125160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890a829-fc15-48e0-ad3b-c705442d77e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:42.126773 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890a829-fc15-48e0-ad3b-c705442d77e1 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:42.142857 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1104/2219] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:05:42.144291 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dad6ed-17df-41cc-8083-7571658382e9 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:42.155756 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dad6ed-17df-41cc-8083-7571658382e9 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:42.162217 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecf277-0ced-4290-a964-9846cce62647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:42.163758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecf277-0ced-4290-a964-9846cce62647 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:42.163758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecf277-0ced-4290-a964-9846cce62647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:42.163935 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecf277-0ced-4290-a964-9846cce62647 admin admin] PATH_INFO: `/v3/projects/ee432f5951c74a60b121a6be4a796b60/users/36f6bfe9800844c39827c891d4da0a66/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:42.182577 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ecf277-0ced-4290-a964-9846cce62647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee432f5951c74a60b121a6be4a796b60, user_id=36f6bfe9800844c39827c891d4da0a66, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:42.185343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ecf277-0ced-4290-a964-9846cce62647 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:42.206353 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1116/2220] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:42 2022] PUT /identity/v3/projects/ee432f5951c74a60b121a6be4a796b60/users/36f6bfe9800844c39827c891d4da0a66/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:42.208446 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890a829-fc15-48e0-ad3b-c705442d77e1 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:42.218924 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890a829-fc15-48e0-ad3b-c705442d77e1 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:42.295890 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6ae06-66f3-4f0b-ab2f-1f8d3e5c30b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:42.296690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6ae06-66f3-4f0b-ab2f-1f8d3e5c30b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:42.297047 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6ae06-66f3-4f0b-ab2f-1f8d3e5c30b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:42.297398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6ae06-66f3-4f0b-ab2f-1f8d3e5c30b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:42.298782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6ae06-66f3-4f0b-ab2f-1f8d3e5c30b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:42.302246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6ae06-66f3-4f0b-ab2f-1f8d3e5c30b9 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:42.315854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1105/2221] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:05:42.320075 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecf277-0ced-4290-a964-9846cce62647 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:42.331638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecf277-0ced-4290-a964-9846cce62647 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:42.336790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac9cb3-5644-4fe4-8d56-77800afd16a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:42.337716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac9cb3-5644-4fe4-8d56-77800afd16a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:42.338000 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac9cb3-5644-4fe4-8d56-77800afd16a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:42.338272 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac9cb3-5644-4fe4-8d56-77800afd16a3 admin admin] PATH_INFO: `/v3/projects/ee432f5951c74a60b121a6be4a796b60/users/36f6bfe9800844c39827c891d4da0a66/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:42.340540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac9cb3-5644-4fe4-8d56-77800afd16a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee432f5951c74a60b121a6be4a796b60, user_id=36f6bfe9800844c39827c891d4da0a66, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:42.343394 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac9cb3-5644-4fe4-8d56-77800afd16a3 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:42.358281 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1117/2222] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:42 2022] PUT /identity/v3/projects/ee432f5951c74a60b121a6be4a796b60/users/36f6bfe9800844c39827c891d4da0a66/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:42.368926 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ca4bc-e89d-49d8-8bc2-abf3a5731d73 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:42.369263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ca4bc-e89d-49d8-8bc2-abf3a5731d73 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:42.369641 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ca4bc-e89d-49d8-8bc2-abf3a5731d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:42.399849 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-a23ca4bc-e89d-49d8-8bc2-abf3a5731d73 None None] MFA Rules not processed for user `36f6bfe9800844c39827c891d4da0a66`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:42.401088 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a23ca4bc-e89d-49d8-8bc2-abf3a5731d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:42.492281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1106/2223] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:42 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:42.504112 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac9cb3-5644-4fe4-8d56-77800afd16a3 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:42.506259 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-b9ac9cb3-5644-4fe4-8d56-77800afd16a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:42.576679 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac9cb3-5644-4fe4-8d56-77800afd16a3 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:42.580556 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94774753-1c2a-447b-81b1-b32215c13e16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:42.581274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94774753-1c2a-447b-81b1-b32215c13e16 service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:42.581552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94774753-1c2a-447b-81b1-b32215c13e16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:42.581821 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94774753-1c2a-447b-81b1-b32215c13e16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:42.591563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94774753-1c2a-447b-81b1-b32215c13e16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:42.592998 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94774753-1c2a-447b-81b1-b32215c13e16 service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:42.604075 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1118/2224] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:42 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:42.788838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ca4bc-e89d-49d8-8bc2-abf3a5731d73 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:42.790274 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a23ca4bc-e89d-49d8-8bc2-abf3a5731d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:42.811522 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ca4bc-e89d-49d8-8bc2-abf3a5731d73 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:42.816064 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cf2c9-8b1a-4c92-bb52-b2b91da74156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:42.816902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cf2c9-8b1a-4c92-bb52-b2b91da74156 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:42.817310 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cf2c9-8b1a-4c92-bb52-b2b91da74156 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:42.817560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cf2c9-8b1a-4c92-bb52-b2b91da74156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:42.826751 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:42.899338 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cf2c9-8b1a-4c92-bb52-b2b91da74156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:42.900843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cf2c9-8b1a-4c92-bb52-b2b91da74156 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:42.918192 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1107/2225] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:42 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:44.311700 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94774753-1c2a-447b-81b1-b32215c13e16 service cinder] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:44.312853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-94774753-1c2a-447b-81b1-b32215c13e16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:44.417002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94774753-1c2a-447b-81b1-b32215c13e16 service cinder] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:44.422622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61149a2-883c-4983-8137-fe8dcd108afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:44.424565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61149a2-883c-4983-8137-fe8dcd108afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:44.424847 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61149a2-883c-4983-8137-fe8dcd108afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:44.425195 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61149a2-883c-4983-8137-fe8dcd108afa admin admin] PATH_INFO: `/v3/users/307f1779c55045d196597f81d1cc294c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:44.427079 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61149a2-883c-4983-8137-fe8dcd108afa admin admin] RBAC: Authorizing `identity:delete_user(user_id=307f1779c55045d196597f81d1cc294c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:44.429108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61149a2-883c-4983-8137-fe8dcd108afa admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:44.435577 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:44.508987 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f61149a2-883c-4983-8137-fe8dcd108afa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '307f1779c55045d196597f81d1cc294c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:44.553822 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f61149a2-883c-4983-8137-fe8dcd108afa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '307f1779c55045d196597f81d1cc294c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:44.555743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f61149a2-883c-4983-8137-fe8dcd108afa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '307f1779c55045d196597f81d1cc294c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:44.556594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f61149a2-883c-4983-8137-fe8dcd108afa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '307f1779c55045d196597f81d1cc294c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:44.588970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f61149a2-883c-4983-8137-fe8dcd108afa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '307f1779c55045d196597f81d1cc294c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:44.615057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1119/2226] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:44 2022] DELETE /identity/v3/users/307f1779c55045d196597f81d1cc294c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:44.620241 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6da6e-f774-4361-81f5-c03b75c4e09e None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:44.620792 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6da6e-f774-4361-81f5-c03b75c4e09e None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:44.621136 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6da6e-f774-4361-81f5-c03b75c4e09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:44.657403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-8ee6da6e-f774-4361-81f5-c03b75c4e09e None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:44.658975 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-8ee6da6e-f774-4361-81f5-c03b75c4e09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:44.766360 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1108/2227] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:44.790105 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61149a2-883c-4983-8137-fe8dcd108afa admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:44.792042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-f61149a2-883c-4983-8137-fe8dcd108afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:44.915631 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61149a2-883c-4983-8137-fe8dcd108afa admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:44.931018 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86a3cf-ff24-4bba-a09a-ff3c5a3cbeac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:44.943219 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86a3cf-ff24-4bba-a09a-ff3c5a3cbeac service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:44.945374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86a3cf-ff24-4bba-a09a-ff3c5a3cbeac service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:44.946224 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86a3cf-ff24-4bba-a09a-ff3c5a3cbeac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:44.963884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86a3cf-ff24-4bba-a09a-ff3c5a3cbeac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:44.965581 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86a3cf-ff24-4bba-a09a-ff3c5a3cbeac service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:44.980301 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1120/2228] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:45.491655 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6da6e-f774-4361-81f5-c03b75c4e09e None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:45.493307 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-8ee6da6e-f774-4361-81f5-c03b75c4e09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:45.505839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6da6e-f774-4361-81f5-c03b75c4e09e None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:45.510621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7daff42-a037-4945-b1fa-5a31f2234da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:45.511546 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7daff42-a037-4945-b1fa-5a31f2234da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:45.511837 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7daff42-a037-4945-b1fa-5a31f2234da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:45.512111 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7daff42-a037-4945-b1fa-5a31f2234da5 admin admin] PATH_INFO: `/v3/projects/71271125dcf94b47b76f37e2def8d448` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:45.513343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7daff42-a037-4945-b1fa-5a31f2234da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71271125dcf94b47b76f37e2def8d448)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:45.515263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7daff42-a037-4945-b1fa-5a31f2234da5 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:45.564003 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e7daff42-a037-4945-b1fa-5a31f2234da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71271125dcf94b47b76f37e2def8d448', 'request_id': 'req-e7daff42-a037-4945-b1fa-5a31f2234da5'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:45.573677 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e7daff42-a037-4945-b1fa-5a31f2234da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71271125dcf94b47b76f37e2def8d448', 'request_id': 'req-e7daff42-a037-4945-b1fa-5a31f2234da5'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:45.580556 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e7daff42-a037-4945-b1fa-5a31f2234da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71271125dcf94b47b76f37e2def8d448', 'request_id': 'req-e7daff42-a037-4945-b1fa-5a31f2234da5'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:45.605030 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e7daff42-a037-4945-b1fa-5a31f2234da5 admin admin] The token cache is being invalidate because project 71271125dcf94b47b76f37e2def8d448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:45.605320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e7daff42-a037-4945-b1fa-5a31f2234da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:45.605975 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e7daff42-a037-4945-b1fa-5a31f2234da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:45.607989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1109/2229] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:45 2022] DELETE /identity/v3/projects/71271125dcf94b47b76f37e2def8d448 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:45.613590 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b9b1e-7bf1-46bd-adfe-0aa1fea5e7af None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:45.614085 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b9b1e-7bf1-46bd-adfe-0aa1fea5e7af None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:45.614191 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b9b1e-7bf1-46bd-adfe-0aa1fea5e7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:45.632936 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-242b9b1e-7bf1-46bd-adfe-0aa1fea5e7af None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:45.634150 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-242b9b1e-7bf1-46bd-adfe-0aa1fea5e7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:45.700208 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1121/2230] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:45.705952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7363b4b-90ab-42bb-b564-03585e7a8ca0 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:45.706437 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7363b4b-90ab-42bb-b564-03585e7a8ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:45.706525 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7363b4b-90ab-42bb-b564-03585e7a8ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:45.729717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-e7363b4b-90ab-42bb-b564-03585e7a8ca0 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:45.731052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-e7363b4b-90ab-42bb-b564-03585e7a8ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:45.739706 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1110/2231] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:45.744432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b9b1e-7bf1-46bd-adfe-0aa1fea5e7af None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:45.756003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b9b1e-7bf1-46bd-adfe-0aa1fea5e7af None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:45.761093 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d59a2c-f8ea-40af-85c3-5e2b71b9074a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:45.761782 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d59a2c-f8ea-40af-85c3-5e2b71b9074a admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:45.762085 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d59a2c-f8ea-40af-85c3-5e2b71b9074a admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:45.762356 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d59a2c-f8ea-40af-85c3-5e2b71b9074a admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:45.763089 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d59a2c-f8ea-40af-85c3-5e2b71b9074a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:05:45.763397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d59a2c-f8ea-40af-85c3-5e2b71b9074a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:45.765043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d59a2c-f8ea-40af-85c3-5e2b71b9074a admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:45.778751 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1122/2232] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:05:45.783247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7363b4b-90ab-42bb-b564-03585e7a8ca0 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:45.792999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7363b4b-90ab-42bb-b564-03585e7a8ca0 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:45.798771 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662d084-359e-4e15-aac8-cbb0494e3e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:45.799467 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662d084-359e-4e15-aac8-cbb0494e3e65 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:45.799767 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662d084-359e-4e15-aac8-cbb0494e3e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:45.800094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662d084-359e-4e15-aac8-cbb0494e3e65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:45.800986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662d084-359e-4e15-aac8-cbb0494e3e65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:45.803047 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662d084-359e-4e15-aac8-cbb0494e3e65 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:45.831358 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:45.838663 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1111/2233] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:45 2022] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:45.843229 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d59a2c-f8ea-40af-85c3-5e2b71b9074a admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:45.853405 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d59a2c-f8ea-40af-85c3-5e2b71b9074a admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:45.865339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:45.933879 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19670cd-74bd-4215-828b-145bd1b114e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:45.934591 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19670cd-74bd-4215-828b-145bd1b114e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:45.934911 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19670cd-74bd-4215-828b-145bd1b114e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:45.935180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19670cd-74bd-4215-828b-145bd1b114e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:45.935908 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19670cd-74bd-4215-828b-145bd1b114e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:45.937870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19670cd-74bd-4215-828b-145bd1b114e0 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:45.965360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1123/2234] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:45 2022] POST /identity/v3/users => generated 282 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:45.970384 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662d084-359e-4e15-aac8-cbb0494e3e65 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:45.982744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662d084-359e-4e15-aac8-cbb0494e3e65 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:45.989226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb220c6b-5550-4e9c-a1b9-dae2740ef356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:45.990245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb220c6b-5550-4e9c-a1b9-dae2740ef356 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:45.990774 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb220c6b-5550-4e9c-a1b9-dae2740ef356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:45.992003 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb220c6b-5550-4e9c-a1b9-dae2740ef356 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:45.993172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb220c6b-5550-4e9c-a1b9-dae2740ef356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:45.995045 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb220c6b-5550-4e9c-a1b9-dae2740ef356 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:46.008165 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1112/2235] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:46.012559 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19670cd-74bd-4215-828b-145bd1b114e0 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:46.024416 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19670cd-74bd-4215-828b-145bd1b114e0 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:46.030841 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276c00e-b984-47e8-be41-b1d0444f701b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:46.031711 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276c00e-b984-47e8-be41-b1d0444f701b admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:46.032092 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276c00e-b984-47e8-be41-b1d0444f701b admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:46.032458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276c00e-b984-47e8-be41-b1d0444f701b admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:46.033354 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276c00e-b984-47e8-be41-b1d0444f701b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:46.035694 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276c00e-b984-47e8-be41-b1d0444f701b admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:46.057870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1124/2236] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:05:46.062224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb220c6b-5550-4e9c-a1b9-dae2740ef356 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:46.078514 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb220c6b-5550-4e9c-a1b9-dae2740ef356 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:46.084851 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86b2f9-e0b4-4b01-be3b-f8948e624ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:46.086296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86b2f9-e0b4-4b01-be3b-f8948e624ece admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:46.086776 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86b2f9-e0b4-4b01-be3b-f8948e624ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:46.087055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86b2f9-e0b4-4b01-be3b-f8948e624ece admin admin] PATH_INFO: `/v3/projects/51279e21b4cb438d9bc45168dfba1c84/users/ce1164d2ec454a7aa200c59e5b6a401a/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:46.103588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86b2f9-e0b4-4b01-be3b-f8948e624ece admin admin] RBAC: Authorizing `identity:create_grant(project_id=51279e21b4cb438d9bc45168dfba1c84, user_id=ce1164d2ec454a7aa200c59e5b6a401a, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:46.106598 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86b2f9-e0b4-4b01-be3b-f8948e624ece admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:46.122042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1113/2237] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:46 2022] PUT /identity/v3/projects/51279e21b4cb438d9bc45168dfba1c84/users/ce1164d2ec454a7aa200c59e5b6a401a/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:05:46.132409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a41df8-8d81-4406-bc5a-35600ed1571a None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:46.132601 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a41df8-8d81-4406-bc5a-35600ed1571a None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:46.132872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a41df8-8d81-4406-bc5a-35600ed1571a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:46.166530 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-92a41df8-8d81-4406-bc5a-35600ed1571a None None] MFA Rules not processed for user `ce1164d2ec454a7aa200c59e5b6a401a`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:46.168013 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-92a41df8-8d81-4406-bc5a-35600ed1571a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:46.258664 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1125/2238] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:46 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:46.270174 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86b2f9-e0b4-4b01-be3b-f8948e624ece admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:46.272483 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-ae86b2f9-e0b4-4b01-be3b-f8948e624ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:46.341311 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86b2f9-e0b4-4b01-be3b-f8948e624ece admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:46.344633 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c01b86-7072-43ec-93aa-0e5c8d77a58d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:46.345324 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c01b86-7072-43ec-93aa-0e5c8d77a58d service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:46.345652 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c01b86-7072-43ec-93aa-0e5c8d77a58d service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:46.345933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c01b86-7072-43ec-93aa-0e5c8d77a58d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:46.356558 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c01b86-7072-43ec-93aa-0e5c8d77a58d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:46.358503 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c01b86-7072-43ec-93aa-0e5c8d77a58d service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:46.370759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1114/2239] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:46 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:48.578470 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a41df8-8d81-4406-bc5a-35600ed1571a None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:48.580256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-92a41df8-8d81-4406-bc5a-35600ed1571a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:48.664257 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a41df8-8d81-4406-bc5a-35600ed1571a None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:48.669348 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5d4e3-2364-4eef-9f13-b7506f722d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:48.670249 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5d4e3-2364-4eef-9f13-b7506f722d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:48.670583 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5d4e3-2364-4eef-9f13-b7506f722d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:48.670795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5d4e3-2364-4eef-9f13-b7506f722d62 admin admin] PATH_INFO: `/v3/users/2cf62822fc48451991600872c10e0379` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:48.672368 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5d4e3-2364-4eef-9f13-b7506f722d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf62822fc48451991600872c10e0379)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:48.676473 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5d4e3-2364-4eef-9f13-b7506f722d62 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:48.706752 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:48.732173 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-20a5d4e3-2364-4eef-9f13-b7506f722d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf62822fc48451991600872c10e0379'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:48.740030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-20a5d4e3-2364-4eef-9f13-b7506f722d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf62822fc48451991600872c10e0379'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:48.741217 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-20a5d4e3-2364-4eef-9f13-b7506f722d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf62822fc48451991600872c10e0379'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:48.741847 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-20a5d4e3-2364-4eef-9f13-b7506f722d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf62822fc48451991600872c10e0379'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:48.756841 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-20a5d4e3-2364-4eef-9f13-b7506f722d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf62822fc48451991600872c10e0379'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:48.773194 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1126/2240] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:48 2022] DELETE /identity/v3/users/2cf62822fc48451991600872c10e0379 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:48.778038 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39505329-693d-46d1-8e53-a2f748154d3c None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:48.778560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39505329-693d-46d1-8e53-a2f748154d3c None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:48.778653 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39505329-693d-46d1-8e53-a2f748154d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:48.797018 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-39505329-693d-46d1-8e53-a2f748154d3c None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:48.798777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-39505329-693d-46d1-8e53-a2f748154d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:48.861928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1115/2241] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:48.878970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5d4e3-2364-4eef-9f13-b7506f722d62 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:48.880921 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-20a5d4e3-2364-4eef-9f13-b7506f722d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:48.961511 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5d4e3-2364-4eef-9f13-b7506f722d62 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:48.965676 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e793aa-21c6-4ad8-b52e-4c42199c13eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:48.966359 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e793aa-21c6-4ad8-b52e-4c42199c13eb service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:48.966639 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e793aa-21c6-4ad8-b52e-4c42199c13eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:48.966914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e793aa-21c6-4ad8-b52e-4c42199c13eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:48.978288 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e793aa-21c6-4ad8-b52e-4c42199c13eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:48.979812 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e793aa-21c6-4ad8-b52e-4c42199c13eb service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:48.991796 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1127/2242] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:49.299259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39505329-693d-46d1-8e53-a2f748154d3c None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:49.300893 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-39505329-693d-46d1-8e53-a2f748154d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:49.313948 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39505329-693d-46d1-8e53-a2f748154d3c None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:49.320623 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab54b5-c674-4e69-b454-a75a2b38b019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:49.321554 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab54b5-c674-4e69-b454-a75a2b38b019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:49.321837 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab54b5-c674-4e69-b454-a75a2b38b019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:49.322111 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab54b5-c674-4e69-b454-a75a2b38b019 admin admin] PATH_INFO: `/v3/projects/e456d5bcf0a14377b69382844d0ded36` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:49.323634 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab54b5-c674-4e69-b454-a75a2b38b019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e456d5bcf0a14377b69382844d0ded36)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:49.326178 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab54b5-c674-4e69-b454-a75a2b38b019 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:49.384622 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d2ab54b5-c674-4e69-b454-a75a2b38b019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e456d5bcf0a14377b69382844d0ded36', 'request_id': 'req-d2ab54b5-c674-4e69-b454-a75a2b38b019'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:49.393795 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d2ab54b5-c674-4e69-b454-a75a2b38b019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e456d5bcf0a14377b69382844d0ded36', 'request_id': 'req-d2ab54b5-c674-4e69-b454-a75a2b38b019'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:49.400199 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:49.401931 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d2ab54b5-c674-4e69-b454-a75a2b38b019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e456d5bcf0a14377b69382844d0ded36', 'request_id': 'req-d2ab54b5-c674-4e69-b454-a75a2b38b019'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:49.417192 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d2ab54b5-c674-4e69-b454-a75a2b38b019 admin admin] The token cache is being invalidate because project e456d5bcf0a14377b69382844d0ded36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:49.417559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d2ab54b5-c674-4e69-b454-a75a2b38b019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:49.418235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d2ab54b5-c674-4e69-b454-a75a2b38b019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:49.420959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1116/2243] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:49 2022] DELETE /identity/v3/projects/e456d5bcf0a14377b69382844d0ded36 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:49.424390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e793aa-21c6-4ad8-b52e-4c42199c13eb service neutron] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:49.435025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e793aa-21c6-4ad8-b52e-4c42199c13eb service neutron] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:49.504731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c27803-606e-4d60-b3d0-701254a27197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:49.505515 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c27803-606e-4d60-b3d0-701254a27197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:49.505834 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c27803-606e-4d60-b3d0-701254a27197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:49.510754 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c27803-606e-4d60-b3d0-701254a27197 admin admin] PATH_INFO: `/v3/users/36f6bfe9800844c39827c891d4da0a66` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:49.516405 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c27803-606e-4d60-b3d0-701254a27197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36f6bfe9800844c39827c891d4da0a66)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:49.519815 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c27803-606e-4d60-b3d0-701254a27197 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:49.593404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-63c27803-606e-4d60-b3d0-701254a27197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36f6bfe9800844c39827c891d4da0a66'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:49.593404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:49.599514 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-63c27803-606e-4d60-b3d0-701254a27197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36f6bfe9800844c39827c891d4da0a66'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:49.601721 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-63c27803-606e-4d60-b3d0-701254a27197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36f6bfe9800844c39827c891d4da0a66'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:49.603676 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-63c27803-606e-4d60-b3d0-701254a27197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36f6bfe9800844c39827c891d4da0a66'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:49.624728 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-63c27803-606e-4d60-b3d0-701254a27197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36f6bfe9800844c39827c891d4da0a66'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:49.645555 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1128/2244] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:49 2022] DELETE /identity/v3/users/36f6bfe9800844c39827c891d4da0a66 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:49.727549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab54b5-c674-4e69-b454-a75a2b38b019 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:49.730652 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-d2ab54b5-c674-4e69-b454-a75a2b38b019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:49.760875 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab54b5-c674-4e69-b454-a75a2b38b019 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:49.859998 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0d12a-6c77-485e-b4d8-207bb0c4723c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:49.861253 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0d12a-6c77-485e-b4d8-207bb0c4723c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:49.861553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0d12a-6c77-485e-b4d8-207bb0c4723c admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:49.861999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0d12a-6c77-485e-b4d8-207bb0c4723c admin admin] PATH_INFO: `/v3/users/f1bd40095831445cacf4bb7ccbcd2fbc` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:49.864098 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0d12a-6c77-485e-b4d8-207bb0c4723c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1bd40095831445cacf4bb7ccbcd2fbc)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:49.866277 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0d12a-6c77-485e-b4d8-207bb0c4723c admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:49.919668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-ffc0d12a-6c77-485e-b4d8-207bb0c4723c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1bd40095831445cacf4bb7ccbcd2fbc'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:49.936211 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-ffc0d12a-6c77-485e-b4d8-207bb0c4723c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1bd40095831445cacf4bb7ccbcd2fbc'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:49.944524 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-ffc0d12a-6c77-485e-b4d8-207bb0c4723c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1bd40095831445cacf4bb7ccbcd2fbc'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:49.945451 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-ffc0d12a-6c77-485e-b4d8-207bb0c4723c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1bd40095831445cacf4bb7ccbcd2fbc'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:49.955523 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-ffc0d12a-6c77-485e-b4d8-207bb0c4723c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1bd40095831445cacf4bb7ccbcd2fbc'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:49.962764 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1117/2245] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:49 2022] DELETE /identity/v3/users/f1bd40095831445cacf4bb7ccbcd2fbc => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:49.967602 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea233c6-ba2b-40ad-a21e-ab95dacd3362 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:49.967914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea233c6-ba2b-40ad-a21e-ab95dacd3362 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:49.968238 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea233c6-ba2b-40ad-a21e-ab95dacd3362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:49.985378 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-1ea233c6-ba2b-40ad-a21e-ab95dacd3362 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:49.986599 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-1ea233c6-ba2b-40ad-a21e-ab95dacd3362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:50.053121 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1129/2246] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:05:50.063267 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0d12a-6c77-485e-b4d8-207bb0c4723c admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:50.064788 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-ffc0d12a-6c77-485e-b4d8-207bb0c4723c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:50.122812 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0d12a-6c77-485e-b4d8-207bb0c4723c admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:50.127022 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563225c-0851-4db4-81f5-e98e1afdc9bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:50.127730 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563225c-0851-4db4-81f5-e98e1afdc9bd service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:50.128015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563225c-0851-4db4-81f5-e98e1afdc9bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:50.128299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563225c-0851-4db4-81f5-e98e1afdc9bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:50.138274 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3563225c-0851-4db4-81f5-e98e1afdc9bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:50.139803 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3563225c-0851-4db4-81f5-e98e1afdc9bd service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:50.150942 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1118/2247] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:50.200885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea233c6-ba2b-40ad-a21e-ab95dacd3362 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:50.202360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-1ea233c6-ba2b-40ad-a21e-ab95dacd3362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:50.217305 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea233c6-ba2b-40ad-a21e-ab95dacd3362 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:50.224408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e7a59-f727-4494-a0fe-f8e5c323c7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:50.225613 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e7a59-f727-4494-a0fe-f8e5c323c7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:50.226199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e7a59-f727-4494-a0fe-f8e5c323c7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:50.226571 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e7a59-f727-4494-a0fe-f8e5c323c7cb admin admin] PATH_INFO: `/v3/projects/ee432f5951c74a60b121a6be4a796b60` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:50.230127 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e7a59-f727-4494-a0fe-f8e5c323c7cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee432f5951c74a60b121a6be4a796b60)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:50.232730 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e7a59-f727-4494-a0fe-f8e5c323c7cb admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:50.291324 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-358e7a59-f727-4494-a0fe-f8e5c323c7cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee432f5951c74a60b121a6be4a796b60', 'request_id': 'req-358e7a59-f727-4494-a0fe-f8e5c323c7cb'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:50.298930 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-358e7a59-f727-4494-a0fe-f8e5c323c7cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee432f5951c74a60b121a6be4a796b60', 'request_id': 'req-358e7a59-f727-4494-a0fe-f8e5c323c7cb'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:50.308872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-358e7a59-f727-4494-a0fe-f8e5c323c7cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee432f5951c74a60b121a6be4a796b60', 'request_id': 'req-358e7a59-f727-4494-a0fe-f8e5c323c7cb'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:50.327318 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-358e7a59-f727-4494-a0fe-f8e5c323c7cb admin admin] The token cache is being invalidate because project ee432f5951c74a60b121a6be4a796b60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:50.327710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-358e7a59-f727-4494-a0fe-f8e5c323c7cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:50.328455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-358e7a59-f727-4494-a0fe-f8e5c323c7cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:50.330849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1130/2248] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:50 2022] DELETE /identity/v3/projects/ee432f5951c74a60b121a6be4a796b60 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:05:50.336987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67646e98-d119-45fd-bf48-4ab40eab9ad9 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:50.338143 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67646e98-d119-45fd-bf48-4ab40eab9ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:50.338655 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67646e98-d119-45fd-bf48-4ab40eab9ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:50.361944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-67646e98-d119-45fd-bf48-4ab40eab9ad9 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:50.363307 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-67646e98-d119-45fd-bf48-4ab40eab9ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:50.373406 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:50.437054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1119/2249] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:05:50.445565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5088791-a3ea-4cc7-9f69-a8facc18c397 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:50.445857 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5088791-a3ea-4cc7-9f69-a8facc18c397 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:50.446139 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5088791-a3ea-4cc7-9f69-a8facc18c397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:50.452196 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67646e98-d119-45fd-bf48-4ab40eab9ad9 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:50.454339 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-67646e98-d119-45fd-bf48-4ab40eab9ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:50.469270 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-f5088791-a3ea-4cc7-9f69-a8facc18c397 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:50.470665 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-f5088791-a3ea-4cc7-9f69-a8facc18c397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:50.473772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67646e98-d119-45fd-bf48-4ab40eab9ad9 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:50.479821 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1131/2250] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:50.481396 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a102b-2486-451f-999a-8ddd35ae1003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:50.483122 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a102b-2486-451f-999a-8ddd35ae1003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:50.483542 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a102b-2486-451f-999a-8ddd35ae1003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:50.485417 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a102b-2486-451f-999a-8ddd35ae1003 admin admin] PATH_INFO: `/v3/projects/4e7bf560bc304ec9a7582adedf2c8cd1` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:50.485542 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5088791-a3ea-4cc7-9f69-a8facc18c397 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:50.487703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a102b-2486-451f-999a-8ddd35ae1003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e7bf560bc304ec9a7582adedf2c8cd1)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:50.493937 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a102b-2486-451f-999a-8ddd35ae1003 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:50.499954 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5088791-a3ea-4cc7-9f69-a8facc18c397 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:50.505958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132171b-5256-4666-bb5a-4b4e39cf9ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:50.506918 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132171b-5256-4666-bb5a-4b4e39cf9ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:50.507377 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132171b-5256-4666-bb5a-4b4e39cf9ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:50.508054 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132171b-5256-4666-bb5a-4b4e39cf9ef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:50.509220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132171b-5256-4666-bb5a-4b4e39cf9ef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:05:50.509755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132171b-5256-4666-bb5a-4b4e39cf9ef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:50.511713 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132171b-5256-4666-bb5a-4b4e39cf9ef6 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:50.527770 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1132/2251] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:05:50.533790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132171b-5256-4666-bb5a-4b4e39cf9ef6 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:50.560758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-095a102b-2486-451f-999a-8ddd35ae1003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e7bf560bc304ec9a7582adedf2c8cd1', 'request_id': 'req-095a102b-2486-451f-999a-8ddd35ae1003'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:50.561624 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132171b-5256-4666-bb5a-4b4e39cf9ef6 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:50.574869 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-095a102b-2486-451f-999a-8ddd35ae1003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e7bf560bc304ec9a7582adedf2c8cd1', 'request_id': 'req-095a102b-2486-451f-999a-8ddd35ae1003'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:50.590455 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-095a102b-2486-451f-999a-8ddd35ae1003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e7bf560bc304ec9a7582adedf2c8cd1', 'request_id': 'req-095a102b-2486-451f-999a-8ddd35ae1003'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:50.606588 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:50.626430 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-095a102b-2486-451f-999a-8ddd35ae1003 admin admin] The token cache is being invalidate because project 4e7bf560bc304ec9a7582adedf2c8cd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:05:50.626910 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-095a102b-2486-451f-999a-8ddd35ae1003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:50.628067 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-095a102b-2486-451f-999a-8ddd35ae1003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:50.641586 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1120/2252] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:05:50 2022] DELETE /identity/v3/projects/4e7bf560bc304ec9a7582adedf2c8cd1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:05:50.666629 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eeddfa-bb9f-4b4c-bc0d-10f8cc7aea24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:50.667322 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeddfa-bb9f-4b4c-bc0d-10f8cc7aea24 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:50.667892 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeddfa-bb9f-4b4c-bc0d-10f8cc7aea24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:50.668160 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeddfa-bb9f-4b4c-bc0d-10f8cc7aea24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:50.669070 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eeddfa-bb9f-4b4c-bc0d-10f8cc7aea24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:50.671157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eeddfa-bb9f-4b4c-bc0d-10f8cc7aea24 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:50.711797 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1133/2253] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:50 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:50.713508 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a102b-2486-451f-999a-8ddd35ae1003 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:50.719680 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-095a102b-2486-451f-999a-8ddd35ae1003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:50.755791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a102b-2486-451f-999a-8ddd35ae1003 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:50.935303 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21f4dd-ccaf-489f-9702-d949c24468b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:50.936734 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21f4dd-ccaf-489f-9702-d949c24468b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:50.937277 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21f4dd-ccaf-489f-9702-d949c24468b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:50.937712 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21f4dd-ccaf-489f-9702-d949c24468b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:50.938760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21f4dd-ccaf-489f-9702-d949c24468b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:50.941569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21f4dd-ccaf-489f-9702-d949c24468b8 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:50.974946 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1121/2254] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:50 2022] POST /identity/v3/users => generated 289 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:05:50.979198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eeddfa-bb9f-4b4c-bc0d-10f8cc7aea24 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:50.993931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eeddfa-bb9f-4b4c-bc0d-10f8cc7aea24 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:50.998833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98dc488-7104-499d-bfac-39ad5a21153a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:50.999563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dc488-7104-499d-bfac-39ad5a21153a admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:50.999849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dc488-7104-499d-bfac-39ad5a21153a admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:51.000402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dc488-7104-499d-bfac-39ad5a21153a admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:51.001255 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98dc488-7104-499d-bfac-39ad5a21153a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:51.014275 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98dc488-7104-499d-bfac-39ad5a21153a admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:51.035875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1134/2255] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:51.041782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21f4dd-ccaf-489f-9702-d949c24468b8 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:51.055446 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21f4dd-ccaf-489f-9702-d949c24468b8 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:51.060632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49bfec-cf43-4890-a162-d5063b2a9059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:51.061285 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49bfec-cf43-4890-a162-d5063b2a9059 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:51.061572 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49bfec-cf43-4890-a162-d5063b2a9059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:51.062440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49bfec-cf43-4890-a162-d5063b2a9059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:51.062616 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49bfec-cf43-4890-a162-d5063b2a9059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:51.064353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49bfec-cf43-4890-a162-d5063b2a9059 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:51.076339 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1122/2256] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:51.080589 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98dc488-7104-499d-bfac-39ad5a21153a admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:51.091138 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98dc488-7104-499d-bfac-39ad5a21153a admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:51.103978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996c154-ef83-4cb1-9b80-0a271181a901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:51.105049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996c154-ef83-4cb1-9b80-0a271181a901 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:51.105333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996c154-ef83-4cb1-9b80-0a271181a901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:51.105582 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996c154-ef83-4cb1-9b80-0a271181a901 admin admin] PATH_INFO: `/v3/projects/6af5a1c31f504bef8f9cb1e444c0b9ec/users/ee3e9cef73814b75a4a1eb349e62c2f4/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:51.122818 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c996c154-ef83-4cb1-9b80-0a271181a901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af5a1c31f504bef8f9cb1e444c0b9ec, user_id=ee3e9cef73814b75a4a1eb349e62c2f4, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:51.126119 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c996c154-ef83-4cb1-9b80-0a271181a901 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:51.141907 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1135/2257] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:51 2022] PUT /identity/v3/projects/6af5a1c31f504bef8f9cb1e444c0b9ec/users/ee3e9cef73814b75a4a1eb349e62c2f4/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:51.152816 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74361fd-4028-41b5-a1d6-86d5a25f5bf8 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:51.153094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74361fd-4028-41b5-a1d6-86d5a25f5bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:51.153515 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74361fd-4028-41b5-a1d6-86d5a25f5bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:51.181275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-a74361fd-4028-41b5-a1d6-86d5a25f5bf8 None None] MFA Rules not processed for user `ee3e9cef73814b75a4a1eb349e62c2f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:51.182516 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a74361fd-4028-41b5-a1d6-86d5a25f5bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:51.186780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:51.252261 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1123/2258] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:05:51.256929 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996c154-ef83-4cb1-9b80-0a271181a901 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:51.320456 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996c154-ef83-4cb1-9b80-0a271181a901 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:51.325224 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c4113-9cd7-4e95-ab67-a918bd70beeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:51.325913 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c4113-9cd7-4e95-ab67-a918bd70beeb admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:51.326197 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c4113-9cd7-4e95-ab67-a918bd70beeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:51.326473 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c4113-9cd7-4e95-ab67-a918bd70beeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:51.327197 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c4113-9cd7-4e95-ab67-a918bd70beeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:51.329185 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c4113-9cd7-4e95-ab67-a918bd70beeb admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:51.357943 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1136/2259] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:51 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:05:51.362117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74361fd-4028-41b5-a1d6-86d5a25f5bf8 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:51.373821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74361fd-4028-41b5-a1d6-86d5a25f5bf8 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:51.444125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbc107-c4be-4b52-bc21-da6fac4af8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:51.444739 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbc107-c4be-4b52-bc21-da6fac4af8bd admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:51.445024 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbc107-c4be-4b52-bc21-da6fac4af8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:51.445299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbc107-c4be-4b52-bc21-da6fac4af8bd admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:51.446004 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbc107-c4be-4b52-bc21-da6fac4af8bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:51.448016 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbc107-c4be-4b52-bc21-da6fac4af8bd admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:51.473124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1124/2260] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:51 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:51.474624 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c4113-9cd7-4e95-ab67-a918bd70beeb admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:51.485864 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c4113-9cd7-4e95-ab67-a918bd70beeb admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:51.491674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdb963-4a08-4240-b7a0-97d5dd80494d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:51.492439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdb963-4a08-4240-b7a0-97d5dd80494d admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:51.492785 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdb963-4a08-4240-b7a0-97d5dd80494d admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:51.493124 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdb963-4a08-4240-b7a0-97d5dd80494d admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:51.493942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fdb963-4a08-4240-b7a0-97d5dd80494d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:51.495764 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fdb963-4a08-4240-b7a0-97d5dd80494d admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:51.507812 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1137/2261] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:51.511929 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbc107-c4be-4b52-bc21-da6fac4af8bd admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:51.522712 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbc107-c4be-4b52-bc21-da6fac4af8bd admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:51.527541 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba115cd7-cfa9-4f13-b450-abb389902484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:51.528222 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba115cd7-cfa9-4f13-b450-abb389902484 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:51.528503 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba115cd7-cfa9-4f13-b450-abb389902484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:51.528779 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba115cd7-cfa9-4f13-b450-abb389902484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:51.529522 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba115cd7-cfa9-4f13-b450-abb389902484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:51.531242 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba115cd7-cfa9-4f13-b450-abb389902484 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:51.545373 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1125/2262] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:51.546643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdb963-4a08-4240-b7a0-97d5dd80494d admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:51.557783 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdb963-4a08-4240-b7a0-97d5dd80494d admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:51.562959 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12188a28-185b-4e8a-8461-4765197af381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:51.563972 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12188a28-185b-4e8a-8461-4765197af381 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:51.564312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12188a28-185b-4e8a-8461-4765197af381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:51.564650 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12188a28-185b-4e8a-8461-4765197af381 admin admin] PATH_INFO: `/v3/projects/2a09e707d0914a7aa6fbc8f1c65d433f/users/440ddbfc4ebe462abd478f49ea28600f/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:51.580227 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12188a28-185b-4e8a-8461-4765197af381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a09e707d0914a7aa6fbc8f1c65d433f, user_id=440ddbfc4ebe462abd478f49ea28600f, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:51.583092 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12188a28-185b-4e8a-8461-4765197af381 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:51.597617 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1138/2263] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:51 2022] PUT /identity/v3/projects/2a09e707d0914a7aa6fbc8f1c65d433f/users/440ddbfc4ebe462abd478f49ea28600f/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:05:51.608212 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe5aad-f27c-4586-ae67-36f5b4c6e811 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:51.608508 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe5aad-f27c-4586-ae67-36f5b4c6e811 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:51.608809 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe5aad-f27c-4586-ae67-36f5b4c6e811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:51.637090 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-81fe5aad-f27c-4586-ae67-36f5b4c6e811 None None] MFA Rules not processed for user `440ddbfc4ebe462abd478f49ea28600f`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:51.638488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-81fe5aad-f27c-4586-ae67-36f5b4c6e811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:51.704827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1126/2264] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:51.709725 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12188a28-185b-4e8a-8461-4765197af381 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:51.744774 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:51.777908 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12188a28-185b-4e8a-8461-4765197af381 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:51.782746 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583cca3-ab28-4d5a-8265-8f7ebad1c27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:51.783453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583cca3-ab28-4d5a-8265-8f7ebad1c27f admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:51.783740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583cca3-ab28-4d5a-8265-8f7ebad1c27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:51.784028 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583cca3-ab28-4d5a-8265-8f7ebad1c27f admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:51.784801 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583cca3-ab28-4d5a-8265-8f7ebad1c27f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:51.786771 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583cca3-ab28-4d5a-8265-8f7ebad1c27f admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:51.815005 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1139/2265] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:05:51 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:51.819219 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe5aad-f27c-4586-ae67-36f5b4c6e811 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:51.830233 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe5aad-f27c-4586-ae67-36f5b4c6e811 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:51.839621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:51.896019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7ca84-9f89-4b6c-9d80-927c357798bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:51.896731 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7ca84-9f89-4b6c-9d80-927c357798bd admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:51.897014 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7ca84-9f89-4b6c-9d80-927c357798bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:51.897416 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7ca84-9f89-4b6c-9d80-927c357798bd admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:51.898116 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7ca84-9f89-4b6c-9d80-927c357798bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:51.900151 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7ca84-9f89-4b6c-9d80-927c357798bd admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:51.924679 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1127/2266] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:05:51 2022] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:05:51.929410 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583cca3-ab28-4d5a-8265-8f7ebad1c27f admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:51.940767 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583cca3-ab28-4d5a-8265-8f7ebad1c27f admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:51.945807 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a274473-c8e1-4002-b220-3f4109f33785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:51.946483 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a274473-c8e1-4002-b220-3f4109f33785 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:51.946778 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a274473-c8e1-4002-b220-3f4109f33785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:51.947149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a274473-c8e1-4002-b220-3f4109f33785 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:51.948015 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a274473-c8e1-4002-b220-3f4109f33785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:51.949616 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a274473-c8e1-4002-b220-3f4109f33785 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:51.973173 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1140/2267] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:05:51.979485 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7ca84-9f89-4b6c-9d80-927c357798bd admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:51.990056 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7ca84-9f89-4b6c-9d80-927c357798bd admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:51.995404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db5d96-f30c-4d82-9d99-0abf62441359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:51.996386 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db5d96-f30c-4d82-9d99-0abf62441359 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:51.996699 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db5d96-f30c-4d82-9d99-0abf62441359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:51.996996 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db5d96-f30c-4d82-9d99-0abf62441359 admin admin] PATH_INFO: `/v3/projects/41c16ae2eef0433a877f07fb731adcc8/users/a10cfa59cae148aa90eb930c8b00ca7d/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:52.012852 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db5d96-f30c-4d82-9d99-0abf62441359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41c16ae2eef0433a877f07fb731adcc8, user_id=a10cfa59cae148aa90eb930c8b00ca7d, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:52.015917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db5d96-f30c-4d82-9d99-0abf62441359 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:52.032115 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1128/2268] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:51 2022] PUT /identity/v3/projects/41c16ae2eef0433a877f07fb731adcc8/users/a10cfa59cae148aa90eb930c8b00ca7d/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:52.036949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a274473-c8e1-4002-b220-3f4109f33785 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:52.047525 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a274473-c8e1-4002-b220-3f4109f33785 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:52.125763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef3ea6-9b60-4be9-9291-06e9befe84ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:52.126430 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef3ea6-9b60-4be9-9291-06e9befe84ff admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:52.126715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef3ea6-9b60-4be9-9291-06e9befe84ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:52.127009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef3ea6-9b60-4be9-9291-06e9befe84ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:52.127777 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef3ea6-9b60-4be9-9291-06e9befe84ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:52.129536 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef3ea6-9b60-4be9-9291-06e9befe84ff admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:52.155845 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1141/2269] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:05:52.160466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db5d96-f30c-4d82-9d99-0abf62441359 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:52.182053 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db5d96-f30c-4d82-9d99-0abf62441359 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:52.187302 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2585e-e3ae-4a2f-af2d-b2c90281812a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:52.188275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2585e-e3ae-4a2f-af2d-b2c90281812a admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:52.188693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2585e-e3ae-4a2f-af2d-b2c90281812a admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:52.188972 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2585e-e3ae-4a2f-af2d-b2c90281812a admin admin] PATH_INFO: `/v3/projects/41c16ae2eef0433a877f07fb731adcc8/users/a10cfa59cae148aa90eb930c8b00ca7d/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:52.191014 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2585e-e3ae-4a2f-af2d-b2c90281812a admin admin] RBAC: Authorizing `identity:create_grant(project_id=41c16ae2eef0433a877f07fb731adcc8, user_id=a10cfa59cae148aa90eb930c8b00ca7d, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:52.193751 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2585e-e3ae-4a2f-af2d-b2c90281812a admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:52.205746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1129/2270] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:05:52 2022] PUT /identity/v3/projects/41c16ae2eef0433a877f07fb731adcc8/users/a10cfa59cae148aa90eb930c8b00ca7d/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:52.216915 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da2bed-d317-4234-90e6-64df3fb63ba3 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:52.217208 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da2bed-d317-4234-90e6-64df3fb63ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:52.217482 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da2bed-d317-4234-90e6-64df3fb63ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:52.264272 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-36da2bed-d317-4234-90e6-64df3fb63ba3 None None] MFA Rules not processed for user `a10cfa59cae148aa90eb930c8b00ca7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:52.265551 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-36da2bed-d317-4234-90e6-64df3fb63ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:52.360683 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1142/2271] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:52.373081 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2585e-e3ae-4a2f-af2d-b2c90281812a admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:52.374900 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-96c2585e-e3ae-4a2f-af2d-b2c90281812a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:52.448972 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2585e-e3ae-4a2f-af2d-b2c90281812a admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:52.452928 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a063f3-62b7-401b-9d4e-b621246ba0d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:52.453697 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a063f3-62b7-401b-9d4e-b621246ba0d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:52.454552 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a063f3-62b7-401b-9d4e-b621246ba0d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:52.454552 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a063f3-62b7-401b-9d4e-b621246ba0d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:52.565689 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a063f3-62b7-401b-9d4e-b621246ba0d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:52.569130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a063f3-62b7-401b-9d4e-b621246ba0d4 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:52.586777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1130/2272] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:54.143732 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da2bed-d317-4234-90e6-64df3fb63ba3 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:54.155256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da2bed-d317-4234-90e6-64df3fb63ba3 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:54.159732 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14faeb-a30b-4809-96aa-476775125aaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:54.160427 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14faeb-a30b-4809-96aa-476775125aaf service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:54.160705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14faeb-a30b-4809-96aa-476775125aaf service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:54.161685 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14faeb-a30b-4809-96aa-476775125aaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:54.184416 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:54.222477 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14faeb-a30b-4809-96aa-476775125aaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:54.225092 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14faeb-a30b-4809-96aa-476775125aaf service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:54.234560 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1143/2273] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:54.799613 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a063f3-62b7-401b-9d4e-b621246ba0d4 service cinder] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:54.808939 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a063f3-62b7-401b-9d4e-b621246ba0d4 service cinder] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:54.812893 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66811c80-329e-4305-baab-d9626b932d75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:54.813559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66811c80-329e-4305-baab-d9626b932d75 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:54.813845 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66811c80-329e-4305-baab-d9626b932d75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:54.814123 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66811c80-329e-4305-baab-d9626b932d75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:54.824055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66811c80-329e-4305-baab-d9626b932d75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:54.825516 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66811c80-329e-4305-baab-d9626b932d75 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:54.837037 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1131/2274] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:57.693278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14faeb-a30b-4809-96aa-476775125aaf service cinder] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:57.704516 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14faeb-a30b-4809-96aa-476775125aaf service cinder] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:57.707933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae69d30-1bd2-4b4c-bf8d-8f09b9559200 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:57.708586 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae69d30-1bd2-4b4c-bf8d-8f09b9559200 service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:57.708863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae69d30-1bd2-4b4c-bf8d-8f09b9559200 service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:57.709230 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae69d30-1bd2-4b4c-bf8d-8f09b9559200 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:57.710973 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-cae69d30-1bd2-4b4c-bf8d-8f09b9559200 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:57.787598 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae69d30-1bd2-4b4c-bf8d-8f09b9559200 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:57.789360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae69d30-1bd2-4b4c-bf8d-8f09b9559200 service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:57.802910 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1144/2275] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:05:58.221382 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925598a-e69f-4204-8d69-98b91359a542 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:58.221885 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925598a-e69f-4204-8d69-98b91359a542 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:58.221977 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925598a-e69f-4204-8d69-98b91359a542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:58.235468 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:58.244228 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-a925598a-e69f-4204-8d69-98b91359a542 None None] MFA Rules not processed for user `0dbf596d8f964d4695944a23dd8e4cef`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:58.246317 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a925598a-e69f-4204-8d69-98b91359a542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:58.310772 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1132/2276] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 02:05:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:58.359766 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae69d30-1bd2-4b4c-bf8d-8f09b9559200 service cinder] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:58.361428 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-cae69d30-1bd2-4b4c-bf8d-8f09b9559200 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:58.452943 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae69d30-1bd2-4b4c-bf8d-8f09b9559200 service cinder] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:58.458681 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638e5d1-61c8-4cc4-a98f-34423fd5a881 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae132c4d0b5461aa26ab929a017cb08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:58.459403 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638e5d1-61c8-4cc4-a98f-34423fd5a881 service swift] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:58.459759 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638e5d1-61c8-4cc4-a98f-34423fd5a881 service swift] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:58.460233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638e5d1-61c8-4cc4-a98f-34423fd5a881 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:58.473993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638e5d1-61c8-4cc4-a98f-34423fd5a881 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:58.475978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638e5d1-61c8-4cc4-a98f-34423fd5a881 service swift] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:58.486751 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1145/2277] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 02:05:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 02:05:58.972188 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925598a-e69f-4204-8d69-98b91359a542 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:59.075649 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925598a-e69f-4204-8d69-98b91359a542 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:59.084078 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8617605-3bf8-46f0-8a92-bd0fabedb189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:59.085497 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8617605-3bf8-46f0-8a92-bd0fabedb189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:59.085861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8617605-3bf8-46f0-8a92-bd0fabedb189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:59.086385 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8617605-3bf8-46f0-8a92-bd0fabedb189 admin admin] PATH_INFO: `/v3/users/ee3e9cef73814b75a4a1eb349e62c2f4` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:59.088039 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8617605-3bf8-46f0-8a92-bd0fabedb189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee3e9cef73814b75a4a1eb349e62c2f4)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:59.090647 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8617605-3bf8-46f0-8a92-bd0fabedb189 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:59.160558 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e8617605-3bf8-46f0-8a92-bd0fabedb189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee3e9cef73814b75a4a1eb349e62c2f4'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:59.202539 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e8617605-3bf8-46f0-8a92-bd0fabedb189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee3e9cef73814b75a4a1eb349e62c2f4'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:59.202539 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e8617605-3bf8-46f0-8a92-bd0fabedb189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee3e9cef73814b75a4a1eb349e62c2f4'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:59.215911 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e8617605-3bf8-46f0-8a92-bd0fabedb189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee3e9cef73814b75a4a1eb349e62c2f4'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:59.243875 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e8617605-3bf8-46f0-8a92-bd0fabedb189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee3e9cef73814b75a4a1eb349e62c2f4'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:05:59.266893 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1133/2278] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:05:58 2022] DELETE /identity/v3/users/ee3e9cef73814b75a4a1eb349e62c2f4 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:05:59.271638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099280c-f1aa-49a5-b725-f2ffb47a9099 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:59.272835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099280c-f1aa-49a5-b725-f2ffb47a9099 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:59.273351 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099280c-f1aa-49a5-b725-f2ffb47a9099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:59.294774 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-3099280c-f1aa-49a5-b725-f2ffb47a9099 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:05:59.296318 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-3099280c-f1aa-49a5-b725-f2ffb47a9099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:59.367587 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:59.408647 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1146/2279] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:05:59.415477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8617605-3bf8-46f0-8a92-bd0fabedb189 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:05:59.416986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-e8617605-3bf8-46f0-8a92-bd0fabedb189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:05:59.494560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:05:59.523319 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8617605-3bf8-46f0-8a92-bd0fabedb189 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:05:59.528086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb97bd-89fd-4dc1-9439-0f41d2c6ec89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:05:59.528244 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb97bd-89fd-4dc1-9439-0f41d2c6ec89 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:05:59.528756 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb97bd-89fd-4dc1-9439-0f41d2c6ec89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:05:59.529252 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb97bd-89fd-4dc1-9439-0f41d2c6ec89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:05:59.543473 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb97bd-89fd-4dc1-9439-0f41d2c6ec89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:05:59.545587 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb97bd-89fd-4dc1-9439-0f41d2c6ec89 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:05:59.558579 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1134/2280] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:05:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:06:00.340689 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099280c-f1aa-49a5-b725-f2ffb47a9099 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:00.342465 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-3099280c-f1aa-49a5-b725-f2ffb47a9099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:00.359279 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099280c-f1aa-49a5-b725-f2ffb47a9099 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:00.367762 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3f2ef-f4c3-4ad8-a87c-b7fbc8574e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:00.369398 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3f2ef-f4c3-4ad8-a87c-b7fbc8574e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:00.370173 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3f2ef-f4c3-4ad8-a87c-b7fbc8574e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:00.370683 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3f2ef-f4c3-4ad8-a87c-b7fbc8574e6c admin admin] PATH_INFO: `/v3/projects/6af5a1c31f504bef8f9cb1e444c0b9ec` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:00.372298 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3f2ef-f4c3-4ad8-a87c-b7fbc8574e6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af5a1c31f504bef8f9cb1e444c0b9ec)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:00.374958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3f2ef-f4c3-4ad8-a87c-b7fbc8574e6c admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:00.446406 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-98e3f2ef-f4c3-4ad8-a87c-b7fbc8574e6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af5a1c31f504bef8f9cb1e444c0b9ec', 'request_id': 'req-98e3f2ef-f4c3-4ad8-a87c-b7fbc8574e6c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:00.456953 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-98e3f2ef-f4c3-4ad8-a87c-b7fbc8574e6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af5a1c31f504bef8f9cb1e444c0b9ec', 'request_id': 'req-98e3f2ef-f4c3-4ad8-a87c-b7fbc8574e6c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:00.471339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-98e3f2ef-f4c3-4ad8-a87c-b7fbc8574e6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af5a1c31f504bef8f9cb1e444c0b9ec', 'request_id': 'req-98e3f2ef-f4c3-4ad8-a87c-b7fbc8574e6c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:00.486282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-98e3f2ef-f4c3-4ad8-a87c-b7fbc8574e6c admin admin] The token cache is being invalidate because project 6af5a1c31f504bef8f9cb1e444c0b9ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:06:00.486833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-98e3f2ef-f4c3-4ad8-a87c-b7fbc8574e6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:00.487299 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-98e3f2ef-f4c3-4ad8-a87c-b7fbc8574e6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:00.489159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1147/2281] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:06:00 2022] DELETE /identity/v3/projects/6af5a1c31f504bef8f9cb1e444c0b9ec => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:06:00.493877 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb97bd-89fd-4dc1-9439-0f41d2c6ec89 service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:00.504540 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb97bd-89fd-4dc1-9439-0f41d2c6ec89 service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:00.575346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0632ff-2fdf-4fc9-9e45-4ea303cd70d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:00.576499 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0632ff-2fdf-4fc9-9e45-4ea303cd70d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:00.576712 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0632ff-2fdf-4fc9-9e45-4ea303cd70d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:00.577004 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0632ff-2fdf-4fc9-9e45-4ea303cd70d1 admin admin] PATH_INFO: `/v3/users/440ddbfc4ebe462abd478f49ea28600f` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:00.578722 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0632ff-2fdf-4fc9-9e45-4ea303cd70d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=440ddbfc4ebe462abd478f49ea28600f)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:00.581083 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0632ff-2fdf-4fc9-9e45-4ea303cd70d1 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:00.652587 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-dc0632ff-2fdf-4fc9-9e45-4ea303cd70d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '440ddbfc4ebe462abd478f49ea28600f'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:00.667953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-dc0632ff-2fdf-4fc9-9e45-4ea303cd70d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '440ddbfc4ebe462abd478f49ea28600f'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:00.676289 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-dc0632ff-2fdf-4fc9-9e45-4ea303cd70d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '440ddbfc4ebe462abd478f49ea28600f'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:00.677015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-dc0632ff-2fdf-4fc9-9e45-4ea303cd70d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '440ddbfc4ebe462abd478f49ea28600f'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:00.686028 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-dc0632ff-2fdf-4fc9-9e45-4ea303cd70d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '440ddbfc4ebe462abd478f49ea28600f'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:00.697918 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1135/2282] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:06:00 2022] DELETE /identity/v3/users/440ddbfc4ebe462abd478f49ea28600f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:06:01.244889 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3f2ef-f4c3-4ad8-a87c-b7fbc8574e6c admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:01.246530 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-98e3f2ef-f4c3-4ad8-a87c-b7fbc8574e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:01.280084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3f2ef-f4c3-4ad8-a87c-b7fbc8574e6c admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:01.421746 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebf3e7-d204-40f3-9c81-1821ee39b340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:01.423548 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebf3e7-d204-40f3-9c81-1821ee39b340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:01.424149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebf3e7-d204-40f3-9c81-1821ee39b340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:01.424643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebf3e7-d204-40f3-9c81-1821ee39b340 admin admin] PATH_INFO: `/v3/projects/2a09e707d0914a7aa6fbc8f1c65d433f` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:01.426176 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebf3e7-d204-40f3-9c81-1821ee39b340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a09e707d0914a7aa6fbc8f1c65d433f)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:01.430180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebf3e7-d204-40f3-9c81-1821ee39b340 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:01.533878 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f5ebf3e7-d204-40f3-9c81-1821ee39b340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a09e707d0914a7aa6fbc8f1c65d433f', 'request_id': 'req-f5ebf3e7-d204-40f3-9c81-1821ee39b340'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:01.543768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f5ebf3e7-d204-40f3-9c81-1821ee39b340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a09e707d0914a7aa6fbc8f1c65d433f', 'request_id': 'req-f5ebf3e7-d204-40f3-9c81-1821ee39b340'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:01.566250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f5ebf3e7-d204-40f3-9c81-1821ee39b340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a09e707d0914a7aa6fbc8f1c65d433f', 'request_id': 'req-f5ebf3e7-d204-40f3-9c81-1821ee39b340'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:01.579867 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:06:01.588167 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f5ebf3e7-d204-40f3-9c81-1821ee39b340 admin admin] The token cache is being invalidate because project 2a09e707d0914a7aa6fbc8f1c65d433f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:06:01.588678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f5ebf3e7-d204-40f3-9c81-1821ee39b340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:01.596334 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f5ebf3e7-d204-40f3-9c81-1821ee39b340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:01.599038 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1148/2283] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:06:01 2022] DELETE /identity/v3/projects/2a09e707d0914a7aa6fbc8f1c65d433f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:06:01.604034 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0632ff-2fdf-4fc9-9e45-4ea303cd70d1 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:01.605611 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-dc0632ff-2fdf-4fc9-9e45-4ea303cd70d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:01.619526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0632ff-2fdf-4fc9-9e45-4ea303cd70d1 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:01.684224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:06:01.695658 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5041b-2f85-442a-aaad-b87ba5ed3317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:01.697428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5041b-2f85-442a-aaad-b87ba5ed3317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:01.697991 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5041b-2f85-442a-aaad-b87ba5ed3317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:01.698272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5041b-2f85-442a-aaad-b87ba5ed3317 admin admin] PATH_INFO: `/v3/users/a10cfa59cae148aa90eb930c8b00ca7d` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:01.700203 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5041b-2f85-442a-aaad-b87ba5ed3317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a10cfa59cae148aa90eb930c8b00ca7d)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:01.702566 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5041b-2f85-442a-aaad-b87ba5ed3317 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:01.759785 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-c0e5041b-2f85-442a-aaad-b87ba5ed3317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a10cfa59cae148aa90eb930c8b00ca7d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:01.772672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-c0e5041b-2f85-442a-aaad-b87ba5ed3317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a10cfa59cae148aa90eb930c8b00ca7d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:01.781026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-c0e5041b-2f85-442a-aaad-b87ba5ed3317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a10cfa59cae148aa90eb930c8b00ca7d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:01.781926 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-c0e5041b-2f85-442a-aaad-b87ba5ed3317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a10cfa59cae148aa90eb930c8b00ca7d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:01.791466 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-c0e5041b-2f85-442a-aaad-b87ba5ed3317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a10cfa59cae148aa90eb930c8b00ca7d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:01.813777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1136/2284] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:06:01 2022] DELETE /identity/v3/users/a10cfa59cae148aa90eb930c8b00ca7d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:06:02.195049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebf3e7-d204-40f3-9c81-1821ee39b340 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:02.197379 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-f5ebf3e7-d204-40f3-9c81-1821ee39b340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:02.264896 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebf3e7-d204-40f3-9c81-1821ee39b340 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:02.365836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf9ba9-2dd8-4b1d-a142-419d125deb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:02.367079 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf9ba9-2dd8-4b1d-a142-419d125deb07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:02.367643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf9ba9-2dd8-4b1d-a142-419d125deb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:02.367922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf9ba9-2dd8-4b1d-a142-419d125deb07 admin admin] PATH_INFO: `/v3/projects/41c16ae2eef0433a877f07fb731adcc8` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:02.369881 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf9ba9-2dd8-4b1d-a142-419d125deb07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41c16ae2eef0433a877f07fb731adcc8)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:02.371756 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf9ba9-2dd8-4b1d-a142-419d125deb07 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:02.434829 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-c3cf9ba9-2dd8-4b1d-a142-419d125deb07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41c16ae2eef0433a877f07fb731adcc8', 'request_id': 'req-c3cf9ba9-2dd8-4b1d-a142-419d125deb07'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:02.441887 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-c3cf9ba9-2dd8-4b1d-a142-419d125deb07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41c16ae2eef0433a877f07fb731adcc8', 'request_id': 'req-c3cf9ba9-2dd8-4b1d-a142-419d125deb07'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:02.452873 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-c3cf9ba9-2dd8-4b1d-a142-419d125deb07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41c16ae2eef0433a877f07fb731adcc8', 'request_id': 'req-c3cf9ba9-2dd8-4b1d-a142-419d125deb07'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:02.466908 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-c3cf9ba9-2dd8-4b1d-a142-419d125deb07 admin admin] The token cache is being invalidate because project 41c16ae2eef0433a877f07fb731adcc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:06:02.467339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-c3cf9ba9-2dd8-4b1d-a142-419d125deb07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:02.468051 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-c3cf9ba9-2dd8-4b1d-a142-419d125deb07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:02.469663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1149/2285] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:06:02 2022] DELETE /identity/v3/projects/41c16ae2eef0433a877f07fb731adcc8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:06:11.794603 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:06:12.463456 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:06:19.503130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5041b-2f85-442a-aaad-b87ba5ed3317 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:19.504804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-c0e5041b-2f85-442a-aaad-b87ba5ed3317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:19.522689 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5041b-2f85-442a-aaad-b87ba5ed3317 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:19.606954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2218e95-4f6e-47ae-924a-ebb77989d78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:19.608093 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2218e95-4f6e-47ae-924a-ebb77989d78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:19.608490 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2218e95-4f6e-47ae-924a-ebb77989d78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:19.608866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2218e95-4f6e-47ae-924a-ebb77989d78e admin admin] PATH_INFO: `/v3/users/6c22158da5fc45a5b80010e32b38689c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:19.610204 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2218e95-4f6e-47ae-924a-ebb77989d78e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c22158da5fc45a5b80010e32b38689c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:19.612656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2218e95-4f6e-47ae-924a-ebb77989d78e admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:19.688712 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d2218e95-4f6e-47ae-924a-ebb77989d78e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c22158da5fc45a5b80010e32b38689c'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:19.703192 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d2218e95-4f6e-47ae-924a-ebb77989d78e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c22158da5fc45a5b80010e32b38689c'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:19.712151 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d2218e95-4f6e-47ae-924a-ebb77989d78e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c22158da5fc45a5b80010e32b38689c'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:19.712897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d2218e95-4f6e-47ae-924a-ebb77989d78e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c22158da5fc45a5b80010e32b38689c'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:19.730815 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d2218e95-4f6e-47ae-924a-ebb77989d78e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c22158da5fc45a5b80010e32b38689c'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:19.738565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1137/2286] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:06:19 2022] DELETE /identity/v3/users/6c22158da5fc45a5b80010e32b38689c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:06:19.957572 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf9ba9-2dd8-4b1d-a142-419d125deb07 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:19.976677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-c3cf9ba9-2dd8-4b1d-a142-419d125deb07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:20.002329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf9ba9-2dd8-4b1d-a142-419d125deb07 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:20.063603 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4acddb-856e-4cfa-9c7f-e46b4d14ecef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:20.064528 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4acddb-856e-4cfa-9c7f-e46b4d14ecef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:20.064809 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4acddb-856e-4cfa-9c7f-e46b4d14ecef admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:20.065085 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4acddb-856e-4cfa-9c7f-e46b4d14ecef admin admin] PATH_INFO: `/v3/projects/665d818bf9714dd7820669579af82795` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:20.066354 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4acddb-856e-4cfa-9c7f-e46b4d14ecef admin admin] RBAC: Authorizing `identity:delete_project(project_id=665d818bf9714dd7820669579af82795)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:20.068392 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4acddb-856e-4cfa-9c7f-e46b4d14ecef admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:20.127576 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-7a4acddb-856e-4cfa-9c7f-e46b4d14ecef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '665d818bf9714dd7820669579af82795', 'request_id': 'req-7a4acddb-856e-4cfa-9c7f-e46b4d14ecef'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:20.135747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-7a4acddb-856e-4cfa-9c7f-e46b4d14ecef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '665d818bf9714dd7820669579af82795', 'request_id': 'req-7a4acddb-856e-4cfa-9c7f-e46b4d14ecef'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:20.146614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-7a4acddb-856e-4cfa-9c7f-e46b4d14ecef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '665d818bf9714dd7820669579af82795', 'request_id': 'req-7a4acddb-856e-4cfa-9c7f-e46b4d14ecef'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:20.160473 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-7a4acddb-856e-4cfa-9c7f-e46b4d14ecef admin admin] The token cache is being invalidate because project 665d818bf9714dd7820669579af82795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:06:20.160821 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-7a4acddb-856e-4cfa-9c7f-e46b4d14ecef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:20.161399 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-7a4acddb-856e-4cfa-9c7f-e46b4d14ecef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:20.165504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1150/2287] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:06:19 2022] DELETE /identity/v3/projects/665d818bf9714dd7820669579af82795 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:06:20.170097 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2218e95-4f6e-47ae-924a-ebb77989d78e admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:20.171895 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-d2218e95-4f6e-47ae-924a-ebb77989d78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:20.186346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2218e95-4f6e-47ae-924a-ebb77989d78e admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:20.253233 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47728d2-38ab-4f85-8ac2-9531c386870c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:20.254334 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47728d2-38ab-4f85-8ac2-9531c386870c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:20.254610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47728d2-38ab-4f85-8ac2-9531c386870c admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:20.254976 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47728d2-38ab-4f85-8ac2-9531c386870c admin admin] PATH_INFO: `/v3/users/080d04b2b98b40008269a0f6b13507d3` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:20.256463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47728d2-38ab-4f85-8ac2-9531c386870c admin admin] RBAC: Authorizing `identity:delete_user(user_id=080d04b2b98b40008269a0f6b13507d3)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:20.258941 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47728d2-38ab-4f85-8ac2-9531c386870c admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:20.291507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:06:20.329842 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-c47728d2-38ab-4f85-8ac2-9531c386870c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '080d04b2b98b40008269a0f6b13507d3'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:20.364233 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-c47728d2-38ab-4f85-8ac2-9531c386870c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '080d04b2b98b40008269a0f6b13507d3'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:20.371818 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-c47728d2-38ab-4f85-8ac2-9531c386870c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '080d04b2b98b40008269a0f6b13507d3'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:20.372581 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-c47728d2-38ab-4f85-8ac2-9531c386870c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '080d04b2b98b40008269a0f6b13507d3'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:20.383671 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-c47728d2-38ab-4f85-8ac2-9531c386870c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '080d04b2b98b40008269a0f6b13507d3'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:20.392705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1138/2288] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:06:20 2022] DELETE /identity/v3/users/080d04b2b98b40008269a0f6b13507d3 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:06:20.591043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4acddb-856e-4cfa-9c7f-e46b4d14ecef admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:20.592806 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-7a4acddb-856e-4cfa-9c7f-e46b4d14ecef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:20.640842 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4acddb-856e-4cfa-9c7f-e46b4d14ecef admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:20.757664 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88d8f3-3819-47ca-b951-1033b9299ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:20.759105 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88d8f3-3819-47ca-b951-1033b9299ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:20.759456 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88d8f3-3819-47ca-b951-1033b9299ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:20.759743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88d8f3-3819-47ca-b951-1033b9299ea4 admin admin] PATH_INFO: `/v3/projects/5b4cb4b1e0164ec9a7b1ebe356819e1f` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:20.761384 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88d8f3-3819-47ca-b951-1033b9299ea4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b4cb4b1e0164ec9a7b1ebe356819e1f)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:20.763662 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88d8f3-3819-47ca-b951-1033b9299ea4 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:20.827814 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:06:20.846460 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-8d88d8f3-3819-47ca-b951-1033b9299ea4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b4cb4b1e0164ec9a7b1ebe356819e1f', 'request_id': 'req-8d88d8f3-3819-47ca-b951-1033b9299ea4'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:20.853222 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-8d88d8f3-3819-47ca-b951-1033b9299ea4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b4cb4b1e0164ec9a7b1ebe356819e1f', 'request_id': 'req-8d88d8f3-3819-47ca-b951-1033b9299ea4'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:20.871988 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-8d88d8f3-3819-47ca-b951-1033b9299ea4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b4cb4b1e0164ec9a7b1ebe356819e1f', 'request_id': 'req-8d88d8f3-3819-47ca-b951-1033b9299ea4'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:20.892662 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-8d88d8f3-3819-47ca-b951-1033b9299ea4 admin admin] The token cache is being invalidate because project 5b4cb4b1e0164ec9a7b1ebe356819e1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:06:20.892943 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-8d88d8f3-3819-47ca-b951-1033b9299ea4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:20.895725 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-8d88d8f3-3819-47ca-b951-1033b9299ea4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:20.903526 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1151/2289] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:06:20 2022] DELETE /identity/v3/projects/5b4cb4b1e0164ec9a7b1ebe356819e1f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:06:20.905869 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517baa1e-e377-483f-aec8-fe00edf40975 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:20.906450 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517baa1e-e377-483f-aec8-fe00edf40975 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:20.906599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517baa1e-e377-483f-aec8-fe00edf40975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:20.930908 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-517baa1e-e377-483f-aec8-fe00edf40975 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:06:20.932348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-517baa1e-e377-483f-aec8-fe00edf40975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:21.028618 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1139/2290] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:06:21.036742 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c83aa3-2034-4dfc-88bc-4f9089626f1e None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:21.037233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c83aa3-2034-4dfc-88bc-4f9089626f1e None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:21.037326 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c83aa3-2034-4dfc-88bc-4f9089626f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:21.057167 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-28c83aa3-2034-4dfc-88bc-4f9089626f1e None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:06:21.058721 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-28c83aa3-2034-4dfc-88bc-4f9089626f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:21.067121 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1152/2291] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:06:21.071633 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517baa1e-e377-483f-aec8-fe00edf40975 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:21.082297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517baa1e-e377-483f-aec8-fe00edf40975 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:21.087590 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a56b0-ef0c-4cb1-9135-1a76a5638a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:21.088280 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a56b0-ef0c-4cb1-9135-1a76a5638a57 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:21.088564 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a56b0-ef0c-4cb1-9135-1a76a5638a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:21.088841 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a56b0-ef0c-4cb1-9135-1a76a5638a57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:21.090283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a56b0-ef0c-4cb1-9135-1a76a5638a57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:06:21.090602 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a56b0-ef0c-4cb1-9135-1a76a5638a57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:21.092281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a56b0-ef0c-4cb1-9135-1a76a5638a57 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:21.111213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1140/2292] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 02:06:21.115695 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c83aa3-2034-4dfc-88bc-4f9089626f1e None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:21.125880 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c83aa3-2034-4dfc-88bc-4f9089626f1e None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:21.132509 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba18d60-87d7-4c5e-85e8-8edffa4807b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:21.133447 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba18d60-87d7-4c5e-85e8-8edffa4807b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:21.133736 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba18d60-87d7-4c5e-85e8-8edffa4807b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:21.134000 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba18d60-87d7-4c5e-85e8-8edffa4807b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:21.134706 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba18d60-87d7-4c5e-85e8-8edffa4807b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:21.137056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba18d60-87d7-4c5e-85e8-8edffa4807b1 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:21.166987 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1153/2293] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:06:21 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:06:21.171371 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a56b0-ef0c-4cb1-9135-1a76a5638a57 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:21.182436 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a56b0-ef0c-4cb1-9135-1a76a5638a57 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:21.245655 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8070b8-86fb-49cc-b1cb-df4d811aa535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:21.246559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8070b8-86fb-49cc-b1cb-df4d811aa535 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:21.246848 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8070b8-86fb-49cc-b1cb-df4d811aa535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:21.247124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8070b8-86fb-49cc-b1cb-df4d811aa535 admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:21.247908 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8070b8-86fb-49cc-b1cb-df4d811aa535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:21.249881 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8070b8-86fb-49cc-b1cb-df4d811aa535 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:21.271603 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1141/2294] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:06:21 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:06:21.275773 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba18d60-87d7-4c5e-85e8-8edffa4807b1 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:21.290519 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba18d60-87d7-4c5e-85e8-8edffa4807b1 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:21.295986 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcaf0c-a9e4-4da7-be8f-40fdc111129d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:21.296823 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcaf0c-a9e4-4da7-be8f-40fdc111129d admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:21.297116 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcaf0c-a9e4-4da7-be8f-40fdc111129d admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:21.297391 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcaf0c-a9e4-4da7-be8f-40fdc111129d admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:21.298461 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcaf0c-a9e4-4da7-be8f-40fdc111129d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:21.300222 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcaf0c-a9e4-4da7-be8f-40fdc111129d admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:21.314753 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1154/2295] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:06:21.316111 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8070b8-86fb-49cc-b1cb-df4d811aa535 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:21.326865 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8070b8-86fb-49cc-b1cb-df4d811aa535 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:21.332471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60078b-f40b-418e-ace1-a2eb6ffd0715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:21.333148 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60078b-f40b-418e-ace1-a2eb6ffd0715 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:21.333427 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60078b-f40b-418e-ace1-a2eb6ffd0715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:21.333706 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60078b-f40b-418e-ace1-a2eb6ffd0715 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:21.334453 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60078b-f40b-418e-ace1-a2eb6ffd0715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:21.336136 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60078b-f40b-418e-ace1-a2eb6ffd0715 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:21.346872 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1142/2296] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:06:21.351192 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcaf0c-a9e4-4da7-be8f-40fdc111129d admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:21.361954 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcaf0c-a9e4-4da7-be8f-40fdc111129d admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:21.366815 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213292b8-5118-4606-a40c-9f5ebd98e2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:21.367750 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213292b8-5118-4606-a40c-9f5ebd98e2e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:21.368027 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213292b8-5118-4606-a40c-9f5ebd98e2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:21.368301 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213292b8-5118-4606-a40c-9f5ebd98e2e1 admin admin] PATH_INFO: `/v3/projects/c40ec68b48db46fb82df6862206298ee/users/c9f9d4f528794f02a51e9c6c479f7c6d/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:21.384039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213292b8-5118-4606-a40c-9f5ebd98e2e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c40ec68b48db46fb82df6862206298ee, user_id=c9f9d4f528794f02a51e9c6c479f7c6d, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:21.386809 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213292b8-5118-4606-a40c-9f5ebd98e2e1 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:21.401149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1155/2297] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:06:21 2022] PUT /identity/v3/projects/c40ec68b48db46fb82df6862206298ee/users/c9f9d4f528794f02a51e9c6c479f7c6d/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:06:21.411342 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e88e1-9087-4fd0-87e8-bfcb6eb8ad6e None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:21.411811 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e88e1-9087-4fd0-87e8-bfcb6eb8ad6e None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:21.411907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e88e1-9087-4fd0-87e8-bfcb6eb8ad6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:21.419048 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:06:21.444553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-a37e88e1-9087-4fd0-87e8-bfcb6eb8ad6e None None] MFA Rules not processed for user `c9f9d4f528794f02a51e9c6c479f7c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:06:21.445800 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a37e88e1-9087-4fd0-87e8-bfcb6eb8ad6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:21.513465 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1143/2298] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:06:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:06:21.524389 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213292b8-5118-4606-a40c-9f5ebd98e2e1 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:21.525323 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21237a-e93e-48e3-9f0e-853bad97f007 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:21.525616 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21237a-e93e-48e3-9f0e-853bad97f007 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:21.525892 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21237a-e93e-48e3-9f0e-853bad97f007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:21.526382 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-213292b8-5118-4606-a40c-9f5ebd98e2e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:21.544649 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-ca21237a-e93e-48e3-9f0e-853bad97f007 None None] MFA Rules not processed for user `0dbf596d8f964d4695944a23dd8e4cef`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:06:21.545945 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-ca21237a-e93e-48e3-9f0e-853bad97f007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:21.586275 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213292b8-5118-4606-a40c-9f5ebd98e2e1 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:21.590671 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203b8aa-dc52-485f-ba67-9a5d2ee5854a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:21.591360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203b8aa-dc52-485f-ba67-9a5d2ee5854a service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:21.591704 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203b8aa-dc52-485f-ba67-9a5d2ee5854a service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:21.591949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203b8aa-dc52-485f-ba67-9a5d2ee5854a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:21.601872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203b8aa-dc52-485f-ba67-9a5d2ee5854a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:21.602354 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1144/2299] 10.222.0.13 () {58 vars in 967 bytes} [Thu Jun 23 02:06:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:06:21.603349 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203b8aa-dc52-485f-ba67-9a5d2ee5854a service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:21.612916 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1156/2300] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:06:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:06:21.615657 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21237a-e93e-48e3-9f0e-853bad97f007 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:21.617011 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-ca21237a-e93e-48e3-9f0e-853bad97f007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:21.689374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21237a-e93e-48e3-9f0e-853bad97f007 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:21.694719 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a933a-47de-4508-a251-8dd21b909021 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae132c4d0b5461aa26ab929a017cb08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:21.695379 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a933a-47de-4508-a251-8dd21b909021 service swift] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:21.695685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a933a-47de-4508-a251-8dd21b909021 service swift] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:21.695961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a933a-47de-4508-a251-8dd21b909021 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:21.705292 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a933a-47de-4508-a251-8dd21b909021 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:21.706819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a933a-47de-4508-a251-8dd21b909021 service swift] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:21.715164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1145/2301] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 02:06:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 02:06:23.729206 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203b8aa-dc52-485f-ba67-9a5d2ee5854a service cinder] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:23.730701 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-2203b8aa-dc52-485f-ba67-9a5d2ee5854a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:23.804434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203b8aa-dc52-485f-ba67-9a5d2ee5854a service cinder] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:23.811371 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9565ec4-a67a-4ab3-b7d1-f12c7d37887b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:23.812314 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9565ec4-a67a-4ab3-b7d1-f12c7d37887b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:23.812600 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9565ec4-a67a-4ab3-b7d1-f12c7d37887b admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:23.812879 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9565ec4-a67a-4ab3-b7d1-f12c7d37887b admin admin] PATH_INFO: `/v3/users/2790457b77004defbea2825d15d8f00d` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:23.814083 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9565ec4-a67a-4ab3-b7d1-f12c7d37887b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2790457b77004defbea2825d15d8f00d)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:23.816173 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9565ec4-a67a-4ab3-b7d1-f12c7d37887b admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:23.817769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:06:23.872562 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e9565ec4-a67a-4ab3-b7d1-f12c7d37887b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2790457b77004defbea2825d15d8f00d'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:23.891609 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e9565ec4-a67a-4ab3-b7d1-f12c7d37887b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2790457b77004defbea2825d15d8f00d'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:23.892441 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e9565ec4-a67a-4ab3-b7d1-f12c7d37887b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2790457b77004defbea2825d15d8f00d'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:23.893987 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e9565ec4-a67a-4ab3-b7d1-f12c7d37887b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2790457b77004defbea2825d15d8f00d'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:23.908341 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-e9565ec4-a67a-4ab3-b7d1-f12c7d37887b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2790457b77004defbea2825d15d8f00d'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:23.923777 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1157/2302] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:06:23 2022] DELETE /identity/v3/users/2790457b77004defbea2825d15d8f00d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:06:24.117773 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a933a-47de-4508-a251-8dd21b909021 service swift] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:24.131100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a933a-47de-4508-a251-8dd21b909021 service swift] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:24.162546 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:06:24.204365 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891026f9-e15e-4bb2-9918-9a20996e45db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:24.205279 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891026f9-e15e-4bb2-9918-9a20996e45db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:24.205838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891026f9-e15e-4bb2-9918-9a20996e45db admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:24.206128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891026f9-e15e-4bb2-9918-9a20996e45db admin admin] PATH_INFO: `/v3/projects/3ecffc37690a49dc8cda96b5fabacc9b` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:24.207610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891026f9-e15e-4bb2-9918-9a20996e45db admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ecffc37690a49dc8cda96b5fabacc9b)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:24.210093 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891026f9-e15e-4bb2-9918-9a20996e45db admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:24.284451 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-891026f9-e15e-4bb2-9918-9a20996e45db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ecffc37690a49dc8cda96b5fabacc9b', 'request_id': 'req-891026f9-e15e-4bb2-9918-9a20996e45db'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:24.298367 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-891026f9-e15e-4bb2-9918-9a20996e45db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ecffc37690a49dc8cda96b5fabacc9b', 'request_id': 'req-891026f9-e15e-4bb2-9918-9a20996e45db'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:24.306027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-891026f9-e15e-4bb2-9918-9a20996e45db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ecffc37690a49dc8cda96b5fabacc9b', 'request_id': 'req-891026f9-e15e-4bb2-9918-9a20996e45db'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:24.324837 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-891026f9-e15e-4bb2-9918-9a20996e45db admin admin] The token cache is being invalidate because project 3ecffc37690a49dc8cda96b5fabacc9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:06:24.325184 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-891026f9-e15e-4bb2-9918-9a20996e45db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:24.325880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-891026f9-e15e-4bb2-9918-9a20996e45db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:24.327723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1146/2303] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:06:24 2022] DELETE /identity/v3/projects/3ecffc37690a49dc8cda96b5fabacc9b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:06:24.335151 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d3e37-6d42-49b5-83b8-f0622a0a8d2a None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:24.335756 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d3e37-6d42-49b5-83b8-f0622a0a8d2a None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:24.335924 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d3e37-6d42-49b5-83b8-f0622a0a8d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:24.366347 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-327d3e37-6d42-49b5-83b8-f0622a0a8d2a None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:06:24.367920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-327d3e37-6d42-49b5-83b8-f0622a0a8d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:24.467228 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1158/2304] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:06:24.474908 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0f47b-052c-4575-a4f1-d2171114d95a None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:24.476893 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0f47b-052c-4575-a4f1-d2171114d95a None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:24.477184 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0f47b-052c-4575-a4f1-d2171114d95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:24.505031 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-94a0f47b-052c-4575-a4f1-d2171114d95a None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:06:24.506984 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-94a0f47b-052c-4575-a4f1-d2171114d95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:24.517846 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1147/2305] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:06:24.523501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d3e37-6d42-49b5-83b8-f0622a0a8d2a None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:24.536039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d3e37-6d42-49b5-83b8-f0622a0a8d2a None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:24.541226 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e9777-b4e4-4a38-ac99-75c39f1beaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:24.541930 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e9777-b4e4-4a38-ac99-75c39f1beaf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:24.542209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e9777-b4e4-4a38-ac99-75c39f1beaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:24.542495 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e9777-b4e4-4a38-ac99-75c39f1beaf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:24.543224 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e9777-b4e4-4a38-ac99-75c39f1beaf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:06:24.543618 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e9777-b4e4-4a38-ac99-75c39f1beaf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:24.545321 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e9777-b4e4-4a38-ac99-75c39f1beaf8 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:24.560091 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1159/2306] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:06:24.564583 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0f47b-052c-4575-a4f1-d2171114d95a None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:24.574095 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0f47b-052c-4575-a4f1-d2171114d95a None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:24.579641 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bc132-7d16-4faf-bc6d-307d94e6808e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:24.580308 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bc132-7d16-4faf-bc6d-307d94e6808e admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:24.580596 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bc132-7d16-4faf-bc6d-307d94e6808e admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:24.580924 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bc132-7d16-4faf-bc6d-307d94e6808e admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:24.581637 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5bc132-7d16-4faf-bc6d-307d94e6808e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:24.583679 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5bc132-7d16-4faf-bc6d-307d94e6808e admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:24.616758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1148/2307] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:06:24 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:06:24.620960 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e9777-b4e4-4a38-ac99-75c39f1beaf8 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:24.631367 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e9777-b4e4-4a38-ac99-75c39f1beaf8 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:24.697865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2de56-7aa9-4df4-8354-4e73e5f31e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:24.698797 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2de56-7aa9-4df4-8354-4e73e5f31e52 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:24.699181 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2de56-7aa9-4df4-8354-4e73e5f31e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:24.699719 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2de56-7aa9-4df4-8354-4e73e5f31e52 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:24.701193 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2de56-7aa9-4df4-8354-4e73e5f31e52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:24.703325 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2de56-7aa9-4df4-8354-4e73e5f31e52 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:24.718017 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:06:24.734830 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1160/2308] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:06:24 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:06:24.738740 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bc132-7d16-4faf-bc6d-307d94e6808e admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:24.749755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bc132-7d16-4faf-bc6d-307d94e6808e admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:24.756008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0d490-e61b-43b8-9385-5f11db07087a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:24.756578 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0d490-e61b-43b8-9385-5f11db07087a admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:24.756868 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0d490-e61b-43b8-9385-5f11db07087a admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:24.757150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0d490-e61b-43b8-9385-5f11db07087a admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:24.757935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0d490-e61b-43b8-9385-5f11db07087a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:24.759627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0d490-e61b-43b8-9385-5f11db07087a admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:24.772112 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1149/2309] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:06:24.776374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2de56-7aa9-4df4-8354-4e73e5f31e52 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:24.787283 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2de56-7aa9-4df4-8354-4e73e5f31e52 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:24.792188 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dacced-92ee-4875-b45d-57b852c16552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:24.792999 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dacced-92ee-4875-b45d-57b852c16552 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:24.793521 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dacced-92ee-4875-b45d-57b852c16552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:24.793744 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dacced-92ee-4875-b45d-57b852c16552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:24.794444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dacced-92ee-4875-b45d-57b852c16552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:24.796134 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dacced-92ee-4875-b45d-57b852c16552 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:24.806927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1161/2310] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:06:24.812039 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0d490-e61b-43b8-9385-5f11db07087a admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:24.823209 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0d490-e61b-43b8-9385-5f11db07087a admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:24.828632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8cb74-585b-4065-b94b-28ecc3f4f8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:24.829536 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8cb74-585b-4065-b94b-28ecc3f4f8df admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:24.829819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8cb74-585b-4065-b94b-28ecc3f4f8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:24.830095 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8cb74-585b-4065-b94b-28ecc3f4f8df admin admin] PATH_INFO: `/v3/projects/91d6f3c1b4fa41a2992f5f800760c8f8/users/959a94ebbca34821ae2a07e1d98084ce/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:24.848671 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8cb74-585b-4065-b94b-28ecc3f4f8df admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d6f3c1b4fa41a2992f5f800760c8f8, user_id=959a94ebbca34821ae2a07e1d98084ce, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:24.851448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8cb74-585b-4065-b94b-28ecc3f4f8df admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:24.869355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1150/2311] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:06:24 2022] PUT /identity/v3/projects/91d6f3c1b4fa41a2992f5f800760c8f8/users/959a94ebbca34821ae2a07e1d98084ce/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:06:24.874694 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797d736-fa57-4d76-85fa-c88ae1f68b01 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:24.874976 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797d736-fa57-4d76-85fa-c88ae1f68b01 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:24.875263 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797d736-fa57-4d76-85fa-c88ae1f68b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:24.895344 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-2797d736-fa57-4d76-85fa-c88ae1f68b01 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:06:24.896713 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-2797d736-fa57-4d76-85fa-c88ae1f68b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:24.967188 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1162/2312] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:06:24.977755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8cb74-585b-4065-b94b-28ecc3f4f8df admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:24.980535 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-12c8cb74-585b-4065-b94b-28ecc3f4f8df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:25.044277 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8cb74-585b-4065-b94b-28ecc3f4f8df admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:25.049251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774e5f0-bddd-43ec-8d3a-9cd5c56accfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:25.050115 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774e5f0-bddd-43ec-8d3a-9cd5c56accfc service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:25.050402 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774e5f0-bddd-43ec-8d3a-9cd5c56accfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:25.050680 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774e5f0-bddd-43ec-8d3a-9cd5c56accfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:25.061411 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774e5f0-bddd-43ec-8d3a-9cd5c56accfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:25.062860 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774e5f0-bddd-43ec-8d3a-9cd5c56accfc service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:25.066760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:06:25.073478 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1151/2313] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:06:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:06:25.791168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de3153-3cd4-4cf0-9996-4884c10bfd35 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:25.791604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de3153-3cd4-4cf0-9996-4884c10bfd35 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:25.795911 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de3153-3cd4-4cf0-9996-4884c10bfd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:25.827871 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-b3de3153-3cd4-4cf0-9996-4884c10bfd35 None None] MFA Rules not processed for user `959a94ebbca34821ae2a07e1d98084ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:06:25.829170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-b3de3153-3cd4-4cf0-9996-4884c10bfd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:25.915327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1163/2314] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:06:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:06:25.926964 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774e5f0-bddd-43ec-8d3a-9cd5c56accfc service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:25.928912 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-1774e5f0-bddd-43ec-8d3a-9cd5c56accfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:25.996080 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774e5f0-bddd-43ec-8d3a-9cd5c56accfc service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:25.999809 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b619db-9c3e-46ec-9564-8b64c8ff0766 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:26.000468 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b619db-9c3e-46ec-9564-8b64c8ff0766 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:26.000752 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b619db-9c3e-46ec-9564-8b64c8ff0766 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:26.001029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b619db-9c3e-46ec-9564-8b64c8ff0766 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:26.010813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b619db-9c3e-46ec-9564-8b64c8ff0766 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:26.012516 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b619db-9c3e-46ec-9564-8b64c8ff0766 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:26.024564 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1152/2315] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:06:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:06:27.245085 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de3153-3cd4-4cf0-9996-4884c10bfd35 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:27.246678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-b3de3153-3cd4-4cf0-9996-4884c10bfd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:27.261926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de3153-3cd4-4cf0-9996-4884c10bfd35 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:27.267042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dc6bf-4a3f-4320-a3e6-6009ba954f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:27.268165 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dc6bf-4a3f-4320-a3e6-6009ba954f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:27.268445 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dc6bf-4a3f-4320-a3e6-6009ba954f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:27.268747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dc6bf-4a3f-4320-a3e6-6009ba954f52 admin admin] PATH_INFO: `/v3/users/c9f9d4f528794f02a51e9c6c479f7c6d` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:27.269970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37dc6bf-4a3f-4320-a3e6-6009ba954f52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9f9d4f528794f02a51e9c6c479f7c6d)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:27.271995 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37dc6bf-4a3f-4320-a3e6-6009ba954f52 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:27.322678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-c37dc6bf-4a3f-4320-a3e6-6009ba954f52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9f9d4f528794f02a51e9c6c479f7c6d'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:27.333744 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-c37dc6bf-4a3f-4320-a3e6-6009ba954f52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9f9d4f528794f02a51e9c6c479f7c6d'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:27.334541 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-c37dc6bf-4a3f-4320-a3e6-6009ba954f52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9f9d4f528794f02a51e9c6c479f7c6d'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:27.335261 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-c37dc6bf-4a3f-4320-a3e6-6009ba954f52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9f9d4f528794f02a51e9c6c479f7c6d'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:27.349483 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:06:27.353079 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-c37dc6bf-4a3f-4320-a3e6-6009ba954f52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9f9d4f528794f02a51e9c6c479f7c6d'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:27.369600 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1164/2316] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:06:27 2022] DELETE /identity/v3/users/c9f9d4f528794f02a51e9c6c479f7c6d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:06:27.375728 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442069b8-e50c-4f31-8a35-adbb7d791710 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:27.376464 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442069b8-e50c-4f31-8a35-adbb7d791710 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:27.377065 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442069b8-e50c-4f31-8a35-adbb7d791710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:27.400280 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc511085-45e7-400c-b563-d595e6ca5f17 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:27.400573 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc511085-45e7-400c-b563-d595e6ca5f17 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:27.400849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc511085-45e7-400c-b563-d595e6ca5f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:27.413525 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-442069b8-e50c-4f31-8a35-adbb7d791710 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:06:27.414999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-442069b8-e50c-4f31-8a35-adbb7d791710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:27.421889 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-dc511085-45e7-400c-b563-d595e6ca5f17 None None] MFA Rules not processed for user `959a94ebbca34821ae2a07e1d98084ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:06:27.423721 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-dc511085-45e7-400c-b563-d595e6ca5f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:27.482602 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1153/2317] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:06:27.494220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442069b8-e50c-4f31-8a35-adbb7d791710 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:27.494619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1165/2318] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:06:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:06:27.496373 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-442069b8-e50c-4f31-8a35-adbb7d791710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:27.577277 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442069b8-e50c-4f31-8a35-adbb7d791710 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:27.580810 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e1b7a-3686-4deb-a1f5-bf891e22e370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:27.581470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e1b7a-3686-4deb-a1f5-bf891e22e370 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:27.581754 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e1b7a-3686-4deb-a1f5-bf891e22e370 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:27.582029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e1b7a-3686-4deb-a1f5-bf891e22e370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:27.591760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e1b7a-3686-4deb-a1f5-bf891e22e370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:27.593368 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e1b7a-3686-4deb-a1f5-bf891e22e370 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:27.603468 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1154/2319] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:06:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:06:28.224132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc511085-45e7-400c-b563-d595e6ca5f17 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:28.225598 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-dc511085-45e7-400c-b563-d595e6ca5f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:28.242102 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc511085-45e7-400c-b563-d595e6ca5f17 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:28.248274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ae0b0-e24c-4962-99bc-2f3b72ed27c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:28.249257 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ae0b0-e24c-4962-99bc-2f3b72ed27c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:28.249610 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ae0b0-e24c-4962-99bc-2f3b72ed27c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:28.249956 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ae0b0-e24c-4962-99bc-2f3b72ed27c9 admin admin] PATH_INFO: `/v3/projects/c40ec68b48db46fb82df6862206298ee` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:28.251774 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ae0b0-e24c-4962-99bc-2f3b72ed27c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c40ec68b48db46fb82df6862206298ee)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:28.253793 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ae0b0-e24c-4962-99bc-2f3b72ed27c9 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:28.314162 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-310ae0b0-e24c-4962-99bc-2f3b72ed27c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c40ec68b48db46fb82df6862206298ee', 'request_id': 'req-310ae0b0-e24c-4962-99bc-2f3b72ed27c9'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:28.322702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-310ae0b0-e24c-4962-99bc-2f3b72ed27c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c40ec68b48db46fb82df6862206298ee', 'request_id': 'req-310ae0b0-e24c-4962-99bc-2f3b72ed27c9'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:28.334733 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-310ae0b0-e24c-4962-99bc-2f3b72ed27c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c40ec68b48db46fb82df6862206298ee', 'request_id': 'req-310ae0b0-e24c-4962-99bc-2f3b72ed27c9'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:28.354835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-310ae0b0-e24c-4962-99bc-2f3b72ed27c9 admin admin] The token cache is being invalidate because project c40ec68b48db46fb82df6862206298ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:06:28.355117 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-310ae0b0-e24c-4962-99bc-2f3b72ed27c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:28.356092 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-310ae0b0-e24c-4962-99bc-2f3b72ed27c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:28.364319 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1166/2320] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:06:28 2022] DELETE /identity/v3/projects/c40ec68b48db46fb82df6862206298ee => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:06:28.365346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727be490-d0df-4c76-9fcc-8132d804713f None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:28.365785 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727be490-d0df-4c76-9fcc-8132d804713f None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:28.366313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727be490-d0df-4c76-9fcc-8132d804713f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:28.385110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-727be490-d0df-4c76-9fcc-8132d804713f None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:06:28.387797 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-727be490-d0df-4c76-9fcc-8132d804713f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:28.453000 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:06:28.477059 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1155/2321] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:06:28.484858 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa434f7-0f8c-49c8-9c5e-ca0ac58a2225 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:28.485379 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa434f7-0f8c-49c8-9c5e-ca0ac58a2225 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:28.485850 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa434f7-0f8c-49c8-9c5e-ca0ac58a2225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:28.505701 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-5aa434f7-0f8c-49c8-9c5e-ca0ac58a2225 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:06:28.506998 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5aa434f7-0f8c-49c8-9c5e-ca0ac58a2225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:28.515817 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1167/2322] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:06:28.520637 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727be490-d0df-4c76-9fcc-8132d804713f None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:28.531315 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727be490-d0df-4c76-9fcc-8132d804713f None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:28.536653 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0102c1-546b-4cc8-8441-b2b9895634bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:28.537391 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0102c1-546b-4cc8-8441-b2b9895634bb admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:28.537774 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0102c1-546b-4cc8-8441-b2b9895634bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:28.538118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0102c1-546b-4cc8-8441-b2b9895634bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:28.538864 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0102c1-546b-4cc8-8441-b2b9895634bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:06:28.539174 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0102c1-546b-4cc8-8441-b2b9895634bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:28.540970 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0102c1-546b-4cc8-8441-b2b9895634bb admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:28.560701 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1156/2323] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:06:28.564952 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa434f7-0f8c-49c8-9c5e-ca0ac58a2225 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:28.574347 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa434f7-0f8c-49c8-9c5e-ca0ac58a2225 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:28.580370 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2f0e7-6e04-4a97-9c3d-ac9d96a624cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:28.581173 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2f0e7-6e04-4a97-9c3d-ac9d96a624cf admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:28.581658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2f0e7-6e04-4a97-9c3d-ac9d96a624cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:28.582026 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2f0e7-6e04-4a97-9c3d-ac9d96a624cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:28.582815 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2f0e7-6e04-4a97-9c3d-ac9d96a624cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:28.584948 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2f0e7-6e04-4a97-9c3d-ac9d96a624cf admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:28.619120 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1168/2324] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:06:28 2022] POST /identity/v3/projects => generated 397 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:06:28.620427 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0102c1-546b-4cc8-8441-b2b9895634bb admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:28.633633 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0102c1-546b-4cc8-8441-b2b9895634bb admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:28.703343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f3697-eac5-4159-bb35-ee47ac5c8f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:28.704103 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f3697-eac5-4159-bb35-ee47ac5c8f83 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:28.704377 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f3697-eac5-4159-bb35-ee47ac5c8f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:28.704655 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f3697-eac5-4159-bb35-ee47ac5c8f83 admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:28.705392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f3697-eac5-4159-bb35-ee47ac5c8f83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:28.707526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f3697-eac5-4159-bb35-ee47ac5c8f83 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:28.738666 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1157/2325] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:06:28 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:06:28.739688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2f0e7-6e04-4a97-9c3d-ac9d96a624cf admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:28.751301 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2f0e7-6e04-4a97-9c3d-ac9d96a624cf admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:28.757399 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd5418-041f-4311-81f7-821208ebd294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:28.758504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd5418-041f-4311-81f7-821208ebd294 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:28.758628 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd5418-041f-4311-81f7-821208ebd294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:28.758972 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd5418-041f-4311-81f7-821208ebd294 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:28.759892 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd5418-041f-4311-81f7-821208ebd294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:28.762018 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd5418-041f-4311-81f7-821208ebd294 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:28.779772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1169/2326] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:06:28.784108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f3697-eac5-4159-bb35-ee47ac5c8f83 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:28.799687 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f3697-eac5-4159-bb35-ee47ac5c8f83 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:28.799876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08d87c-d45b-4f86-b34a-f4c615bcde79 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:28.800104 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08d87c-d45b-4f86-b34a-f4c615bcde79 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:28.800432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08d87c-d45b-4f86-b34a-f4c615bcde79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:28.806230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0318c-fdf9-475d-aa74-ef3df7d2277f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:28.807013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0318c-fdf9-475d-aa74-ef3df7d2277f admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:28.807448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0318c-fdf9-475d-aa74-ef3df7d2277f admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:28.807805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0318c-fdf9-475d-aa74-ef3df7d2277f admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:28.808680 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0318c-fdf9-475d-aa74-ef3df7d2277f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:28.810351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0318c-fdf9-475d-aa74-ef3df7d2277f admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:28.818652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-8b08d87c-d45b-4f86-b34a-f4c615bcde79 None None] MFA Rules not processed for user `0c3ad28388a84ebd9d386fa466c65ba9`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:06:28.819893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-8b08d87c-d45b-4f86-b34a-f4c615bcde79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:28.826677 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1158/2327] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:06:28.828063 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0318c-fdf9-475d-aa74-ef3df7d2277f admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:28.840866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0318c-fdf9-475d-aa74-ef3df7d2277f admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:28.847862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9adaa-1bdc-4947-a8ec-63bf89571226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:28.848839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9adaa-1bdc-4947-a8ec-63bf89571226 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:28.849190 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9adaa-1bdc-4947-a8ec-63bf89571226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:28.849533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9adaa-1bdc-4947-a8ec-63bf89571226 admin admin] PATH_INFO: `/v3/projects/0ef2342960cc474686665aaac212e93a/users/ce6499279f90452ba8be2af47772844d/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:28.853995 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:06:28.867947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9adaa-1bdc-4947-a8ec-63bf89571226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ef2342960cc474686665aaac212e93a, user_id=ce6499279f90452ba8be2af47772844d, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:28.870686 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9adaa-1bdc-4947-a8ec-63bf89571226 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:28.885053 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1170/2328] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:06:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:06:28.887828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1159/2329] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:06:28 2022] PUT /identity/v3/projects/0ef2342960cc474686665aaac212e93a/users/ce6499279f90452ba8be2af47772844d/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:06:28.899217 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f559982-d5a6-46b7-b57d-873238437394 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:28.911726 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f559982-d5a6-46b7-b57d-873238437394 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:28.912059 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f559982-d5a6-46b7-b57d-873238437394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:28.946379 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-3f559982-d5a6-46b7-b57d-873238437394 None None] MFA Rules not processed for user `ce6499279f90452ba8be2af47772844d`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:06:28.947937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-3f559982-d5a6-46b7-b57d-873238437394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:29.022796 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9adaa-1bdc-4947-a8ec-63bf89571226 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:29.024934 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-8fc9adaa-1bdc-4947-a8ec-63bf89571226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:29.038106 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1171/2330] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:06:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:06:29.050461 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f559982-d5a6-46b7-b57d-873238437394 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:29.052100 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-3f559982-d5a6-46b7-b57d-873238437394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:29.095296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9adaa-1bdc-4947-a8ec-63bf89571226 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:29.100914 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98149f-bb73-4896-99d3-5611dcdc1c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:29.102675 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98149f-bb73-4896-99d3-5611dcdc1c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:29.103151 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98149f-bb73-4896-99d3-5611dcdc1c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:29.104307 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98149f-bb73-4896-99d3-5611dcdc1c4a admin admin] PATH_INFO: `/v3/users/ce1164d2ec454a7aa200c59e5b6a401a` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:29.106282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98149f-bb73-4896-99d3-5611dcdc1c4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce1164d2ec454a7aa200c59e5b6a401a)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:29.109184 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98149f-bb73-4896-99d3-5611dcdc1c4a admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:29.113509 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f559982-d5a6-46b7-b57d-873238437394 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:29.118564 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23611f-fb4f-4b2a-ae08-dc95afd4f672 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:29.119303 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23611f-fb4f-4b2a-ae08-dc95afd4f672 service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:29.119679 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23611f-fb4f-4b2a-ae08-dc95afd4f672 service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:29.120025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23611f-fb4f-4b2a-ae08-dc95afd4f672 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:29.131540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23611f-fb4f-4b2a-ae08-dc95afd4f672 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:29.133052 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23611f-fb4f-4b2a-ae08-dc95afd4f672 service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:29.142504 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:06:29.155713 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1172/2331] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:06:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:06:29.167526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3d98149f-bb73-4896-99d3-5611dcdc1c4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce1164d2ec454a7aa200c59e5b6a401a'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:29.186194 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3d98149f-bb73-4896-99d3-5611dcdc1c4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce1164d2ec454a7aa200c59e5b6a401a'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:29.193856 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3d98149f-bb73-4896-99d3-5611dcdc1c4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce1164d2ec454a7aa200c59e5b6a401a'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:29.194675 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3d98149f-bb73-4896-99d3-5611dcdc1c4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce1164d2ec454a7aa200c59e5b6a401a'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:29.204735 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3d98149f-bb73-4896-99d3-5611dcdc1c4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce1164d2ec454a7aa200c59e5b6a401a'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:29.212150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1160/2332] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:06:29 2022] DELETE /identity/v3/users/ce1164d2ec454a7aa200c59e5b6a401a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:06:29.217095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac45c6-bdb1-47d9-a809-2e5591a41957 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:29.217385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac45c6-bdb1-47d9-a809-2e5591a41957 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:29.217662 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac45c6-bdb1-47d9-a809-2e5591a41957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:29.238830 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-0bac45c6-bdb1-47d9-a809-2e5591a41957 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:06:29.240320 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-0bac45c6-bdb1-47d9-a809-2e5591a41957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:29.311468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1173/2333] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:06:29.318825 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98149f-bb73-4896-99d3-5611dcdc1c4a admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:29.321646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-3d98149f-bb73-4896-99d3-5611dcdc1c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:29.421953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98149f-bb73-4896-99d3-5611dcdc1c4a admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:29.431615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b30a9e-b254-4cc1-be44-4969f12f9ebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:29.439263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b30a9e-b254-4cc1-be44-4969f12f9ebd service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:29.440568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b30a9e-b254-4cc1-be44-4969f12f9ebd service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:29.440861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b30a9e-b254-4cc1-be44-4969f12f9ebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:29.464708 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b30a9e-b254-4cc1-be44-4969f12f9ebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:29.468774 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b30a9e-b254-4cc1-be44-4969f12f9ebd service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:29.491599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1161/2334] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:06:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:06:29.959931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac45c6-bdb1-47d9-a809-2e5591a41957 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:29.961764 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-0bac45c6-bdb1-47d9-a809-2e5591a41957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:29.991981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac45c6-bdb1-47d9-a809-2e5591a41957 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:30.001937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377ad2a-e943-4528-a8e1-5f4bf9ab4350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:30.002669 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377ad2a-e943-4528-a8e1-5f4bf9ab4350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:30.002973 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377ad2a-e943-4528-a8e1-5f4bf9ab4350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:30.003241 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377ad2a-e943-4528-a8e1-5f4bf9ab4350 admin admin] PATH_INFO: `/v3/projects/51279e21b4cb438d9bc45168dfba1c84` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:30.004506 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377ad2a-e943-4528-a8e1-5f4bf9ab4350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51279e21b4cb438d9bc45168dfba1c84)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:30.006644 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377ad2a-e943-4528-a8e1-5f4bf9ab4350 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:30.016774 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:06:30.069555 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-9377ad2a-e943-4528-a8e1-5f4bf9ab4350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51279e21b4cb438d9bc45168dfba1c84', 'request_id': 'req-9377ad2a-e943-4528-a8e1-5f4bf9ab4350'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:30.079957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-9377ad2a-e943-4528-a8e1-5f4bf9ab4350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51279e21b4cb438d9bc45168dfba1c84', 'request_id': 'req-9377ad2a-e943-4528-a8e1-5f4bf9ab4350'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:30.092660 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-9377ad2a-e943-4528-a8e1-5f4bf9ab4350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51279e21b4cb438d9bc45168dfba1c84', 'request_id': 'req-9377ad2a-e943-4528-a8e1-5f4bf9ab4350'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:30.109794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-9377ad2a-e943-4528-a8e1-5f4bf9ab4350 admin admin] The token cache is being invalidate because project 51279e21b4cb438d9bc45168dfba1c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:06:30.110085 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-9377ad2a-e943-4528-a8e1-5f4bf9ab4350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:30.110797 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-9377ad2a-e943-4528-a8e1-5f4bf9ab4350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:30.112608 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1174/2335] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:06:29 2022] DELETE /identity/v3/projects/51279e21b4cb438d9bc45168dfba1c84 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:06:34.416155 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b30a9e-b254-4cc1-be44-4969f12f9ebd service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:34.418468 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-44b30a9e-b254-4cc1-be44-4969f12f9ebd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:34.507179 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b30a9e-b254-4cc1-be44-4969f12f9ebd service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:34.557898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:06:34.579819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f4107-8902-4400-9bd7-91ce79c06bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:34.580752 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f4107-8902-4400-9bd7-91ce79c06bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:34.581029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f4107-8902-4400-9bd7-91ce79c06bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:34.581299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f4107-8902-4400-9bd7-91ce79c06bb3 admin admin] PATH_INFO: `/v3/users/ce6499279f90452ba8be2af47772844d` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:34.582644 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f4107-8902-4400-9bd7-91ce79c06bb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce6499279f90452ba8be2af47772844d)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:34.584635 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f4107-8902-4400-9bd7-91ce79c06bb3 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:34.656901 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-6f1f4107-8902-4400-9bd7-91ce79c06bb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce6499279f90452ba8be2af47772844d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:34.678471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-6f1f4107-8902-4400-9bd7-91ce79c06bb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce6499279f90452ba8be2af47772844d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:34.687482 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-6f1f4107-8902-4400-9bd7-91ce79c06bb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce6499279f90452ba8be2af47772844d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:34.693573 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-6f1f4107-8902-4400-9bd7-91ce79c06bb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce6499279f90452ba8be2af47772844d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:34.712798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-6f1f4107-8902-4400-9bd7-91ce79c06bb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce6499279f90452ba8be2af47772844d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:34.720018 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1162/2336] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:06:34 2022] DELETE /identity/v3/users/ce6499279f90452ba8be2af47772844d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:06:34.725538 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61760913-9d27-46f4-9104-2f6c34bee17f None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:34.726060 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61760913-9d27-46f4-9104-2f6c34bee17f None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:34.726192 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61760913-9d27-46f4-9104-2f6c34bee17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:34.755561 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-61760913-9d27-46f4-9104-2f6c34bee17f None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:06:34.756862 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-61760913-9d27-46f4-9104-2f6c34bee17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:34.816844 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1175/2337] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:06:34.826558 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f4107-8902-4400-9bd7-91ce79c06bb3 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:34.828128 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-6f1f4107-8902-4400-9bd7-91ce79c06bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:34.933901 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f4107-8902-4400-9bd7-91ce79c06bb3 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:34.938448 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e1d15-eb47-4c18-aeb9-1a23f74513dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:34.939267 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e1d15-eb47-4c18-aeb9-1a23f74513dc service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:34.939604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e1d15-eb47-4c18-aeb9-1a23f74513dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:34.939878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e1d15-eb47-4c18-aeb9-1a23f74513dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:34.950447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e1d15-eb47-4c18-aeb9-1a23f74513dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:34.952023 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e1d15-eb47-4c18-aeb9-1a23f74513dc service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:34.963056 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1163/2338] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:06:35.252483 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61760913-9d27-46f4-9104-2f6c34bee17f None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:35.254370 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-61760913-9d27-46f4-9104-2f6c34bee17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:35.277978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61760913-9d27-46f4-9104-2f6c34bee17f None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:35.283087 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e87e0-41e0-4af5-acd1-d13e7fcb0f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:35.284056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e87e0-41e0-4af5-acd1-d13e7fcb0f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:35.284337 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e87e0-41e0-4af5-acd1-d13e7fcb0f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:35.284612 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e87e0-41e0-4af5-acd1-d13e7fcb0f8e admin admin] PATH_INFO: `/v3/projects/0ef2342960cc474686665aaac212e93a` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:35.285914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e87e0-41e0-4af5-acd1-d13e7fcb0f8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ef2342960cc474686665aaac212e93a)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:35.287838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e87e0-41e0-4af5-acd1-d13e7fcb0f8e admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:35.340212 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-058e87e0-41e0-4af5-acd1-d13e7fcb0f8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ef2342960cc474686665aaac212e93a', 'request_id': 'req-058e87e0-41e0-4af5-acd1-d13e7fcb0f8e'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:35.347594 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-058e87e0-41e0-4af5-acd1-d13e7fcb0f8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ef2342960cc474686665aaac212e93a', 'request_id': 'req-058e87e0-41e0-4af5-acd1-d13e7fcb0f8e'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:35.362126 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-058e87e0-41e0-4af5-acd1-d13e7fcb0f8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ef2342960cc474686665aaac212e93a', 'request_id': 'req-058e87e0-41e0-4af5-acd1-d13e7fcb0f8e'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:35.375810 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-058e87e0-41e0-4af5-acd1-d13e7fcb0f8e admin admin] The token cache is being invalidate because project 0ef2342960cc474686665aaac212e93a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:06:35.376101 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-058e87e0-41e0-4af5-acd1-d13e7fcb0f8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:35.376865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-058e87e0-41e0-4af5-acd1-d13e7fcb0f8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:06:35.378797 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1176/2339] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:06:35 2022] DELETE /identity/v3/projects/0ef2342960cc474686665aaac212e93a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:06:35.383733 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2b996-d01d-4c9b-82f3-1963c9d565e3 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:35.384039 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2b996-d01d-4c9b-82f3-1963c9d565e3 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:35.384330 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2b996-d01d-4c9b-82f3-1963c9d565e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:35.426647 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-15d2b996-d01d-4c9b-82f3-1963c9d565e3 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:06:35.427943 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-15d2b996-d01d-4c9b-82f3-1963c9d565e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:35.441856 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:06:35.505613 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1164/2340] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:06:35.515455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84f457-33fa-464e-8783-cdf74b3cb2be None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:35.515928 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84f457-33fa-464e-8783-cdf74b3cb2be None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:35.516250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84f457-33fa-464e-8783-cdf74b3cb2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:35.538517 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-4b84f457-33fa-464e-8783-cdf74b3cb2be None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:06:35.540406 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-4b84f457-33fa-464e-8783-cdf74b3cb2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:35.549268 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1177/2341] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:06:35.553702 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2b996-d01d-4c9b-82f3-1963c9d565e3 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:35.564375 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2b996-d01d-4c9b-82f3-1963c9d565e3 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:35.570250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111a04b-1e04-4563-8967-ba75f843d799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:35.570955 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111a04b-1e04-4563-8967-ba75f843d799 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:35.571255 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111a04b-1e04-4563-8967-ba75f843d799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:35.571556 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111a04b-1e04-4563-8967-ba75f843d799 admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:35.572428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111a04b-1e04-4563-8967-ba75f843d799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:06:35.572802 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111a04b-1e04-4563-8967-ba75f843d799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:35.574740 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111a04b-1e04-4563-8967-ba75f843d799 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:35.589847 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1165/2342] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:06:35.595097 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84f457-33fa-464e-8783-cdf74b3cb2be None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:35.606047 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84f457-33fa-464e-8783-cdf74b3cb2be None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:35.611636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50507fb2-fa02-4bd0-b55d-6c4c0440f908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:35.612319 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50507fb2-fa02-4bd0-b55d-6c4c0440f908 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:35.612596 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50507fb2-fa02-4bd0-b55d-6c4c0440f908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:35.612865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50507fb2-fa02-4bd0-b55d-6c4c0440f908 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:35.613558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50507fb2-fa02-4bd0-b55d-6c4c0440f908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:35.615539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50507fb2-fa02-4bd0-b55d-6c4c0440f908 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:35.619316 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:06:35.658220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1178/2343] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:06:35 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:06:35.661552 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111a04b-1e04-4563-8967-ba75f843d799 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:35.673136 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111a04b-1e04-4563-8967-ba75f843d799 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:35.752180 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d207f74-4bf0-4aff-b3a6-d2f149717c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:35.753113 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d207f74-4bf0-4aff-b3a6-d2f149717c5d admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:35.753588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d207f74-4bf0-4aff-b3a6-d2f149717c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:35.754050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d207f74-4bf0-4aff-b3a6-d2f149717c5d admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:35.754979 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d207f74-4bf0-4aff-b3a6-d2f149717c5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:35.757507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d207f74-4bf0-4aff-b3a6-d2f149717c5d admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:35.792149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1166/2344] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:06:35 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:06:35.793566 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50507fb2-fa02-4bd0-b55d-6c4c0440f908 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:35.809227 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50507fb2-fa02-4bd0-b55d-6c4c0440f908 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:35.814870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50132ea5-5ecd-41d2-975a-3eb0dc026687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:35.815607 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50132ea5-5ecd-41d2-975a-3eb0dc026687 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:35.815892 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50132ea5-5ecd-41d2-975a-3eb0dc026687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:35.816170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50132ea5-5ecd-41d2-975a-3eb0dc026687 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:35.817047 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50132ea5-5ecd-41d2-975a-3eb0dc026687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:35.818663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50132ea5-5ecd-41d2-975a-3eb0dc026687 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:35.829758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1179/2345] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:06:35.834186 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d207f74-4bf0-4aff-b3a6-d2f149717c5d admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:35.844586 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d207f74-4bf0-4aff-b3a6-d2f149717c5d admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:35.849641 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621b56e-8442-43a0-a1f8-ffec9b729662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:35.850440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621b56e-8442-43a0-a1f8-ffec9b729662 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:35.850796 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621b56e-8442-43a0-a1f8-ffec9b729662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:35.851143 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621b56e-8442-43a0-a1f8-ffec9b729662 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:35.852057 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621b56e-8442-43a0-a1f8-ffec9b729662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:35.853880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621b56e-8442-43a0-a1f8-ffec9b729662 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:35.869951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1167/2346] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:06:35.875033 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50132ea5-5ecd-41d2-975a-3eb0dc026687 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:35.887235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50132ea5-5ecd-41d2-975a-3eb0dc026687 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:35.892751 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc21c12-dd0f-4cf5-b99f-640428601504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:35.893669 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc21c12-dd0f-4cf5-b99f-640428601504 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:35.893951 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc21c12-dd0f-4cf5-b99f-640428601504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:35.894220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc21c12-dd0f-4cf5-b99f-640428601504 admin admin] PATH_INFO: `/v3/projects/976261d1e5b64a0489fe16e0a099e4fa/users/7f57f8e664e64f0a94d19d3dc9ecca3d/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:35.918220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc21c12-dd0f-4cf5-b99f-640428601504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=976261d1e5b64a0489fe16e0a099e4fa, user_id=7f57f8e664e64f0a94d19d3dc9ecca3d, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:35.921306 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc21c12-dd0f-4cf5-b99f-640428601504 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:35.943250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1180/2347] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:06:35 2022] PUT /identity/v3/projects/976261d1e5b64a0489fe16e0a099e4fa/users/7f57f8e664e64f0a94d19d3dc9ecca3d/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:06:35.948121 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d661b0-f064-410d-afbb-123d23ac176d None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:35.948918 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d661b0-f064-410d-afbb-123d23ac176d None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:35.949384 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d661b0-f064-410d-afbb-123d23ac176d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:35.973609 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-19d661b0-f064-410d-afbb-123d23ac176d None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:06:35.975176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-19d661b0-f064-410d-afbb-123d23ac176d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:36.069393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1168/2348] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:06:36.079300 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc21c12-dd0f-4cf5-b99f-640428601504 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:36.081064 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-abc21c12-dd0f-4cf5-b99f-640428601504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:36.145138 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc21c12-dd0f-4cf5-b99f-640428601504 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:36.148853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058de17-1381-4c72-82aa-812426ffcda4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:36.149509 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058de17-1381-4c72-82aa-812426ffcda4 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:36.149785 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058de17-1381-4c72-82aa-812426ffcda4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:36.150029 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058de17-1381-4c72-82aa-812426ffcda4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:36.159903 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058de17-1381-4c72-82aa-812426ffcda4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:36.161329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058de17-1381-4c72-82aa-812426ffcda4 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:36.171674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1181/2349] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:06:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:06:40.503541 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2e625-fec5-4656-983b-52b70db1461b None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:40.504059 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2e625-fec5-4656-983b-52b70db1461b None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:40.504233 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2e625-fec5-4656-983b-52b70db1461b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:40.535021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-e7c2e625-fec5-4656-983b-52b70db1461b None None] MFA Rules not processed for user `7f57f8e664e64f0a94d19d3dc9ecca3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:06:40.538740 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-e7c2e625-fec5-4656-983b-52b70db1461b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:40.549889 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:06:40.616618 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1169/2350] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:06:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:06:40.621590 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058de17-1381-4c72-82aa-812426ffcda4 service neutron] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:40.631546 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058de17-1381-4c72-82aa-812426ffcda4 service neutron] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:40.636248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692e8f0-f77d-4ab8-93cd-ea87d83f88d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:40.636909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692e8f0-f77d-4ab8-93cd-ea87d83f88d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:40.637191 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692e8f0-f77d-4ab8-93cd-ea87d83f88d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:40.637463 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692e8f0-f77d-4ab8-93cd-ea87d83f88d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:40.638264 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692e8f0-f77d-4ab8-93cd-ea87d83f88d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:40.640596 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692e8f0-f77d-4ab8-93cd-ea87d83f88d3 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:40.670279 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1182/2351] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:06:40 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:06:40.674358 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2e625-fec5-4656-983b-52b70db1461b None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:40.685507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2e625-fec5-4656-983b-52b70db1461b None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:40.782599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154b0a1-6d4a-45ac-b504-5c4ec5e6e183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:40.783350 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154b0a1-6d4a-45ac-b504-5c4ec5e6e183 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:40.783767 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154b0a1-6d4a-45ac-b504-5c4ec5e6e183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:40.784043 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154b0a1-6d4a-45ac-b504-5c4ec5e6e183 admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:40.784940 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154b0a1-6d4a-45ac-b504-5c4ec5e6e183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:40.787233 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154b0a1-6d4a-45ac-b504-5c4ec5e6e183 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:40.835841 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1170/2352] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:06:40 2022] POST /identity/v3/users => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:06:40.836794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692e8f0-f77d-4ab8-93cd-ea87d83f88d3 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:40.854128 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692e8f0-f77d-4ab8-93cd-ea87d83f88d3 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:40.864598 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35525878-9958-439c-852d-8c5410de10f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:40.865856 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35525878-9958-439c-852d-8c5410de10f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:40.866361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35525878-9958-439c-852d-8c5410de10f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:40.867384 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35525878-9958-439c-852d-8c5410de10f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:40.868497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35525878-9958-439c-852d-8c5410de10f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:40.871827 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35525878-9958-439c-852d-8c5410de10f6 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:40.890154 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1183/2353] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:06:40.891873 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154b0a1-6d4a-45ac-b504-5c4ec5e6e183 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:40.903047 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154b0a1-6d4a-45ac-b504-5c4ec5e6e183 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:40.911515 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db914144-65db-4c45-bed6-85c5d909c668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:40.911515 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db914144-65db-4c45-bed6-85c5d909c668 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:40.911515 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db914144-65db-4c45-bed6-85c5d909c668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:40.911515 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db914144-65db-4c45-bed6-85c5d909c668 admin admin] PATH_INFO: `/v3/projects/8a11a8506b8b4a29b45854753334a492/users/b97e148902094a6d9fc5453936553752/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:40.947913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db914144-65db-4c45-bed6-85c5d909c668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a11a8506b8b4a29b45854753334a492, user_id=b97e148902094a6d9fc5453936553752, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:40.951509 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db914144-65db-4c45-bed6-85c5d909c668 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:40.974808 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1171/2354] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:06:40 2022] PUT /identity/v3/projects/8a11a8506b8b4a29b45854753334a492/users/b97e148902094a6d9fc5453936553752/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:06:40.978729 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35525878-9958-439c-852d-8c5410de10f6 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:40.990889 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35525878-9958-439c-852d-8c5410de10f6 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:41.076282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf6b3e-9dcd-4f1d-88eb-767b4d1c4750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:41.077082 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf6b3e-9dcd-4f1d-88eb-767b4d1c4750 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:41.077364 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf6b3e-9dcd-4f1d-88eb-767b4d1c4750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:41.077692 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf6b3e-9dcd-4f1d-88eb-767b4d1c4750 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:41.078627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf6b3e-9dcd-4f1d-88eb-767b4d1c4750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:41.080379 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf6b3e-9dcd-4f1d-88eb-767b4d1c4750 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:41.091911 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1184/2355] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:06:41.096027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db914144-65db-4c45-bed6-85c5d909c668 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:41.113271 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db914144-65db-4c45-bed6-85c5d909c668 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:41.118275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2136ef-e10d-48e6-87d5-31782573bb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:41.119203 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2136ef-e10d-48e6-87d5-31782573bb20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:41.119524 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2136ef-e10d-48e6-87d5-31782573bb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:41.119803 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2136ef-e10d-48e6-87d5-31782573bb20 admin admin] PATH_INFO: `/v3/projects/8a11a8506b8b4a29b45854753334a492/users/b97e148902094a6d9fc5453936553752/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:41.121917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2136ef-e10d-48e6-87d5-31782573bb20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a11a8506b8b4a29b45854753334a492, user_id=b97e148902094a6d9fc5453936553752, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:41.124831 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2136ef-e10d-48e6-87d5-31782573bb20 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:41.136445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1172/2356] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:06:41 2022] PUT /identity/v3/projects/8a11a8506b8b4a29b45854753334a492/users/b97e148902094a6d9fc5453936553752/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:06:46.201635 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eac804-bdc0-42f2-b326-8de339622f34 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:46.202165 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eac804-bdc0-42f2-b326-8de339622f34 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:46.202165 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eac804-bdc0-42f2-b326-8de339622f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:46.255397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-43eac804-bdc0-42f2-b326-8de339622f34 None None] MFA Rules not processed for user `b97e148902094a6d9fc5453936553752`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:06:46.258133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-43eac804-bdc0-42f2-b326-8de339622f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:46.262506 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:06:46.347565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1185/2357] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:06:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:06:46.358846 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2136ef-e10d-48e6-87d5-31782573bb20 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:46.360693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-cc2136ef-e10d-48e6-87d5-31782573bb20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:46.430022 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2136ef-e10d-48e6-87d5-31782573bb20 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:46.434958 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7a63d-c495-461e-a373-5a10fa499c32 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46aba36939c549278bcdee7a04511e27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:46.435787 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7a63d-c495-461e-a373-5a10fa499c32 service glance] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:46.436163 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7a63d-c495-461e-a373-5a10fa499c32 service glance] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:46.436517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7a63d-c495-461e-a373-5a10fa499c32 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:46.475301 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:06:46.550225 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7a63d-c495-461e-a373-5a10fa499c32 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:46.551758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7a63d-c495-461e-a373-5a10fa499c32 service glance] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:46.563592 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1173/2358] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:06:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:06:46.744422 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c624c-0868-4c71-a47c-43c158f01e53 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:46.744748 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c624c-0868-4c71-a47c-43c158f01e53 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:46.745015 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c624c-0868-4c71-a47c-43c158f01e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:46.789039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-5b3c624c-0868-4c71-a47c-43c158f01e53 None None] MFA Rules not processed for user `0dbf596d8f964d4695944a23dd8e4cef`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:06:46.790307 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5b3c624c-0868-4c71-a47c-43c158f01e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:46.936051 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1186/2359] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 02:06:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:06:46.948243 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7a63d-c495-461e-a373-5a10fa499c32 service glance] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:46.949787 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-84e7a63d-c495-461e-a373-5a10fa499c32 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:47.037831 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7a63d-c495-461e-a373-5a10fa499c32 service glance] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:47.044072 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150f7dc-f7f2-4c80-99e0-2471d2c658c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae132c4d0b5461aa26ab929a017cb08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:47.045077 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150f7dc-f7f2-4c80-99e0-2471d2c658c3 service swift] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:47.045205 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150f7dc-f7f2-4c80-99e0-2471d2c658c3 service swift] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:47.045441 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150f7dc-f7f2-4c80-99e0-2471d2c658c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:47.056517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150f7dc-f7f2-4c80-99e0-2471d2c658c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:47.058505 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150f7dc-f7f2-4c80-99e0-2471d2c658c3 service swift] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:47.069253 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1174/2360] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 02:06:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 02:06:56.572605 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef4c8d-9af0-46f0-ac79-28975b6067c4 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:56.573173 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef4c8d-9af0-46f0-ac79-28975b6067c4 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:56.573173 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef4c8d-9af0-46f0-ac79-28975b6067c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:56.591904 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-07ef4c8d-9af0-46f0-ac79-28975b6067c4 None None] MFA Rules not processed for user `7f57f8e664e64f0a94d19d3dc9ecca3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:06:56.593175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-07ef4c8d-9af0-46f0-ac79-28975b6067c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:56.606876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1187/2361] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:06:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:06:57.064703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=50 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:06:58.649042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d92f50-ccb5-46c4-9164-49450da6782d None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:58.650259 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d92f50-ccb5-46c4-9164-49450da6782d None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:58.650543 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d92f50-ccb5-46c4-9164-49450da6782d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:58.671291 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-d0d92f50-ccb5-46c4-9164-49450da6782d None None] MFA Rules not processed for user `0dbf596d8f964d4695944a23dd8e4cef`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:06:58.673127 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-d0d92f50-ccb5-46c4-9164-49450da6782d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:06:58.689054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1175/2362] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 02:06:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:06:58.711764 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef4c8d-9af0-46f0-ac79-28975b6067c4 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:06:58.725170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef4c8d-9af0-46f0-ac79-28975b6067c4 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:06:58.732425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf155cc-e55b-49d6-8544-f90f20c505d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae132c4d0b5461aa26ab929a017cb08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:06:58.733271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf155cc-e55b-49d6-8544-f90f20c505d9 service swift] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:06:58.733666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf155cc-e55b-49d6-8544-f90f20c505d9 service swift] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:06:58.733993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf155cc-e55b-49d6-8544-f90f20c505d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:06:58.743273 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf155cc-e55b-49d6-8544-f90f20c505d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:06:58.744919 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf155cc-e55b-49d6-8544-f90f20c505d9 service swift] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:06:58.754963 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1188/2363] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 02:06:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 02:07:08.682840 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=6 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:07:08.751106 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=65 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:07:15.512396 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d92f50-ccb5-46c4-9164-49450da6782d None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:07:15.514169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-d0d92f50-ccb5-46c4-9164-49450da6782d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:07:15.621242 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d92f50-ccb5-46c4-9164-49450da6782d None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:07:15.629053 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e4c64-92ee-4f36-b30c-2f19e5fc9fd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9756f5b9de8a4f23b365a96d309d86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:07:15.629612 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e4c64-92ee-4f36-b30c-2f19e5fc9fd4 service placement] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:15.630069 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e4c64-92ee-4f36-b30c-2f19e5fc9fd4 service placement] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:15.630330 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e4c64-92ee-4f36-b30c-2f19e5fc9fd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:15.632502 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-f32e4c64-92ee-4f36-b30c-2f19e5fc9fd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:07:15.650132 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e4c64-92ee-4f36-b30c-2f19e5fc9fd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:07:15.651824 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e4c64-92ee-4f36-b30c-2f19e5fc9fd4 service placement] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:07:15.664439 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1176/2364] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:07:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:07:19.136096 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b03337-fe8f-4d24-a8bf-e5c3b4bd1677 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:19.136688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b03337-fe8f-4d24-a8bf-e5c3b4bd1677 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:19.136688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b03337-fe8f-4d24-a8bf-e5c3b4bd1677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:19.188686 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-62b03337-fe8f-4d24-a8bf-e5c3b4bd1677 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:07:19.190443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-62b03337-fe8f-4d24-a8bf-e5c3b4bd1677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:07:19.255207 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1189/2365] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jun 23 02:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:07:19.269907 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e4c64-92ee-4f36-b30c-2f19e5fc9fd4 service placement] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:07:19.271335 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-f32e4c64-92ee-4f36-b30c-2f19e5fc9fd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:07:19.376111 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e4c64-92ee-4f36-b30c-2f19e5fc9fd4 service placement] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:07:19.382951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57994950-abdf-4124-9976-b609b3646993 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:07:19.383664 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57994950-abdf-4124-9976-b609b3646993 service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:19.383951 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57994950-abdf-4124-9976-b609b3646993 service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:19.384246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57994950-abdf-4124-9976-b609b3646993 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:19.393595 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57994950-abdf-4124-9976-b609b3646993 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:07:19.395250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57994950-abdf-4124-9976-b609b3646993 service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:07:19.405007 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1177/2366] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:07:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:07:26.441520 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba32ce-fa8e-4c4a-86b1-4a7a4909806a None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:26.442013 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba32ce-fa8e-4c4a-86b1-4a7a4909806a None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:26.442123 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba32ce-fa8e-4c4a-86b1-4a7a4909806a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:26.492152 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-d9ba32ce-fa8e-4c4a-86b1-4a7a4909806a None None] MFA Rules not processed for user `0dbf596d8f964d4695944a23dd8e4cef`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:07:26.493420 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-d9ba32ce-fa8e-4c4a-86b1-4a7a4909806a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:07:26.511729 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1190/2367] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 02:07:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:07:26.527639 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57994950-abdf-4124-9976-b609b3646993 service nova] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:07:26.556342 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57994950-abdf-4124-9976-b609b3646993 service nova] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:07:26.564912 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac655c-8cdf-4357-8a7d-0d5259dca49c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae132c4d0b5461aa26ab929a017cb08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:07:26.565561 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac655c-8cdf-4357-8a7d-0d5259dca49c service swift] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:26.565851 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac655c-8cdf-4357-8a7d-0d5259dca49c service swift] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:26.566131 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac655c-8cdf-4357-8a7d-0d5259dca49c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:26.576022 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac655c-8cdf-4357-8a7d-0d5259dca49c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:07:26.577627 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac655c-8cdf-4357-8a7d-0d5259dca49c service swift] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:07:26.586115 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1178/2368] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 02:07:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 02:07:27.544740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806fd92-921e-4f21-afa9-e21346cdb976 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:27.545664 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806fd92-921e-4f21-afa9-e21346cdb976 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:27.546232 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806fd92-921e-4f21-afa9-e21346cdb976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:27.574339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-4806fd92-921e-4f21-afa9-e21346cdb976 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:07:27.575612 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-4806fd92-921e-4f21-afa9-e21346cdb976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:07:27.585003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1191/2369] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jun 23 02:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:07:27.602016 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac655c-8cdf-4357-8a7d-0d5259dca49c service swift] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:07:27.604159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-07ac655c-8cdf-4357-8a7d-0d5259dca49c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:07:27.628349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac655c-8cdf-4357-8a7d-0d5259dca49c service swift] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:07:27.638848 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd5519-66bf-4829-85e3-ca73da0a68da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:07:27.638848 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd5519-66bf-4829-85e3-ca73da0a68da service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:27.638848 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd5519-66bf-4829-85e3-ca73da0a68da service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:27.638848 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd5519-66bf-4829-85e3-ca73da0a68da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:27.646815 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd5519-66bf-4829-85e3-ca73da0a68da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:07:27.648717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd5519-66bf-4829-85e3-ca73da0a68da service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:07:27.654449 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:07:27.661041 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1179/2370] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:07:31.964234 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc65f6-c8d1-4e47-b541-26714c4bd61c None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:31.964882 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc65f6-c8d1-4e47-b541-26714c4bd61c None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:31.964882 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc65f6-c8d1-4e47-b541-26714c4bd61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:31.985756 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-b6dc65f6-c8d1-4e47-b541-26714c4bd61c None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:07:31.987180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-b6dc65f6-c8d1-4e47-b541-26714c4bd61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:07:31.996592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1192/2371] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jun 23 02:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:07:32.010082 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd5519-66bf-4829-85e3-ca73da0a68da service nova] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:07:32.022364 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd5519-66bf-4829-85e3-ca73da0a68da service nova] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:07:32.027998 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca972663-9a37-41ce-b71a-185ca2444552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:07:32.028900 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca972663-9a37-41ce-b71a-185ca2444552 service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:32.029378 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca972663-9a37-41ce-b71a-185ca2444552 service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:32.029820 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca972663-9a37-41ce-b71a-185ca2444552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:32.040383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca972663-9a37-41ce-b71a-185ca2444552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:07:32.042344 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca972663-9a37-41ce-b71a-185ca2444552 service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:07:32.052683 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1180/2372] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:07:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:07:35.010521 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc65f6-c8d1-4e47-b541-26714c4bd61c None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:07:35.088920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc65f6-c8d1-4e47-b541-26714c4bd61c None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:07:35.092866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f08610-dab7-4219-b9d1-da9cdd467915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:07:35.093534 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f08610-dab7-4219-b9d1-da9cdd467915 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:35.093792 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f08610-dab7-4219-b9d1-da9cdd467915 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:35.094075 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f08610-dab7-4219-b9d1-da9cdd467915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:35.103974 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f08610-dab7-4219-b9d1-da9cdd467915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:07:35.105432 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f08610-dab7-4219-b9d1-da9cdd467915 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:07:35.116101 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1193/2373] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:07:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:07:36.073238 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee79ba-73e3-438f-8f86-f7bb39ac75ca None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:36.074603 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee79ba-73e3-438f-8f86-f7bb39ac75ca None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:36.075072 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee79ba-73e3-438f-8f86-f7bb39ac75ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:36.097503 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-5bee79ba-73e3-438f-8f86-f7bb39ac75ca None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:07:36.099449 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-5bee79ba-73e3-438f-8f86-f7bb39ac75ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:07:36.109906 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1181/2374] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jun 23 02:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:07:36.133520 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f08610-dab7-4219-b9d1-da9cdd467915 service neutron] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:07:36.156890 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f08610-dab7-4219-b9d1-da9cdd467915 service neutron] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:07:36.164424 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab963e-7f2b-4588-9e00-0351df9198cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:07:36.166033 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab963e-7f2b-4588-9e00-0351df9198cf service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:36.166441 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab963e-7f2b-4588-9e00-0351df9198cf service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:36.166983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab963e-7f2b-4588-9e00-0351df9198cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:36.179372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab963e-7f2b-4588-9e00-0351df9198cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:07:36.181374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab963e-7f2b-4588-9e00-0351df9198cf service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:07:36.192869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1194/2375] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:07:40.321795 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7028f-f21e-43f2-b90f-6f9022a67ce4 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:40.322325 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7028f-f21e-43f2-b90f-6f9022a67ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:40.322424 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7028f-f21e-43f2-b90f-6f9022a67ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:40.342293 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-06e7028f-f21e-43f2-b90f-6f9022a67ce4 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:07:40.343773 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-06e7028f-f21e-43f2-b90f-6f9022a67ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:07:40.352901 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1182/2376] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jun 23 02:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:07:40.367722 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab963e-7f2b-4588-9e00-0351df9198cf service nova] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:07:40.379240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab963e-7f2b-4588-9e00-0351df9198cf service nova] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:07:40.385943 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1b405-fa2e-45ad-9151-b25966efa5b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:07:40.386665 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1b405-fa2e-45ad-9151-b25966efa5b4 service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:40.387003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1b405-fa2e-45ad-9151-b25966efa5b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:40.387334 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1b405-fa2e-45ad-9151-b25966efa5b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:40.396618 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1b405-fa2e-45ad-9151-b25966efa5b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:07:40.398296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1b405-fa2e-45ad-9151-b25966efa5b4 service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:07:40.408555 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1195/2377] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:07:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:07:42.855248 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e198b-27b1-43fd-8e33-909a329bc955 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:42.855818 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e198b-27b1-43fd-8e33-909a329bc955 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:42.855917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e198b-27b1-43fd-8e33-909a329bc955 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:42.857278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1183/2378] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 23 02:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 02:07:42.863224 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7827e0-0f7b-4678-8b42-285593f1dfb4 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:42.863776 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7827e0-0f7b-4678-8b42-285593f1dfb4 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:42.863873 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7827e0-0f7b-4678-8b42-285593f1dfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:42.897486 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:07:42.906916 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-eb7827e0-0f7b-4678-8b42-285593f1dfb4 None None] MFA Rules not processed for user `9d3b5180fb7144c394c39d4db28713b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:07:42.908185 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-eb7827e0-0f7b-4678-8b42-285593f1dfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:07:42.917906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1196/2379] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 23 02:07:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:07:42.932411 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e198b-27b1-43fd-8e33-909a329bc955 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:07:42.934100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-6e8e198b-27b1-43fd-8e33-909a329bc955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:07:42.971814 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e198b-27b1-43fd-8e33-909a329bc955 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:07:42.975670 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88feb1dc-3b64-458c-96c3-63ca25680281 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46aba36939c549278bcdee7a04511e27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:07:42.976495 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88feb1dc-3b64-458c-96c3-63ca25680281 service glance] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:42.976883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88feb1dc-3b64-458c-96c3-63ca25680281 service glance] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:42.977340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88feb1dc-3b64-458c-96c3-63ca25680281 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:42.988082 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88feb1dc-3b64-458c-96c3-63ca25680281 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:07:42.993251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88feb1dc-3b64-458c-96c3-63ca25680281 service glance] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:07:43.000645 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1184/2380] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:07:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:07:43.076074 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9a8a6-8375-4118-aef1-9a2ef0720575 None None] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:43.076364 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9a8a6-8375-4118-aef1-9a2ef0720575 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:43.076954 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9a8a6-8375-4118-aef1-9a2ef0720575 None None] PATH_INFO: `/` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:43.078470 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1197/2381] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 23 02:07:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 02:07:43.083800 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a36d8-b4e3-439d-b010-166ad05260de None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:43.084167 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a36d8-b4e3-439d-b010-166ad05260de None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:43.084536 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a36d8-b4e3-439d-b010-166ad05260de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:43.104332 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-c18a36d8-b4e3-439d-b010-166ad05260de None None] MFA Rules not processed for user `8cda12550db1442ab04f30b9875fdbea`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:07:43.105734 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-c18a36d8-b4e3-439d-b010-166ad05260de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:07:43.112657 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1185/2382] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 23 02:07:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:07:43.124893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9a8a6-8375-4118-aef1-9a2ef0720575 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:07:43.126699 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-46b9a8a6-8375-4118-aef1-9a2ef0720575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:07:43.140791 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9a8a6-8375-4118-aef1-9a2ef0720575 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:07:43.144724 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5341b-c475-4f65-b2a4-aa165d60be46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:07:43.145414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5341b-c475-4f65-b2a4-aa165d60be46 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:43.145690 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5341b-c475-4f65-b2a4-aa165d60be46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:43.145944 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5341b-c475-4f65-b2a4-aa165d60be46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:43.154298 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5341b-c475-4f65-b2a4-aa165d60be46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:07:43.156185 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5341b-c475-4f65-b2a4-aa165d60be46 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:07:43.165382 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1198/2383] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:07:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:07:43.251575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b7fbe-8537-4b90-8795-829c1172f865 None None] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:43.251836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b7fbe-8537-4b90-8795-829c1172f865 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:43.252151 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b7fbe-8537-4b90-8795-829c1172f865 None None] PATH_INFO: `/` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:43.253594 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1186/2384] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 23 02:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 02:07:43.260168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d8d15-b721-4ebb-b2a4-360bb5c26fbb None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:43.260453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d8d15-b721-4ebb-b2a4-360bb5c26fbb None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:43.260723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d8d15-b721-4ebb-b2a4-360bb5c26fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:43.282187 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-687d8d15-b721-4ebb-b2a4-360bb5c26fbb None None] MFA Rules not processed for user `9d3b5180fb7144c394c39d4db28713b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:07:43.283363 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-687d8d15-b721-4ebb-b2a4-360bb5c26fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:07:43.293447 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1199/2385] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 23 02:07:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:07:43.305150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b7fbe-8537-4b90-8795-829c1172f865 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:07:43.317775 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b7fbe-8537-4b90-8795-829c1172f865 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:07:43.322051 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c09e4a-4a40-48d9-94a7-8f73125f92d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:07:43.322829 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c09e4a-4a40-48d9-94a7-8f73125f92d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:43.323118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c09e4a-4a40-48d9-94a7-8f73125f92d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:43.323704 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c09e4a-4a40-48d9-94a7-8f73125f92d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:43.336310 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c09e4a-4a40-48d9-94a7-8f73125f92d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:07:43.337823 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c09e4a-4a40-48d9-94a7-8f73125f92d3 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:07:43.351909 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1187/2386] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:07:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:07:45.544746 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4064b9-4ffc-4a66-9632-ff557fb6bc3d None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:45.545244 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4064b9-4ffc-4a66-9632-ff557fb6bc3d None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:45.545363 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4064b9-4ffc-4a66-9632-ff557fb6bc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:45.564195 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-fa4064b9-4ffc-4a66-9632-ff557fb6bc3d None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:07:45.565403 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-fa4064b9-4ffc-4a66-9632-ff557fb6bc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:07:45.574583 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1200/2387] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jun 23 02:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:07:45.589759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c09e4a-4a40-48d9-94a7-8f73125f92d3 service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:07:45.601548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c09e4a-4a40-48d9-94a7-8f73125f92d3 service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:07:45.608463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4287a3-935e-40b6-8512-e6ce19dd47be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:07:45.609239 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4287a3-935e-40b6-8512-e6ce19dd47be service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:45.609550 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4287a3-935e-40b6-8512-e6ce19dd47be service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:45.609807 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4287a3-935e-40b6-8512-e6ce19dd47be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:45.618526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4287a3-935e-40b6-8512-e6ce19dd47be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:07:45.620184 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4287a3-935e-40b6-8512-e6ce19dd47be service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:07:45.629775 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1188/2388] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:07:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:07:45.668960 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675abc2b-ad30-4d09-a984-c1d60683daf4 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:45.669241 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675abc2b-ad30-4d09-a984-c1d60683daf4 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:45.669516 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675abc2b-ad30-4d09-a984-c1d60683daf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:45.690237 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-675abc2b-ad30-4d09-a984-c1d60683daf4 None None] MFA Rules not processed for user `0dbf596d8f964d4695944a23dd8e4cef`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:07:45.691479 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-675abc2b-ad30-4d09-a984-c1d60683daf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:07:45.700053 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1201/2389] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 02:07:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:07:45.712712 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4287a3-935e-40b6-8512-e6ce19dd47be service nova] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:07:45.725012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4287a3-935e-40b6-8512-e6ce19dd47be service nova] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:07:45.730703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5cbea-4738-4298-8978-4cf451ffd921 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae132c4d0b5461aa26ab929a017cb08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:07:45.731525 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5cbea-4738-4298-8978-4cf451ffd921 service swift] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:07:45.731889 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5cbea-4738-4298-8978-4cf451ffd921 service swift] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:07:45.732244 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5cbea-4738-4298-8978-4cf451ffd921 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:07:45.744897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5cbea-4738-4298-8978-4cf451ffd921 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:07:45.746501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5cbea-4738-4298-8978-4cf451ffd921 service swift] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:07:45.754926 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1189/2390] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 02:07:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 02:07:55.684914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=17 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:07:55.751602 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=48 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:08:14.366893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488dce5-557c-4c29-8073-01637da4a12a None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:08:14.367519 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488dce5-557c-4c29-8073-01637da4a12a None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:08:14.367519 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488dce5-557c-4c29-8073-01637da4a12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:08:14.392952 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-4488dce5-557c-4c29-8073-01637da4a12a None None] MFA Rules not processed for user `0dbf596d8f964d4695944a23dd8e4cef`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:08:14.394090 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-4488dce5-557c-4c29-8073-01637da4a12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:08:14.402187 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1202/2391] 10.222.0.13 () {58 vars in 967 bytes} [Thu Jun 23 02:08:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:08:14.432554 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5cbea-4738-4298-8978-4cf451ffd921 service swift] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:08:14.444306 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5cbea-4738-4298-8978-4cf451ffd921 service swift] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:08:14.449552 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7f805-e68f-4916-8fc4-93b9e98700f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae132c4d0b5461aa26ab929a017cb08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:08:14.450213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7f805-e68f-4916-8fc4-93b9e98700f6 service swift] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:08:14.450493 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7f805-e68f-4916-8fc4-93b9e98700f6 service swift] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:08:14.450769 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7f805-e68f-4916-8fc4-93b9e98700f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:08:14.460052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7f805-e68f-4916-8fc4-93b9e98700f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:08:14.461661 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7f805-e68f-4916-8fc4-93b9e98700f6 service swift] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:08:14.487434 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1190/2392] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 02:08:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 02:08:19.539103 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607e5fa-1e1d-470a-81c0-3147bccda9ab None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:08:19.539810 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607e5fa-1e1d-470a-81c0-3147bccda9ab None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:08:19.539810 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607e5fa-1e1d-470a-81c0-3147bccda9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:08:19.559786 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-e607e5fa-1e1d-470a-81c0-3147bccda9ab None None] MFA Rules not processed for user `959a94ebbca34821ae2a07e1d98084ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:08:19.561051 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-e607e5fa-1e1d-470a-81c0-3147bccda9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:08:19.633628 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1203/2393] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:08:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:08:24.471370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=6 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:08:29.626465 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=28 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:08:36.073935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d51976-a352-4c07-9186-4dbf0e644c17 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:08:36.074513 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d51976-a352-4c07-9186-4dbf0e644c17 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:08:36.074513 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d51976-a352-4c07-9186-4dbf0e644c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:08:36.093427 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-d7d51976-a352-4c07-9186-4dbf0e644c17 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:08:36.094694 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-d7d51976-a352-4c07-9186-4dbf0e644c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:08:36.104420 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1191/2394] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jun 23 02:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:08:36.129872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607e5fa-1e1d-470a-81c0-3147bccda9ab None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:08:36.143091 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607e5fa-1e1d-470a-81c0-3147bccda9ab None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:08:36.149304 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1296e-bfbd-4955-b2c5-7e1e0e3ccf25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:08:36.149950 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1296e-bfbd-4955-b2c5-7e1e0e3ccf25 service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:08:36.150231 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1296e-bfbd-4955-b2c5-7e1e0e3ccf25 service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:08:36.150508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1296e-bfbd-4955-b2c5-7e1e0e3ccf25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:08:36.159573 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1296e-bfbd-4955-b2c5-7e1e0e3ccf25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:08:36.161169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1296e-bfbd-4955-b2c5-7e1e0e3ccf25 service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:08:36.172084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1204/2395] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:08:40.424637 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c34733-414b-48cd-b458-f2775089825b None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:08:40.425202 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c34733-414b-48cd-b458-f2775089825b None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:08:40.425202 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c34733-414b-48cd-b458-f2775089825b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:08:40.446739 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-c5c34733-414b-48cd-b458-f2775089825b None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:08:40.448013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-c5c34733-414b-48cd-b458-f2775089825b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:08:40.458700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1192/2396] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jun 23 02:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:08:40.479895 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1296e-bfbd-4955-b2c5-7e1e0e3ccf25 service nova] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:08:40.499923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1296e-bfbd-4955-b2c5-7e1e0e3ccf25 service nova] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:08:40.508463 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427ca8a-c0c4-4032-a2c6-4ae3dc243b6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:08:40.509110 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427ca8a-c0c4-4032-a2c6-4ae3dc243b6e service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:08:40.509385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427ca8a-c0c4-4032-a2c6-4ae3dc243b6e service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:08:40.509675 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427ca8a-c0c4-4032-a2c6-4ae3dc243b6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:08:40.519252 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427ca8a-c0c4-4032-a2c6-4ae3dc243b6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:08:40.520913 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427ca8a-c0c4-4032-a2c6-4ae3dc243b6e service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:08:40.530941 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1205/2397] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:08:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:08:44.551326 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca139666-ff2a-4efb-b35f-560a6d7c6f36 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:08:44.551881 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca139666-ff2a-4efb-b35f-560a6d7c6f36 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:08:44.551982 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca139666-ff2a-4efb-b35f-560a6d7c6f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:08:44.575982 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-ca139666-ff2a-4efb-b35f-560a6d7c6f36 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:08:44.577222 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-ca139666-ff2a-4efb-b35f-560a6d7c6f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:08:44.586241 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1193/2398] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jun 23 02:08:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:08:44.601496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427ca8a-c0c4-4032-a2c6-4ae3dc243b6e service nova] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:08:44.613811 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427ca8a-c0c4-4032-a2c6-4ae3dc243b6e service nova] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:08:44.619845 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8eeeec-33ec-4f2d-82a7-9822b43e56ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:08:44.620507 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eeeec-33ec-4f2d-82a7-9822b43e56ef service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:08:44.620790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eeeec-33ec-4f2d-82a7-9822b43e56ef service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:08:44.621063 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eeeec-33ec-4f2d-82a7-9822b43e56ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:08:44.629754 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8eeeec-33ec-4f2d-82a7-9822b43e56ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:08:44.631399 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8eeeec-33ec-4f2d-82a7-9822b43e56ef service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:08:44.641034 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1206/2399] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:08:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:08:48.784253 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa53662-f433-423e-a471-8725c90419c1 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:08:48.784949 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa53662-f433-423e-a471-8725c90419c1 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:08:48.784949 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa53662-f433-423e-a471-8725c90419c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:08:48.806191 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-8fa53662-f433-423e-a471-8725c90419c1 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:08:48.809053 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-8fa53662-f433-423e-a471-8725c90419c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:08:48.825026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1194/2400] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jun 23 02:08:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:08:48.845508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8eeeec-33ec-4f2d-82a7-9822b43e56ef service nova] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:08:48.861348 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8eeeec-33ec-4f2d-82a7-9822b43e56ef service nova] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:08:48.868652 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d857d-1005-4257-b85c-1ab16f2db497 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:08:48.869344 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d857d-1005-4257-b85c-1ab16f2db497 service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:08:48.869622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d857d-1005-4257-b85c-1ab16f2db497 service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:08:48.869893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d857d-1005-4257-b85c-1ab16f2db497 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:08:48.882901 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d857d-1005-4257-b85c-1ab16f2db497 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:08:48.885519 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d857d-1005-4257-b85c-1ab16f2db497 service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:08:48.897191 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1207/2401] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:08:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:08:54.040352 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603f248-06f7-4f6c-9f28-137c2503904b None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:08:54.040950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603f248-06f7-4f6c-9f28-137c2503904b None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:08:54.040950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603f248-06f7-4f6c-9f28-137c2503904b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:08:54.061606 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-9603f248-06f7-4f6c-9f28-137c2503904b None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:08:54.062969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-9603f248-06f7-4f6c-9f28-137c2503904b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:08:54.072220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1195/2402] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Jun 23 02:08:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:08:54.089384 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d857d-1005-4257-b85c-1ab16f2db497 service nova] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:08:54.101435 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d857d-1005-4257-b85c-1ab16f2db497 service nova] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:08:54.107724 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c4b54-c871-4234-b8c6-184a5aa7b977 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:08:54.108422 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c4b54-c871-4234-b8c6-184a5aa7b977 service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:08:54.108705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c4b54-c871-4234-b8c6-184a5aa7b977 service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:08:54.108978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c4b54-c871-4234-b8c6-184a5aa7b977 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:08:54.118206 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c4b54-c871-4234-b8c6-184a5aa7b977 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:08:54.119853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c4b54-c871-4234-b8c6-184a5aa7b977 service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:08:54.130543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1208/2403] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:08:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:08:57.812346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb26f42-d328-4df2-9da6-5c5f04aa7f91 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:08:57.812891 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb26f42-d328-4df2-9da6-5c5f04aa7f91 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:08:57.812891 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb26f42-d328-4df2-9da6-5c5f04aa7f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:08:57.833176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-0cb26f42-d328-4df2-9da6-5c5f04aa7f91 None None] MFA Rules not processed for user `0c3ad28388a84ebd9d386fa466c65ba9`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:08:57.834381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-0cb26f42-d328-4df2-9da6-5c5f04aa7f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:08:57.910154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1196/2404] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:08:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:09:04.125561 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=30 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:09:05.457547 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c4b54-c871-4234-b8c6-184a5aa7b977 service nova] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:09:05.467926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c4b54-c871-4234-b8c6-184a5aa7b977 service nova] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:09:05.472379 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c8aff-d829-47d4-822d-708bfa2b135a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:09:05.473032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c8aff-d829-47d4-822d-708bfa2b135a service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:09:05.473293 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c8aff-d829-47d4-822d-708bfa2b135a service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:09:05.473588 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c8aff-d829-47d4-822d-708bfa2b135a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:09:05.475714 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-c63c8aff-d829-47d4-822d-708bfa2b135a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:09:05.489959 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c8aff-d829-47d4-822d-708bfa2b135a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:09:05.491403 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c8aff-d829-47d4-822d-708bfa2b135a service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:09:05.502823 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1209/2405] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:09:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:09:06.492167 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb26f42-d328-4df2-9da6-5c5f04aa7f91 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:09:06.497559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=41 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:09:06.504207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb26f42-d328-4df2-9da6-5c5f04aa7f91 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:09:06.508175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e36af-2b0a-4610-8a7e-fb45089f0253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:09:06.508837 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e36af-2b0a-4610-8a7e-fb45089f0253 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:09:06.509312 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e36af-2b0a-4610-8a7e-fb45089f0253 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:09:06.509590 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e36af-2b0a-4610-8a7e-fb45089f0253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:09:06.511999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-ef9e36af-2b0a-4610-8a7e-fb45089f0253 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:09:06.527244 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e36af-2b0a-4610-8a7e-fb45089f0253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:09:06.528757 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e36af-2b0a-4610-8a7e-fb45089f0253 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:09:06.544685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1197/2406] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:09:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:09:15.497959 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=6 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:09:16.535927 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=5 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:09:25.990472 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c8aff-d829-47d4-822d-708bfa2b135a service neutron] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:09:26.002272 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c8aff-d829-47d4-822d-708bfa2b135a service neutron] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:09:26.009306 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb76b4c-19e9-4edd-9762-931910a9bab5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:09:26.009953 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb76b4c-19e9-4edd-9762-931910a9bab5 service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:09:26.010230 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb76b4c-19e9-4edd-9762-931910a9bab5 service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:09:26.010498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb76b4c-19e9-4edd-9762-931910a9bab5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:09:26.012475 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-3cb76b4c-19e9-4edd-9762-931910a9bab5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:09:26.081336 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb76b4c-19e9-4edd-9762-931910a9bab5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:09:26.082952 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb76b4c-19e9-4edd-9762-931910a9bab5 service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:09:26.096688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1210/2407] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:09:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:09:26.778381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e36af-2b0a-4610-8a7e-fb45089f0253 service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:09:26.790373 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e36af-2b0a-4610-8a7e-fb45089f0253 service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:09:26.796464 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcc594-1756-49f6-ad5e-621936cc407e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9756f5b9de8a4f23b365a96d309d86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:09:26.797164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcc594-1756-49f6-ad5e-621936cc407e service placement] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:09:26.797437 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcc594-1756-49f6-ad5e-621936cc407e service placement] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:09:26.797733 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcc594-1756-49f6-ad5e-621936cc407e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:09:26.800146 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a6fcc594-1756-49f6-ad5e-621936cc407e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:09:26.812399 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcc594-1756-49f6-ad5e-621936cc407e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:09:26.814045 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcc594-1756-49f6-ad5e-621936cc407e service placement] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:09:26.825387 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1198/2408] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:09:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:09:26.841659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb76b4c-19e9-4edd-9762-931910a9bab5 service nova] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:09:26.842937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-3cb76b4c-19e9-4edd-9762-931910a9bab5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:09:26.858040 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb76b4c-19e9-4edd-9762-931910a9bab5 service nova] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:09:26.863823 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67269379-5e2a-4e63-a7c1-f60c31d244ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:09:26.865093 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67269379-5e2a-4e63-a7c1-f60c31d244ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:09:26.865612 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67269379-5e2a-4e63-a7c1-f60c31d244ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:09:26.866132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67269379-5e2a-4e63-a7c1-f60c31d244ba admin admin] PATH_INFO: `/v3/users/959a94ebbca34821ae2a07e1d98084ce` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:09:26.867402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67269379-5e2a-4e63-a7c1-f60c31d244ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=959a94ebbca34821ae2a07e1d98084ce)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:09:26.869982 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67269379-5e2a-4e63-a7c1-f60c31d244ba admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:09:26.923931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-67269379-5e2a-4e63-a7c1-f60c31d244ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '959a94ebbca34821ae2a07e1d98084ce'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:09:26.935799 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-67269379-5e2a-4e63-a7c1-f60c31d244ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '959a94ebbca34821ae2a07e1d98084ce'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:09:26.936960 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-67269379-5e2a-4e63-a7c1-f60c31d244ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '959a94ebbca34821ae2a07e1d98084ce'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:09:26.937987 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-67269379-5e2a-4e63-a7c1-f60c31d244ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '959a94ebbca34821ae2a07e1d98084ce'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:09:26.951095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-67269379-5e2a-4e63-a7c1-f60c31d244ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '959a94ebbca34821ae2a07e1d98084ce'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:09:26.966294 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1211/2409] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:09:26 2022] DELETE /identity/v3/users/959a94ebbca34821ae2a07e1d98084ce => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:09:27.144894 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcc594-1756-49f6-ad5e-621936cc407e service placement] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:09:27.157185 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcc594-1756-49f6-ad5e-621936cc407e service placement] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:09:27.216456 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1aa61-a9de-4685-9fa1-f4c7256040c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:09:27.217329 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1aa61-a9de-4685-9fa1-f4c7256040c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:09:27.217611 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1aa61-a9de-4685-9fa1-f4c7256040c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:09:27.217887 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1aa61-a9de-4685-9fa1-f4c7256040c5 admin admin] PATH_INFO: `/v3/projects/91d6f3c1b4fa41a2992f5f800760c8f8` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:09:27.219141 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1aa61-a9de-4685-9fa1-f4c7256040c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91d6f3c1b4fa41a2992f5f800760c8f8)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:09:27.221175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1aa61-a9de-4685-9fa1-f4c7256040c5 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:09:27.268506 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-b3e1aa61-a9de-4685-9fa1-f4c7256040c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91d6f3c1b4fa41a2992f5f800760c8f8', 'request_id': 'req-b3e1aa61-a9de-4685-9fa1-f4c7256040c5'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:09:27.276167 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-b3e1aa61-a9de-4685-9fa1-f4c7256040c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91d6f3c1b4fa41a2992f5f800760c8f8', 'request_id': 'req-b3e1aa61-a9de-4685-9fa1-f4c7256040c5'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:09:27.281508 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-b3e1aa61-a9de-4685-9fa1-f4c7256040c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91d6f3c1b4fa41a2992f5f800760c8f8', 'request_id': 'req-b3e1aa61-a9de-4685-9fa1-f4c7256040c5'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:09:27.292279 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-b3e1aa61-a9de-4685-9fa1-f4c7256040c5 admin admin] The token cache is being invalidate because project 91d6f3c1b4fa41a2992f5f800760c8f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:09:27.292570 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-b3e1aa61-a9de-4685-9fa1-f4c7256040c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:09:27.293190 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-b3e1aa61-a9de-4685-9fa1-f4c7256040c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:09:27.294971 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1199/2410] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:09:27 2022] DELETE /identity/v3/projects/91d6f3c1b4fa41a2992f5f800760c8f8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:09:31.913720 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe69d8-e957-4a47-a366-deb542366b05 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:09:31.914301 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe69d8-e957-4a47-a366-deb542366b05 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:09:31.914301 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe69d8-e957-4a47-a366-deb542366b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:09:31.933128 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-edbe69d8-e957-4a47-a366-deb542366b05 None None] MFA Rules not processed for user `ee036a5188e8459989184fa216cc79e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:09:31.934437 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-edbe69d8-e957-4a47-a366-deb542366b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:09:32.000099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1212/2411] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:09:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:09:32.343089 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1aa61-a9de-4685-9fa1-f4c7256040c5 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:09:32.344752 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-b3e1aa61-a9de-4685-9fa1-f4c7256040c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:09:32.411765 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1aa61-a9de-4685-9fa1-f4c7256040c5 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:09:32.415792 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cac4f2-cff2-46c3-9b5f-0387136c5d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:09:32.416458 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cac4f2-cff2-46c3-9b5f-0387136c5d6f service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:09:32.416749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cac4f2-cff2-46c3-9b5f-0387136c5d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:09:32.417021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cac4f2-cff2-46c3-9b5f-0387136c5d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:09:32.419075 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-27cac4f2-cff2-46c3-9b5f-0387136c5d6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:09:32.429592 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cac4f2-cff2-46c3-9b5f-0387136c5d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:09:32.431025 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cac4f2-cff2-46c3-9b5f-0387136c5d6f service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:09:32.439211 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1200/2412] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:09:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:09:32.766174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe69d8-e957-4a47-a366-deb542366b05 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:09:32.767676 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-edbe69d8-e957-4a47-a366-deb542366b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:09:32.788482 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:09:32.845296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe69d8-e957-4a47-a366-deb542366b05 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:09:32.850574 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388c594-8b54-4dd7-9b76-118417078840 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9756f5b9de8a4f23b365a96d309d86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:09:32.851236 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388c594-8b54-4dd7-9b76-118417078840 service placement] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:09:32.851549 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388c594-8b54-4dd7-9b76-118417078840 service placement] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:09:32.851824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388c594-8b54-4dd7-9b76-118417078840 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:09:32.853738 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-7388c594-8b54-4dd7-9b76-118417078840 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:09:32.867061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388c594-8b54-4dd7-9b76-118417078840 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:09:32.868757 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388c594-8b54-4dd7-9b76-118417078840 service placement] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:09:32.879877 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1213/2413] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:09:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:09:34.779521 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cac4f2-cff2-46c3-9b5f-0387136c5d6f service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:09:34.789557 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cac4f2-cff2-46c3-9b5f-0387136c5d6f service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:09:34.793388 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38276e66-5637-45f8-b0c7-c2609163ddb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:09:34.794059 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38276e66-5637-45f8-b0c7-c2609163ddb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:09:34.794343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38276e66-5637-45f8-b0c7-c2609163ddb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:09:34.794622 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38276e66-5637-45f8-b0c7-c2609163ddb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:09:34.796857 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-38276e66-5637-45f8-b0c7-c2609163ddb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:09:34.807724 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38276e66-5637-45f8-b0c7-c2609163ddb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:09:34.809167 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38276e66-5637-45f8-b0c7-c2609163ddb6 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:09:34.818351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1201/2414] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:09:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:09:42.875145 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=25 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:09:44.814116 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:09:47.108683 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388c594-8b54-4dd7-9b76-118417078840 service placement] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:09:47.110222 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-7388c594-8b54-4dd7-9b76-118417078840 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:09:47.189619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388c594-8b54-4dd7-9b76-118417078840 service placement] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:09:47.195997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a91915-08e9-43da-87c9-c0fa27f58f39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:09:47.196665 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a91915-08e9-43da-87c9-c0fa27f58f39 service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:09:47.196946 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a91915-08e9-43da-87c9-c0fa27f58f39 service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:09:47.197220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a91915-08e9-43da-87c9-c0fa27f58f39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:09:47.199102 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-62a91915-08e9-43da-87c9-c0fa27f58f39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:09:47.212282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a91915-08e9-43da-87c9-c0fa27f58f39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:09:47.214008 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a91915-08e9-43da-87c9-c0fa27f58f39 service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:09:47.225041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1214/2415] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:09:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:09:57.220976 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=34 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:10:13.440350 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38276e66-5637-45f8-b0c7-c2609163ddb6 service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:13.442089 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-38276e66-5637-45f8-b0c7-c2609163ddb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:13.531987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38276e66-5637-45f8-b0c7-c2609163ddb6 service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:13.536389 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bd71e-5d2b-4e77-9bb6-f1565fe4aacf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:13.537047 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bd71e-5d2b-4e77-9bb6-f1565fe4aacf service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:13.537328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bd71e-5d2b-4e77-9bb6-f1565fe4aacf service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:13.537601 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bd71e-5d2b-4e77-9bb6-f1565fe4aacf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:13.539628 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-fc2bd71e-5d2b-4e77-9bb6-f1565fe4aacf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:13.603893 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2bd71e-5d2b-4e77-9bb6-f1565fe4aacf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:13.605338 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2bd71e-5d2b-4e77-9bb6-f1565fe4aacf service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:13.614864 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1202/2416] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:10:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:10:15.082841 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a91915-08e9-43da-87c9-c0fa27f58f39 service nova] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:15.093078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a91915-08e9-43da-87c9-c0fa27f58f39 service nova] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:15.097132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1bccb-0f75-4793-8abd-6616170902f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:15.097782 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1bccb-0f75-4793-8abd-6616170902f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:15.098094 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1bccb-0f75-4793-8abd-6616170902f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:15.098370 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1bccb-0f75-4793-8abd-6616170902f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:15.100159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-97e1bccb-0f75-4793-8abd-6616170902f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:15.172479 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1bccb-0f75-4793-8abd-6616170902f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:15.174308 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1bccb-0f75-4793-8abd-6616170902f0 service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:15.186040 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1215/2417] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:10:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:10:16.081134 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bd71e-5d2b-4e77-9bb6-f1565fe4aacf service cinder] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:16.082685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-fc2bd71e-5d2b-4e77-9bb6-f1565fe4aacf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:16.099954 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bd71e-5d2b-4e77-9bb6-f1565fe4aacf service cinder] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:16.107174 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a17bba-c68a-4372-8331-15d0b4a18257 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:16.108332 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a17bba-c68a-4372-8331-15d0b4a18257 service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:16.108831 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a17bba-c68a-4372-8331-15d0b4a18257 service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:16.109296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a17bba-c68a-4372-8331-15d0b4a18257 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:16.111768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-89a17bba-c68a-4372-8331-15d0b4a18257 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:16.130484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a17bba-c68a-4372-8331-15d0b4a18257 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:16.141349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a17bba-c68a-4372-8331-15d0b4a18257 service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:16.158871 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1203/2418] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:10:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:10:19.567465 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df8ff0-e0f6-4606-91c6-705efe5781b9 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:19.567954 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df8ff0-e0f6-4606-91c6-705efe5781b9 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:19.568066 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df8ff0-e0f6-4606-91c6-705efe5781b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:19.585335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-28df8ff0-e0f6-4606-91c6-705efe5781b9 None None] MFA Rules not processed for user `042853e4abce41f9a3e8263d1fc8ac00`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:10:19.586558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-28df8ff0-e0f6-4606-91c6-705efe5781b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:19.594466 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1216/2419] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:10:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:10:19.910546 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a17bba-c68a-4372-8331-15d0b4a18257 service nova] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:19.912094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-89a17bba-c68a-4372-8331-15d0b4a18257 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:19.924982 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a17bba-c68a-4372-8331-15d0b4a18257 service nova] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:19.929266 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbc91c-2432-4ed8-9b3e-fa81b6d12730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:19.930020 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbc91c-2432-4ed8-9b3e-fa81b6d12730 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:19.930320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbc91c-2432-4ed8-9b3e-fa81b6d12730 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:19.930668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbc91c-2432-4ed8-9b3e-fa81b6d12730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:19.932620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-3efbc91c-2432-4ed8-9b3e-fa81b6d12730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:19.943403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbc91c-2432-4ed8-9b3e-fa81b6d12730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:19.945046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbc91c-2432-4ed8-9b3e-fa81b6d12730 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:19.955484 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1204/2420] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:10:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:10:28.582542 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df8ff0-e0f6-4606-91c6-705efe5781b9 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:28.599161 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df8ff0-e0f6-4606-91c6-705efe5781b9 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:28.606069 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe82f4-d034-46db-a7a6-74e7d2e56ebb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:28.606956 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe82f4-d034-46db-a7a6-74e7d2e56ebb service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:28.607250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe82f4-d034-46db-a7a6-74e7d2e56ebb service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:28.607525 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe82f4-d034-46db-a7a6-74e7d2e56ebb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:28.609627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-56fe82f4-d034-46db-a7a6-74e7d2e56ebb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:28.623202 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe82f4-d034-46db-a7a6-74e7d2e56ebb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:28.625151 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe82f4-d034-46db-a7a6-74e7d2e56ebb service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:28.638162 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1217/2421] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:10:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:10:29.950326 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=69 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:10:35.297634 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db22cb-3db9-417e-b9e2-0d3e1063eebd None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:35.298313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db22cb-3db9-417e-b9e2-0d3e1063eebd None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:35.298313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db22cb-3db9-417e-b9e2-0d3e1063eebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:35.316859 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-b8db22cb-3db9-417e-b9e2-0d3e1063eebd None None] MFA Rules not processed for user `0dbf596d8f964d4695944a23dd8e4cef`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:10:35.318126 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-b8db22cb-3db9-417e-b9e2-0d3e1063eebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:35.381383 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1205/2422] 10.222.0.13 () {58 vars in 967 bytes} [Thu Jun 23 02:10:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:10:35.434169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe82f4-d034-46db-a7a6-74e7d2e56ebb service nova] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:35.435787 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-56fe82f4-d034-46db-a7a6-74e7d2e56ebb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:35.523744 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe82f4-d034-46db-a7a6-74e7d2e56ebb service nova] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:35.529086 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597618c-c3bd-4f5d-848b-2b683e4974b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae132c4d0b5461aa26ab929a017cb08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:35.529728 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597618c-c3bd-4f5d-848b-2b683e4974b1 service swift] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:35.530010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597618c-c3bd-4f5d-848b-2b683e4974b1 service swift] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:35.530287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597618c-c3bd-4f5d-848b-2b683e4974b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:35.540574 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597618c-c3bd-4f5d-848b-2b683e4974b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:35.542593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597618c-c3bd-4f5d-848b-2b683e4974b1 service swift] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:35.552021 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1218/2423] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 02:10:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 02:10:35.899079 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db22cb-3db9-417e-b9e2-0d3e1063eebd None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:35.914381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db22cb-3db9-417e-b9e2-0d3e1063eebd None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:35.920281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5be97-b933-477a-b422-6ca3bc2c1b40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:35.921205 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5be97-b933-477a-b422-6ca3bc2c1b40 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:35.921700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5be97-b933-477a-b422-6ca3bc2c1b40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:35.926642 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5be97-b933-477a-b422-6ca3bc2c1b40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:35.929309 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-31a5be97-b933-477a-b422-6ca3bc2c1b40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:35.997321 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5be97-b933-477a-b422-6ca3bc2c1b40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:35.998820 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5be97-b933-477a-b422-6ca3bc2c1b40 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:36.010029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1206/2424] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:10:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:10:40.491778 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597618c-c3bd-4f5d-848b-2b683e4974b1 service swift] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:40.497932 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=75 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:10:40.516615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597618c-c3bd-4f5d-848b-2b683e4974b1 service swift] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:40.524284 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383674b-1d9f-4fc1-b6ec-7461740cd746 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9756f5b9de8a4f23b365a96d309d86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:40.525139 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383674b-1d9f-4fc1-b6ec-7461740cd746 service placement] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:40.525639 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383674b-1d9f-4fc1-b6ec-7461740cd746 service placement] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:40.526249 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383674b-1d9f-4fc1-b6ec-7461740cd746 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:40.528804 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-6383674b-1d9f-4fc1-b6ec-7461740cd746 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:40.543831 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383674b-1d9f-4fc1-b6ec-7461740cd746 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:40.546804 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383674b-1d9f-4fc1-b6ec-7461740cd746 service placement] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:40.555088 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5be97-b933-477a-b422-6ca3bc2c1b40 service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:40.556656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-31a5be97-b933-477a-b422-6ca3bc2c1b40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:40.563761 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1219/2425] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:10:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:10:40.575712 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5be97-b933-477a-b422-6ca3bc2c1b40 service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:40.580700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7b901-684d-4ed2-8b61-bb3665fdce37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:40.582004 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7b901-684d-4ed2-8b61-bb3665fdce37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:40.582377 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7b901-684d-4ed2-8b61-bb3665fdce37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:40.582714 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7b901-684d-4ed2-8b61-bb3665fdce37 admin admin] PATH_INFO: `/v3/users/0c3ad28388a84ebd9d386fa466c65ba9` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:40.584095 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7b901-684d-4ed2-8b61-bb3665fdce37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c3ad28388a84ebd9d386fa466c65ba9)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:40.586201 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7b901-684d-4ed2-8b61-bb3665fdce37 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:40.671032 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e2b7b901-684d-4ed2-8b61-bb3665fdce37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c3ad28388a84ebd9d386fa466c65ba9'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:40.685832 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e2b7b901-684d-4ed2-8b61-bb3665fdce37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c3ad28388a84ebd9d386fa466c65ba9'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:40.694345 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e2b7b901-684d-4ed2-8b61-bb3665fdce37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c3ad28388a84ebd9d386fa466c65ba9'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:40.696039 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e2b7b901-684d-4ed2-8b61-bb3665fdce37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c3ad28388a84ebd9d386fa466c65ba9'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:40.708393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e2b7b901-684d-4ed2-8b61-bb3665fdce37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c3ad28388a84ebd9d386fa466c65ba9'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:40.720992 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1207/2426] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:10:40 2022] DELETE /identity/v3/users/0c3ad28388a84ebd9d386fa466c65ba9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:10:40.922842 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383674b-1d9f-4fc1-b6ec-7461740cd746 service placement] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:40.941321 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383674b-1d9f-4fc1-b6ec-7461740cd746 service placement] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:41.003642 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc36a97-d17b-4891-beb4-f38ccbef5ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:41.004561 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc36a97-d17b-4891-beb4-f38ccbef5ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:41.004934 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc36a97-d17b-4891-beb4-f38ccbef5ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:41.005250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc36a97-d17b-4891-beb4-f38ccbef5ba1 admin admin] PATH_INFO: `/v3/projects/1f860c81407e44f697340c74e0f20473` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:41.006457 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc36a97-d17b-4891-beb4-f38ccbef5ba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f860c81407e44f697340c74e0f20473)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:41.008443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc36a97-d17b-4891-beb4-f38ccbef5ba1 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:41.057126 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-adc36a97-d17b-4891-beb4-f38ccbef5ba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f860c81407e44f697340c74e0f20473', 'request_id': 'req-adc36a97-d17b-4891-beb4-f38ccbef5ba1'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:41.063252 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-adc36a97-d17b-4891-beb4-f38ccbef5ba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f860c81407e44f697340c74e0f20473', 'request_id': 'req-adc36a97-d17b-4891-beb4-f38ccbef5ba1'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:41.071804 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-adc36a97-d17b-4891-beb4-f38ccbef5ba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f860c81407e44f697340c74e0f20473', 'request_id': 'req-adc36a97-d17b-4891-beb4-f38ccbef5ba1'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:41.083380 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-adc36a97-d17b-4891-beb4-f38ccbef5ba1 admin admin] The token cache is being invalidate because project 1f860c81407e44f697340c74e0f20473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:10:41.083618 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-adc36a97-d17b-4891-beb4-f38ccbef5ba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:41.084369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-adc36a97-d17b-4891-beb4-f38ccbef5ba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:41.086019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1220/2427] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:10:40 2022] DELETE /identity/v3/projects/1f860c81407e44f697340c74e0f20473 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:10:41.091237 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950f82f-1495-4751-aa41-cde3542a8ca3 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:41.091562 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950f82f-1495-4751-aa41-cde3542a8ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:41.091843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950f82f-1495-4751-aa41-cde3542a8ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:41.112717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-4950f82f-1495-4751-aa41-cde3542a8ca3 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:10:41.114135 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-4950f82f-1495-4751-aa41-cde3542a8ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:41.120244 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:10:41.180923 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1208/2428] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:10:41.189133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a493e-0e67-4fb7-8d6d-aa5346e061d2 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:41.189466 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a493e-0e67-4fb7-8d6d-aa5346e061d2 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:41.189743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a493e-0e67-4fb7-8d6d-aa5346e061d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:41.209061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-b36a493e-0e67-4fb7-8d6d-aa5346e061d2 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:10:41.210282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-b36a493e-0e67-4fb7-8d6d-aa5346e061d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:41.218308 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1221/2429] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:10:41.222753 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950f82f-1495-4751-aa41-cde3542a8ca3 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:41.232642 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950f82f-1495-4751-aa41-cde3542a8ca3 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:41.237872 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710603d-1daa-477d-ad30-e4006cfae547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:41.238552 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710603d-1daa-477d-ad30-e4006cfae547 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:41.238832 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710603d-1daa-477d-ad30-e4006cfae547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:41.239108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710603d-1daa-477d-ad30-e4006cfae547 admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:41.239897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710603d-1daa-477d-ad30-e4006cfae547 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:10:41.240228 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710603d-1daa-477d-ad30-e4006cfae547 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:41.241866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710603d-1daa-477d-ad30-e4006cfae547 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:41.254351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1209/2430] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:10:41.258817 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a493e-0e67-4fb7-8d6d-aa5346e061d2 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:41.268435 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a493e-0e67-4fb7-8d6d-aa5346e061d2 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:41.273456 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29529c-2d70-44c0-bbaa-3d5adbc5d51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:41.274123 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29529c-2d70-44c0-bbaa-3d5adbc5d51e admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:41.274403 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29529c-2d70-44c0-bbaa-3d5adbc5d51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:41.274672 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29529c-2d70-44c0-bbaa-3d5adbc5d51e admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:41.275361 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29529c-2d70-44c0-bbaa-3d5adbc5d51e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:41.277327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29529c-2d70-44c0-bbaa-3d5adbc5d51e admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:41.318740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1222/2431] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:10:41 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:10:41.320218 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710603d-1daa-477d-ad30-e4006cfae547 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:41.330573 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710603d-1daa-477d-ad30-e4006cfae547 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:41.388355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed9e03-0cc3-40f0-94a2-636bb6031fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:41.389348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed9e03-0cc3-40f0-94a2-636bb6031fcb admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:41.389630 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed9e03-0cc3-40f0-94a2-636bb6031fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:41.389932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed9e03-0cc3-40f0-94a2-636bb6031fcb admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:41.390615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed9e03-0cc3-40f0-94a2-636bb6031fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:41.392565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed9e03-0cc3-40f0-94a2-636bb6031fcb admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:41.416973 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1210/2432] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:10:41 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:10:41.418187 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29529c-2d70-44c0-bbaa-3d5adbc5d51e admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:41.430275 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29529c-2d70-44c0-bbaa-3d5adbc5d51e admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:41.435367 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcf9d7-acc3-49cd-844b-849136c090bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:41.436103 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcf9d7-acc3-49cd-844b-849136c090bd admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:41.436384 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcf9d7-acc3-49cd-844b-849136c090bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:41.436655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcf9d7-acc3-49cd-844b-849136c090bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:41.437392 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcf9d7-acc3-49cd-844b-849136c090bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:41.439026 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcf9d7-acc3-49cd-844b-849136c090bd admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:41.450348 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1223/2433] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:10:41.454600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed9e03-0cc3-40f0-94a2-636bb6031fcb admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:41.465187 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed9e03-0cc3-40f0-94a2-636bb6031fcb admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:41.469986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87168f-4761-44c7-8f7f-b9db96cb8ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:41.470668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87168f-4761-44c7-8f7f-b9db96cb8ada admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:41.470947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87168f-4761-44c7-8f7f-b9db96cb8ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:41.471343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87168f-4761-44c7-8f7f-b9db96cb8ada admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:41.472136 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87168f-4761-44c7-8f7f-b9db96cb8ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:41.473796 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87168f-4761-44c7-8f7f-b9db96cb8ada admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:41.484223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1211/2434] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:10:41.488653 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcf9d7-acc3-49cd-844b-849136c090bd admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:41.498685 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcf9d7-acc3-49cd-844b-849136c090bd admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:41.503510 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a872f-ee2c-490c-94f3-390b334295f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:41.504492 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a872f-ee2c-490c-94f3-390b334295f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:41.504773 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a872f-ee2c-490c-94f3-390b334295f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:41.505136 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a872f-ee2c-490c-94f3-390b334295f6 admin admin] PATH_INFO: `/v3/projects/de56a13061a84014aa119345dfe909f1/users/502bab0e79cf4fd5bc61d3c56b6035ca/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:41.521066 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a872f-ee2c-490c-94f3-390b334295f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de56a13061a84014aa119345dfe909f1, user_id=502bab0e79cf4fd5bc61d3c56b6035ca, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:41.523913 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a872f-ee2c-490c-94f3-390b334295f6 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:41.547370 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1224/2435] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:10:41 2022] PUT /identity/v3/projects/de56a13061a84014aa119345dfe909f1/users/502bab0e79cf4fd5bc61d3c56b6035ca/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:10:41.550071 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc921a-c0d8-4cf1-82d3-b9d8e07318b6 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:41.550420 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc921a-c0d8-4cf1-82d3-b9d8e07318b6 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:41.550722 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc921a-c0d8-4cf1-82d3-b9d8e07318b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:41.585297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-d3fc921a-c0d8-4cf1-82d3-b9d8e07318b6 None None] MFA Rules not processed for user `502bab0e79cf4fd5bc61d3c56b6035ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:10:41.586580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-d3fc921a-c0d8-4cf1-82d3-b9d8e07318b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:41.662209 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1212/2436] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:10:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:10:41.674939 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a872f-ee2c-490c-94f3-390b334295f6 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:41.676896 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-714a872f-ee2c-490c-94f3-390b334295f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:41.687958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:10:41.760575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a872f-ee2c-490c-94f3-390b334295f6 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:41.766347 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866f359-f3a4-4d29-ab31-a8f3dae868c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:41.767346 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866f359-f3a4-4d29-ab31-a8f3dae868c1 service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:41.767714 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866f359-f3a4-4d29-ab31-a8f3dae868c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:41.768058 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866f359-f3a4-4d29-ab31-a8f3dae868c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:41.776073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866f359-f3a4-4d29-ab31-a8f3dae868c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:41.777706 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866f359-f3a4-4d29-ab31-a8f3dae868c1 service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:41.787082 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1225/2437] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:10:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:10:42.181608 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc921a-c0d8-4cf1-82d3-b9d8e07318b6 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:42.192256 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:10:42.262398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc921a-c0d8-4cf1-82d3-b9d8e07318b6 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:42.268571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c6e0e-23b5-4eec-8f29-833de22092ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:42.269773 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c6e0e-23b5-4eec-8f29-833de22092ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:42.270242 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c6e0e-23b5-4eec-8f29-833de22092ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:42.270779 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c6e0e-23b5-4eec-8f29-833de22092ef admin admin] PATH_INFO: `/v3/users/502bab0e79cf4fd5bc61d3c56b6035ca` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:42.272086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c6e0e-23b5-4eec-8f29-833de22092ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=502bab0e79cf4fd5bc61d3c56b6035ca)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:42.274175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c6e0e-23b5-4eec-8f29-833de22092ef admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:42.334212 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-a97c6e0e-23b5-4eec-8f29-833de22092ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '502bab0e79cf4fd5bc61d3c56b6035ca'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:42.349584 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-a97c6e0e-23b5-4eec-8f29-833de22092ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '502bab0e79cf4fd5bc61d3c56b6035ca'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:42.357922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-a97c6e0e-23b5-4eec-8f29-833de22092ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '502bab0e79cf4fd5bc61d3c56b6035ca'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:42.358630 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-a97c6e0e-23b5-4eec-8f29-833de22092ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '502bab0e79cf4fd5bc61d3c56b6035ca'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:42.368499 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-a97c6e0e-23b5-4eec-8f29-833de22092ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '502bab0e79cf4fd5bc61d3c56b6035ca'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:42.376688 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1213/2438] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:10:42 2022] DELETE /identity/v3/users/502bab0e79cf4fd5bc61d3c56b6035ca => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:10:42.382489 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708620f-59f6-43b8-8c65-1c870909e512 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:42.382911 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708620f-59f6-43b8-8c65-1c870909e512 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:42.383283 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708620f-59f6-43b8-8c65-1c870909e512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:42.401321 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-e708620f-59f6-43b8-8c65-1c870909e512 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:10:42.402878 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-e708620f-59f6-43b8-8c65-1c870909e512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:42.475590 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1226/2439] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:10:42.484916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c6e0e-23b5-4eec-8f29-833de22092ef admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:42.486491 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a97c6e0e-23b5-4eec-8f29-833de22092ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:42.562253 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c6e0e-23b5-4eec-8f29-833de22092ef admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:42.568704 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a913ecd-ba72-4303-a9f0-b3a39ae61532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:42.569457 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a913ecd-ba72-4303-a9f0-b3a39ae61532 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:42.570063 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a913ecd-ba72-4303-a9f0-b3a39ae61532 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:42.570496 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a913ecd-ba72-4303-a9f0-b3a39ae61532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:42.582031 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a913ecd-ba72-4303-a9f0-b3a39ae61532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:42.583618 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a913ecd-ba72-4303-a9f0-b3a39ae61532 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:42.595401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1214/2440] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:10:42.932706 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708620f-59f6-43b8-8c65-1c870909e512 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:42.934218 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-e708620f-59f6-43b8-8c65-1c870909e512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:42.947891 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708620f-59f6-43b8-8c65-1c870909e512 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:42.953230 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd54a09-f835-42f6-a2ec-721c1c997c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:42.954514 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd54a09-f835-42f6-a2ec-721c1c997c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:42.954514 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd54a09-f835-42f6-a2ec-721c1c997c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:42.954756 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd54a09-f835-42f6-a2ec-721c1c997c35 admin admin] PATH_INFO: `/v3/projects/de56a13061a84014aa119345dfe909f1` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:42.956028 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd54a09-f835-42f6-a2ec-721c1c997c35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de56a13061a84014aa119345dfe909f1)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:42.957969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd54a09-f835-42f6-a2ec-721c1c997c35 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:43.007113 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-5dd54a09-f835-42f6-a2ec-721c1c997c35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de56a13061a84014aa119345dfe909f1', 'request_id': 'req-5dd54a09-f835-42f6-a2ec-721c1c997c35'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:43.013524 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-5dd54a09-f835-42f6-a2ec-721c1c997c35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de56a13061a84014aa119345dfe909f1', 'request_id': 'req-5dd54a09-f835-42f6-a2ec-721c1c997c35'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:43.021895 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-5dd54a09-f835-42f6-a2ec-721c1c997c35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de56a13061a84014aa119345dfe909f1', 'request_id': 'req-5dd54a09-f835-42f6-a2ec-721c1c997c35'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:43.033750 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-5dd54a09-f835-42f6-a2ec-721c1c997c35 admin admin] The token cache is being invalidate because project de56a13061a84014aa119345dfe909f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:10:43.034411 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-5dd54a09-f835-42f6-a2ec-721c1c997c35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:43.035042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-5dd54a09-f835-42f6-a2ec-721c1c997c35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:43.040814 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1227/2441] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:10:42 2022] DELETE /identity/v3/projects/de56a13061a84014aa119345dfe909f1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:10:43.042669 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3333d-e4f1-44fe-a6a6-09c54bfb386a None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:43.042886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3333d-e4f1-44fe-a6a6-09c54bfb386a None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:43.043167 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3333d-e4f1-44fe-a6a6-09c54bfb386a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:43.064301 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-7cb3333d-e4f1-44fe-a6a6-09c54bfb386a None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:10:43.065886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-7cb3333d-e4f1-44fe-a6a6-09c54bfb386a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:43.092802 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:10:43.137703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1215/2442] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:10:43.147095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b314a61-9a39-4ee4-9236-e7d265c5ded5 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:43.147502 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b314a61-9a39-4ee4-9236-e7d265c5ded5 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:43.147852 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b314a61-9a39-4ee4-9236-e7d265c5ded5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:43.170600 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-1b314a61-9a39-4ee4-9236-e7d265c5ded5 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:10:43.172223 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-1b314a61-9a39-4ee4-9236-e7d265c5ded5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:43.184559 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1228/2443] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:10:43.192323 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3333d-e4f1-44fe-a6a6-09c54bfb386a None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:43.209017 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3333d-e4f1-44fe-a6a6-09c54bfb386a None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:43.216364 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fcd299-9658-4106-b49e-c12cf3c70b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:43.217113 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fcd299-9658-4106-b49e-c12cf3c70b7c admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:43.217339 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fcd299-9658-4106-b49e-c12cf3c70b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:43.217618 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fcd299-9658-4106-b49e-c12cf3c70b7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:43.218367 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fcd299-9658-4106-b49e-c12cf3c70b7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:10:43.218677 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fcd299-9658-4106-b49e-c12cf3c70b7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:43.220375 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fcd299-9658-4106-b49e-c12cf3c70b7c admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:43.238643 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1216/2444] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:10:43.240231 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b314a61-9a39-4ee4-9236-e7d265c5ded5 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:43.250368 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b314a61-9a39-4ee4-9236-e7d265c5ded5 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:43.256004 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c74d2-0e77-4700-b89b-14393abb4ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:43.256919 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c74d2-0e77-4700-b89b-14393abb4ebd admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:43.257202 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c74d2-0e77-4700-b89b-14393abb4ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:43.257478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c74d2-0e77-4700-b89b-14393abb4ebd admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:43.258218 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c74d2-0e77-4700-b89b-14393abb4ebd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:43.260154 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c74d2-0e77-4700-b89b-14393abb4ebd admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:43.265082 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:10:43.297781 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1229/2445] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:10:43 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:10:43.299266 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fcd299-9658-4106-b49e-c12cf3c70b7c admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:43.310304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fcd299-9658-4106-b49e-c12cf3c70b7c admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:43.370995 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b2368-481e-4b8d-ab3c-e88c95df567a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:43.371721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b2368-481e-4b8d-ab3c-e88c95df567a admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:43.372006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b2368-481e-4b8d-ab3c-e88c95df567a admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:43.372299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b2368-481e-4b8d-ab3c-e88c95df567a admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:43.373062 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b2368-481e-4b8d-ab3c-e88c95df567a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:43.375049 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b2368-481e-4b8d-ab3c-e88c95df567a admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:43.398740 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1217/2446] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:10:43 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:10:43.404244 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c74d2-0e77-4700-b89b-14393abb4ebd admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:43.415139 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c74d2-0e77-4700-b89b-14393abb4ebd admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:43.421851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72626084-4cf5-40e9-88fe-39385942cae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:43.422457 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72626084-4cf5-40e9-88fe-39385942cae3 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:43.422740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72626084-4cf5-40e9-88fe-39385942cae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:43.423009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72626084-4cf5-40e9-88fe-39385942cae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:43.423801 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72626084-4cf5-40e9-88fe-39385942cae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:43.425638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72626084-4cf5-40e9-88fe-39385942cae3 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:43.437385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1230/2447] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:10:43.441646 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b2368-481e-4b8d-ab3c-e88c95df567a admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:43.452255 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b2368-481e-4b8d-ab3c-e88c95df567a admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:43.457528 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291fb79-38e2-41e5-b336-623d3510c324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:43.458273 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291fb79-38e2-41e5-b336-623d3510c324 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:43.458631 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291fb79-38e2-41e5-b336-623d3510c324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:43.458998 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291fb79-38e2-41e5-b336-623d3510c324 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:43.459868 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291fb79-38e2-41e5-b336-623d3510c324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:43.461563 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291fb79-38e2-41e5-b336-623d3510c324 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:43.472287 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1218/2448] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:10:43.476489 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72626084-4cf5-40e9-88fe-39385942cae3 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:43.486666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72626084-4cf5-40e9-88fe-39385942cae3 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:43.491972 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba018e6-9913-4500-8331-51f8059d8b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:43.492875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba018e6-9913-4500-8331-51f8059d8b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:43.493152 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba018e6-9913-4500-8331-51f8059d8b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:43.493427 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba018e6-9913-4500-8331-51f8059d8b05 admin admin] PATH_INFO: `/v3/projects/665440ed828d45e1a10811c3b9076809/users/d72937d41af94804a317ebaa730ed06e/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:43.512354 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba018e6-9913-4500-8331-51f8059d8b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=665440ed828d45e1a10811c3b9076809, user_id=d72937d41af94804a317ebaa730ed06e, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:43.515381 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba018e6-9913-4500-8331-51f8059d8b05 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:43.548019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1231/2449] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:10:43 2022] PUT /identity/v3/projects/665440ed828d45e1a10811c3b9076809/users/d72937d41af94804a317ebaa730ed06e/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:10:43.549895 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bce8eb-b8b9-40da-9e4d-1ac834616ac4 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:43.550452 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bce8eb-b8b9-40da-9e4d-1ac834616ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:43.550786 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bce8eb-b8b9-40da-9e4d-1ac834616ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:43.583204 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-79bce8eb-b8b9-40da-9e4d-1ac834616ac4 None None] MFA Rules not processed for user `d72937d41af94804a317ebaa730ed06e`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:10:43.584585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-79bce8eb-b8b9-40da-9e4d-1ac834616ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:43.656283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1219/2450] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:10:43 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:10:43.660947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba018e6-9913-4500-8331-51f8059d8b05 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:43.725883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bce8eb-b8b9-40da-9e4d-1ac834616ac4 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:43.727346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-79bce8eb-b8b9-40da-9e4d-1ac834616ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:43.749066 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba018e6-9913-4500-8331-51f8059d8b05 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:43.756112 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c1273-addd-4325-8ee0-2a5f589ead6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:43.756743 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c1273-addd-4325-8ee0-2a5f589ead6b admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:43.757026 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c1273-addd-4325-8ee0-2a5f589ead6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:43.757325 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c1273-addd-4325-8ee0-2a5f589ead6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:43.757759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:10:43.758042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c1273-addd-4325-8ee0-2a5f589ead6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:43.760289 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c1273-addd-4325-8ee0-2a5f589ead6b admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:43.794543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1232/2451] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:10:43 2022] POST /identity/v3/projects => generated 363 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:10:43.795551 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c1273-addd-4325-8ee0-2a5f589ead6b admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:43.807768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bce8eb-b8b9-40da-9e4d-1ac834616ac4 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:43.866134 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c1273-addd-4325-8ee0-2a5f589ead6b admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:43.873639 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e8f58-4ce8-45b1-ac51-1f3408bcdbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:43.873780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35095a-26a2-40ef-9592-53f9950fe3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:43.874343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35095a-26a2-40ef-9592-53f9950fe3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:43.874546 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e8f58-4ce8-45b1-ac51-1f3408bcdbf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:43.874655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35095a-26a2-40ef-9592-53f9950fe3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:43.874883 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35095a-26a2-40ef-9592-53f9950fe3e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:43.874978 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e8f58-4ce8-45b1-ac51-1f3408bcdbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:43.875162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e8f58-4ce8-45b1-ac51-1f3408bcdbf9 admin admin] PATH_INFO: `/v3/users/7f57f8e664e64f0a94d19d3dc9ecca3d` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:43.875610 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35095a-26a2-40ef-9592-53f9950fe3e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:43.876438 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e8f58-4ce8-45b1-ac51-1f3408bcdbf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f57f8e664e64f0a94d19d3dc9ecca3d)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:43.877807 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35095a-26a2-40ef-9592-53f9950fe3e5 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:43.879034 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e8f58-4ce8-45b1-ac51-1f3408bcdbf9 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:43.898580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1233/2452] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:10:43 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:10:43.902899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35095a-26a2-40ef-9592-53f9950fe3e5 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:43.914698 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35095a-26a2-40ef-9592-53f9950fe3e5 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:43.920177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84631df7-7f82-4de4-84f7-fc2a74cd4b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:43.920848 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84631df7-7f82-4de4-84f7-fc2a74cd4b21 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:43.921147 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84631df7-7f82-4de4-84f7-fc2a74cd4b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:43.921408 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84631df7-7f82-4de4-84f7-fc2a74cd4b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:43.922206 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84631df7-7f82-4de4-84f7-fc2a74cd4b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:43.923923 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84631df7-7f82-4de4-84f7-fc2a74cd4b21 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:43.934729 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1234/2453] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:10:43.937988 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-023e8f58-4ce8-45b1-ac51-1f3408bcdbf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f57f8e664e64f0a94d19d3dc9ecca3d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:43.938633 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84631df7-7f82-4de4-84f7-fc2a74cd4b21 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:43.948825 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84631df7-7f82-4de4-84f7-fc2a74cd4b21 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:43.951055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-023e8f58-4ce8-45b1-ac51-1f3408bcdbf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f57f8e664e64f0a94d19d3dc9ecca3d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:43.955001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7f098-ddce-4428-9ced-a5681cedb7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:43.956300 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7f098-ddce-4428-9ced-a5681cedb7fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:43.956593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7f098-ddce-4428-9ced-a5681cedb7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:43.956872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7f098-ddce-4428-9ced-a5681cedb7fe admin admin] PATH_INFO: `/v3/projects/4a848bffb6ea4ed9a41bda00f90ad2f6/users/4897ad98906549ec9f91f930891d6f7e/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:43.958821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-023e8f58-4ce8-45b1-ac51-1f3408bcdbf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f57f8e664e64f0a94d19d3dc9ecca3d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:43.959636 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-023e8f58-4ce8-45b1-ac51-1f3408bcdbf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f57f8e664e64f0a94d19d3dc9ecca3d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:43.968546 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-023e8f58-4ce8-45b1-ac51-1f3408bcdbf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f57f8e664e64f0a94d19d3dc9ecca3d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:43.969192 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:10:43.972887 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7f098-ddce-4428-9ced-a5681cedb7fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a848bffb6ea4ed9a41bda00f90ad2f6, user_id=4897ad98906549ec9f91f930891d6f7e, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:43.975321 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1220/2454] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:10:43 2022] DELETE /identity/v3/users/7f57f8e664e64f0a94d19d3dc9ecca3d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:10:43.976295 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7f098-ddce-4428-9ced-a5681cedb7fe admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:43.992483 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1235/2455] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:10:43 2022] PUT /identity/v3/projects/4a848bffb6ea4ed9a41bda00f90ad2f6/users/4897ad98906549ec9f91f930891d6f7e/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:10:43.996606 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e8f58-4ce8-45b1-ac51-1f3408bcdbf9 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:43.998149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-023e8f58-4ce8-45b1-ac51-1f3408bcdbf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:44.053746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:10:44.072522 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e8f58-4ce8-45b1-ac51-1f3408bcdbf9 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:44.131738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22eb7c-024d-4859-a8f7-443e2cf35bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:44.132373 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22eb7c-024d-4859-a8f7-443e2cf35bee admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:44.132790 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22eb7c-024d-4859-a8f7-443e2cf35bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:44.133082 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22eb7c-024d-4859-a8f7-443e2cf35bee admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:44.133826 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22eb7c-024d-4859-a8f7-443e2cf35bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:44.135552 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22eb7c-024d-4859-a8f7-443e2cf35bee admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:44.149205 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1221/2456] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:10:44.152498 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7f098-ddce-4428-9ced-a5681cedb7fe admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:44.161693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22eb7c-024d-4859-a8f7-443e2cf35bee admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:44.163680 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-1d22eb7c-024d-4859-a8f7-443e2cf35bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:44.164631 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7f098-ddce-4428-9ced-a5681cedb7fe admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:44.169894 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74188e-7085-473b-8651-de78125de649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:44.170800 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74188e-7085-473b-8651-de78125de649 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:44.171090 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74188e-7085-473b-8651-de78125de649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:44.171338 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74188e-7085-473b-8651-de78125de649 admin admin] PATH_INFO: `/v3/projects/4a848bffb6ea4ed9a41bda00f90ad2f6/users/4897ad98906549ec9f91f930891d6f7e/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:44.174020 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74188e-7085-473b-8651-de78125de649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a848bffb6ea4ed9a41bda00f90ad2f6, user_id=4897ad98906549ec9f91f930891d6f7e, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:44.176190 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74188e-7085-473b-8651-de78125de649 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:44.181804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22eb7c-024d-4859-a8f7-443e2cf35bee admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:44.188725 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1236/2457] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:10:44 2022] PUT /identity/v3/projects/4a848bffb6ea4ed9a41bda00f90ad2f6/users/4897ad98906549ec9f91f930891d6f7e/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:10:44.199615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3fa5b-1cf0-47ac-a491-5b8d9e5facab None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:44.199914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3fa5b-1cf0-47ac-a491-5b8d9e5facab None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:44.200194 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3fa5b-1cf0-47ac-a491-5b8d9e5facab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:44.227738 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-3ff3fa5b-1cf0-47ac-a491-5b8d9e5facab None None] MFA Rules not processed for user `4897ad98906549ec9f91f930891d6f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:10:44.228984 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-3ff3fa5b-1cf0-47ac-a491-5b8d9e5facab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:44.250768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f835f-6aaa-47c2-a628-4f9581000092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:44.251713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f835f-6aaa-47c2-a628-4f9581000092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:44.252000 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f835f-6aaa-47c2-a628-4f9581000092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:44.252369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f835f-6aaa-47c2-a628-4f9581000092 admin admin] PATH_INFO: `/v3/projects/976261d1e5b64a0489fe16e0a099e4fa` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:44.254912 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f835f-6aaa-47c2-a628-4f9581000092 admin admin] RBAC: Authorizing `identity:delete_project(project_id=976261d1e5b64a0489fe16e0a099e4fa)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:44.257022 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f835f-6aaa-47c2-a628-4f9581000092 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:44.304096 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1237/2458] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:10:44 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:10:44.309277 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3c9f835f-6aaa-47c2-a628-4f9581000092 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '976261d1e5b64a0489fe16e0a099e4fa', 'request_id': 'req-3c9f835f-6aaa-47c2-a628-4f9581000092'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:44.316250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3fa5b-1cf0-47ac-a491-5b8d9e5facab None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:44.317786 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-3ff3fa5b-1cf0-47ac-a491-5b8d9e5facab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:44.319172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3c9f835f-6aaa-47c2-a628-4f9581000092 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '976261d1e5b64a0489fe16e0a099e4fa', 'request_id': 'req-3c9f835f-6aaa-47c2-a628-4f9581000092'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:44.325424 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3c9f835f-6aaa-47c2-a628-4f9581000092 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '976261d1e5b64a0489fe16e0a099e4fa', 'request_id': 'req-3c9f835f-6aaa-47c2-a628-4f9581000092'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:44.338725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3c9f835f-6aaa-47c2-a628-4f9581000092 admin admin] The token cache is being invalidate because project 976261d1e5b64a0489fe16e0a099e4fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:10:44.339019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3c9f835f-6aaa-47c2-a628-4f9581000092 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:44.340033 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3c9f835f-6aaa-47c2-a628-4f9581000092 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:44.344532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1222/2459] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:10:44 2022] DELETE /identity/v3/projects/976261d1e5b64a0489fe16e0a099e4fa => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:10:44.345345 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f835f-6aaa-47c2-a628-4f9581000092 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:44.347123 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-3c9f835f-6aaa-47c2-a628-4f9581000092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:44.378055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:10:44.381872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3fa5b-1cf0-47ac-a491-5b8d9e5facab None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:44.424778 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f835f-6aaa-47c2-a628-4f9581000092 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:44.430332 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb15d13-1bd9-4268-92ba-cc6139620084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:44.431300 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb15d13-1bd9-4268-92ba-cc6139620084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:44.431618 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb15d13-1bd9-4268-92ba-cc6139620084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:44.432325 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb15d13-1bd9-4268-92ba-cc6139620084 admin admin] PATH_INFO: `/v3/users/b97e148902094a6d9fc5453936553752` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:44.433226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb15d13-1bd9-4268-92ba-cc6139620084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b97e148902094a6d9fc5453936553752)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:44.435287 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb15d13-1bd9-4268-92ba-cc6139620084 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:44.440364 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8787ad-0c7e-4dc7-9c57-9a3ef382d547 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:44.441158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8787ad-0c7e-4dc7-9c57-9a3ef382d547 service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:44.441506 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8787ad-0c7e-4dc7-9c57-9a3ef382d547 service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:44.441868 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8787ad-0c7e-4dc7-9c57-9a3ef382d547 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:44.443895 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5c8787ad-0c7e-4dc7-9c57-9a3ef382d547 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:44.480733 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:10:44.485763 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-0eb15d13-1bd9-4268-92ba-cc6139620084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b97e148902094a6d9fc5453936553752'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:44.498901 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-0eb15d13-1bd9-4268-92ba-cc6139620084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b97e148902094a6d9fc5453936553752'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:44.506337 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-0eb15d13-1bd9-4268-92ba-cc6139620084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b97e148902094a6d9fc5453936553752'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:44.507035 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-0eb15d13-1bd9-4268-92ba-cc6139620084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b97e148902094a6d9fc5453936553752'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:44.510830 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8787ad-0c7e-4dc7-9c57-9a3ef382d547 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:44.512487 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8787ad-0c7e-4dc7-9c57-9a3ef382d547 service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:44.515610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-0eb15d13-1bd9-4268-92ba-cc6139620084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b97e148902094a6d9fc5453936553752'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:44.523255 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1223/2460] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:10:44 2022] DELETE /identity/v3/users/b97e148902094a6d9fc5453936553752 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:10:44.523669 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1238/2461] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:10:44 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:10:44.719075 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb15d13-1bd9-4268-92ba-cc6139620084 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:44.720760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-0eb15d13-1bd9-4268-92ba-cc6139620084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:44.817863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb15d13-1bd9-4268-92ba-cc6139620084 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:44.822817 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a13f0-ce00-416f-9598-d2c4ffa6a558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:44.823822 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a13f0-ce00-416f-9598-d2c4ffa6a558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:44.824142 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a13f0-ce00-416f-9598-d2c4ffa6a558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:44.824478 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a13f0-ce00-416f-9598-d2c4ffa6a558 admin admin] PATH_INFO: `/v3/projects/8a11a8506b8b4a29b45854753334a492` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:44.825788 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a13f0-ce00-416f-9598-d2c4ffa6a558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a11a8506b8b4a29b45854753334a492)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:44.827876 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a13f0-ce00-416f-9598-d2c4ffa6a558 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:44.882585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:10:44.886413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-fa7a13f0-ce00-416f-9598-d2c4ffa6a558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a11a8506b8b4a29b45854753334a492', 'request_id': 'req-fa7a13f0-ce00-416f-9598-d2c4ffa6a558'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:44.897708 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-fa7a13f0-ce00-416f-9598-d2c4ffa6a558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a11a8506b8b4a29b45854753334a492', 'request_id': 'req-fa7a13f0-ce00-416f-9598-d2c4ffa6a558'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:44.906940 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-fa7a13f0-ce00-416f-9598-d2c4ffa6a558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a11a8506b8b4a29b45854753334a492', 'request_id': 'req-fa7a13f0-ce00-416f-9598-d2c4ffa6a558'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:44.924647 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-fa7a13f0-ce00-416f-9598-d2c4ffa6a558 admin admin] The token cache is being invalidate because project 8a11a8506b8b4a29b45854753334a492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:10:44.924815 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-fa7a13f0-ce00-416f-9598-d2c4ffa6a558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:44.925576 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-fa7a13f0-ce00-416f-9598-d2c4ffa6a558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:44.929221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1224/2462] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:10:44 2022] DELETE /identity/v3/projects/8a11a8506b8b4a29b45854753334a492 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:10:44.935632 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b2e9-c1bb-4fbd-9577-987a7ca1cb4e None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:44.935632 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b2e9-c1bb-4fbd-9577-987a7ca1cb4e None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:44.935632 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b2e9-c1bb-4fbd-9577-987a7ca1cb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:44.953422 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-6f99b2e9-c1bb-4fbd-9577-987a7ca1cb4e None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:10:44.954650 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-6f99b2e9-c1bb-4fbd-9577-987a7ca1cb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:45.010776 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a13f0-ce00-416f-9598-d2c4ffa6a558 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:45.012347 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-fa7a13f0-ce00-416f-9598-d2c4ffa6a558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:45.017583 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1239/2463] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:10:45.025645 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a13f0-ce00-416f-9598-d2c4ffa6a558 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:45.025828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a867f-e824-448c-8836-9422cb94e7d7 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:45.026104 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a867f-e824-448c-8836-9422cb94e7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:45.026377 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a867f-e824-448c-8836-9422cb94e7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:45.030265 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205f800-3c02-4207-ab93-e407ea2fc997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:45.031152 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205f800-3c02-4207-ab93-e407ea2fc997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:45.031464 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205f800-3c02-4207-ab93-e407ea2fc997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:45.031743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205f800-3c02-4207-ab93-e407ea2fc997 admin admin] PATH_INFO: `/v3/users/d72937d41af94804a317ebaa730ed06e` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:45.032981 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205f800-3c02-4207-ab93-e407ea2fc997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d72937d41af94804a317ebaa730ed06e)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:45.035100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205f800-3c02-4207-ab93-e407ea2fc997 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:45.045719 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-2a5a867f-e824-448c-8836-9422cb94e7d7 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:10:45.046931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-2a5a867f-e824-448c-8836-9422cb94e7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:45.055249 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1240/2464] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:10:45.059534 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a867f-e824-448c-8836-9422cb94e7d7 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:45.071586 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a867f-e824-448c-8836-9422cb94e7d7 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:45.076971 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866578b5-9575-4c65-a727-46c9804e467c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:45.077648 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866578b5-9575-4c65-a727-46c9804e467c admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:45.077927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866578b5-9575-4c65-a727-46c9804e467c admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:45.078203 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866578b5-9575-4c65-a727-46c9804e467c admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:45.078930 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866578b5-9575-4c65-a727-46c9804e467c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:10:45.079234 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866578b5-9575-4c65-a727-46c9804e467c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:45.081228 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866578b5-9575-4c65-a727-46c9804e467c admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:45.086047 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-f205f800-3c02-4207-ab93-e407ea2fc997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd72937d41af94804a317ebaa730ed06e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:45.094483 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1241/2465] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 02:10:45.098618 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866578b5-9575-4c65-a727-46c9804e467c admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:45.099337 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-f205f800-3c02-4207-ab93-e407ea2fc997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd72937d41af94804a317ebaa730ed06e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:45.106625 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-f205f800-3c02-4207-ab93-e407ea2fc997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd72937d41af94804a317ebaa730ed06e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:45.107356 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-f205f800-3c02-4207-ab93-e407ea2fc997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd72937d41af94804a317ebaa730ed06e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:45.108290 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866578b5-9575-4c65-a727-46c9804e467c admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:45.113794 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d3e2b-9582-4cf4-9ad3-2840392fbab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:45.114605 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d3e2b-9582-4cf4-9ad3-2840392fbab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:45.114938 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d3e2b-9582-4cf4-9ad3-2840392fbab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:45.115216 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d3e2b-9582-4cf4-9ad3-2840392fbab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:45.115968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d3e2b-9582-4cf4-9ad3-2840392fbab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:45.116084 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-f205f800-3c02-4207-ab93-e407ea2fc997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd72937d41af94804a317ebaa730ed06e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:45.117901 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d3e2b-9582-4cf4-9ad3-2840392fbab4 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:45.122096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1225/2466] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:10:45 2022] DELETE /identity/v3/users/d72937d41af94804a317ebaa730ed06e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:10:45.126581 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b2697-5dc5-4b8e-a8db-2d9ec91db34b None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:45.126872 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b2697-5dc5-4b8e-a8db-2d9ec91db34b None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:45.127220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b2697-5dc5-4b8e-a8db-2d9ec91db34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:45.145549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-ba7b2697-5dc5-4b8e-a8db-2d9ec91db34b None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:10:45.146341 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1242/2467] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:10:45 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:10:45.149595 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-ba7b2697-5dc5-4b8e-a8db-2d9ec91db34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:45.150476 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d3e2b-9582-4cf4-9ad3-2840392fbab4 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:45.152178 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-560d3e2b-9582-4cf4-9ad3-2840392fbab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:45.207365 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1226/2468] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:10:45.216779 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d3e2b-9582-4cf4-9ad3-2840392fbab4 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:45.217154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b2697-5dc5-4b8e-a8db-2d9ec91db34b None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:45.218596 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-ba7b2697-5dc5-4b8e-a8db-2d9ec91db34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:45.222235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7eb93-cfcf-4fa5-ae2d-b75931f0c251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:45.222953 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7eb93-cfcf-4fa5-ae2d-b75931f0c251 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:45.223280 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7eb93-cfcf-4fa5-ae2d-b75931f0c251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:45.223618 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7eb93-cfcf-4fa5-ae2d-b75931f0c251 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:45.224324 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7eb93-cfcf-4fa5-ae2d-b75931f0c251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:45.226325 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7eb93-cfcf-4fa5-ae2d-b75931f0c251 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:45.251262 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1243/2469] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:10:45 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:10:45.252628 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7eb93-cfcf-4fa5-ae2d-b75931f0c251 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:45.262084 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7eb93-cfcf-4fa5-ae2d-b75931f0c251 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:45.266841 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a062a-97a5-40cb-b2ad-eb7e1eb80322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:45.267535 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a062a-97a5-40cb-b2ad-eb7e1eb80322 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:45.267866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a062a-97a5-40cb-b2ad-eb7e1eb80322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:45.268145 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a062a-97a5-40cb-b2ad-eb7e1eb80322 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:45.268901 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a062a-97a5-40cb-b2ad-eb7e1eb80322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:45.270731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a062a-97a5-40cb-b2ad-eb7e1eb80322 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:45.276441 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:10:45.282690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b2697-5dc5-4b8e-a8db-2d9ec91db34b None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:45.282836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1244/2470] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:10:45.286963 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a062a-97a5-40cb-b2ad-eb7e1eb80322 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:45.288274 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cf05e-812c-4a9b-abd3-a4e87573154f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:45.288984 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cf05e-812c-4a9b-abd3-a4e87573154f service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:45.289446 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cf05e-812c-4a9b-abd3-a4e87573154f service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:45.289870 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cf05e-812c-4a9b-abd3-a4e87573154f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:45.297098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a062a-97a5-40cb-b2ad-eb7e1eb80322 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:45.300595 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cf05e-812c-4a9b-abd3-a4e87573154f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:45.302066 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cf05e-812c-4a9b-abd3-a4e87573154f service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:45.302683 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50f818-2b79-4ad7-81e9-1461c7508d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:45.303366 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50f818-2b79-4ad7-81e9-1461c7508d95 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:45.303672 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50f818-2b79-4ad7-81e9-1461c7508d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:45.303964 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50f818-2b79-4ad7-81e9-1461c7508d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:45.305274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50f818-2b79-4ad7-81e9-1461c7508d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:45.306922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50f818-2b79-4ad7-81e9-1461c7508d95 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:45.308395 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:10:45.311941 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1227/2471] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:10:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:10:45.319754 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1245/2472] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:10:45.323683 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cf05e-812c-4a9b-abd3-a4e87573154f service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:45.333905 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cf05e-812c-4a9b-abd3-a4e87573154f service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:45.338665 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d35e0-20c2-445a-ad40-bf0f13c5708f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:45.339568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d35e0-20c2-445a-ad40-bf0f13c5708f admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:45.339855 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d35e0-20c2-445a-ad40-bf0f13c5708f admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:45.340160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d35e0-20c2-445a-ad40-bf0f13c5708f admin admin] PATH_INFO: `/v3/projects/410e0d53a5194be4b2ad9a2c28017244/users/8d78b45727a94620b8ecab2dbb77db50/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:45.354920 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d35e0-20c2-445a-ad40-bf0f13c5708f admin admin] RBAC: Authorizing `identity:create_grant(project_id=410e0d53a5194be4b2ad9a2c28017244, user_id=8d78b45727a94620b8ecab2dbb77db50, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:45.357638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d35e0-20c2-445a-ad40-bf0f13c5708f admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:45.373490 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1228/2473] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:10:45 2022] PUT /identity/v3/projects/410e0d53a5194be4b2ad9a2c28017244/users/8d78b45727a94620b8ecab2dbb77db50/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:10:45.378981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaa5bf-1481-4954-b712-8ec154fa96db None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:45.379332 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaa5bf-1481-4954-b712-8ec154fa96db None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:45.379707 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaa5bf-1481-4954-b712-8ec154fa96db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:45.397413 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-23eaa5bf-1481-4954-b712-8ec154fa96db None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:10:45.398630 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-23eaa5bf-1481-4954-b712-8ec154fa96db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:45.463952 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1246/2474] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:10:45.474987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d35e0-20c2-445a-ad40-bf0f13c5708f admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:45.532681 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d35e0-20c2-445a-ad40-bf0f13c5708f admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:45.536568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39fa2d-0cfc-45ad-946c-a7eaa5577404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:45.537265 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39fa2d-0cfc-45ad-946c-a7eaa5577404 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:45.537548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39fa2d-0cfc-45ad-946c-a7eaa5577404 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:45.537826 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39fa2d-0cfc-45ad-946c-a7eaa5577404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:45.547843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39fa2d-0cfc-45ad-946c-a7eaa5577404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:45.549744 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39fa2d-0cfc-45ad-946c-a7eaa5577404 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:45.559474 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1229/2475] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:10:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:10:45.591857 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eaa5bf-1481-4954-b712-8ec154fa96db None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:45.593468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-23eaa5bf-1481-4954-b712-8ec154fa96db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:45.614668 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eaa5bf-1481-4954-b712-8ec154fa96db None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:45.627053 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cac7b5-4aa4-4c27-a5a1-1c3c2c18614b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:45.628411 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cac7b5-4aa4-4c27-a5a1-1c3c2c18614b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:45.628687 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cac7b5-4aa4-4c27-a5a1-1c3c2c18614b admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:45.628958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cac7b5-4aa4-4c27-a5a1-1c3c2c18614b admin admin] PATH_INFO: `/v3/projects/665440ed828d45e1a10811c3b9076809` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:45.630194 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cac7b5-4aa4-4c27-a5a1-1c3c2c18614b admin admin] RBAC: Authorizing `identity:delete_project(project_id=665440ed828d45e1a10811c3b9076809)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:45.632174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cac7b5-4aa4-4c27-a5a1-1c3c2c18614b admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:45.682513 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-91cac7b5-4aa4-4c27-a5a1-1c3c2c18614b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '665440ed828d45e1a10811c3b9076809', 'request_id': 'req-91cac7b5-4aa4-4c27-a5a1-1c3c2c18614b'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:45.689796 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-91cac7b5-4aa4-4c27-a5a1-1c3c2c18614b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '665440ed828d45e1a10811c3b9076809', 'request_id': 'req-91cac7b5-4aa4-4c27-a5a1-1c3c2c18614b'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:45.698730 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-91cac7b5-4aa4-4c27-a5a1-1c3c2c18614b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '665440ed828d45e1a10811c3b9076809', 'request_id': 'req-91cac7b5-4aa4-4c27-a5a1-1c3c2c18614b'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:45.710869 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-91cac7b5-4aa4-4c27-a5a1-1c3c2c18614b admin admin] The token cache is being invalidate because project 665440ed828d45e1a10811c3b9076809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:10:45.711186 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-91cac7b5-4aa4-4c27-a5a1-1c3c2c18614b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:45.711951 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-91cac7b5-4aa4-4c27-a5a1-1c3c2c18614b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:45.713810 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1247/2476] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:10:45 2022] DELETE /identity/v3/projects/665440ed828d45e1a10811c3b9076809 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:10:45.717790 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39fa2d-0cfc-45ad-946c-a7eaa5577404 service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:45.728327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39fa2d-0cfc-45ad-946c-a7eaa5577404 service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:45.803043 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebb8b4-890d-4c77-be43-45918b31b7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:45.804041 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebb8b4-890d-4c77-be43-45918b31b7a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:45.804376 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebb8b4-890d-4c77-be43-45918b31b7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:45.804681 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebb8b4-890d-4c77-be43-45918b31b7a2 admin admin] PATH_INFO: `/v3/users/4897ad98906549ec9f91f930891d6f7e` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:45.806283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebb8b4-890d-4c77-be43-45918b31b7a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4897ad98906549ec9f91f930891d6f7e)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:45.808458 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebb8b4-890d-4c77-be43-45918b31b7a2 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:45.859734 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-76ebb8b4-890d-4c77-be43-45918b31b7a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4897ad98906549ec9f91f930891d6f7e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:45.873146 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-76ebb8b4-890d-4c77-be43-45918b31b7a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4897ad98906549ec9f91f930891d6f7e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:45.877617 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:10:45.880507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-76ebb8b4-890d-4c77-be43-45918b31b7a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4897ad98906549ec9f91f930891d6f7e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:45.881356 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-76ebb8b4-890d-4c77-be43-45918b31b7a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4897ad98906549ec9f91f930891d6f7e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:45.891585 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-76ebb8b4-890d-4c77-be43-45918b31b7a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4897ad98906549ec9f91f930891d6f7e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:45.898624 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1230/2477] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:10:45 2022] DELETE /identity/v3/users/4897ad98906549ec9f91f930891d6f7e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:10:46.300187 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cac7b5-4aa4-4c27-a5a1-1c3c2c18614b admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:46.301824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-91cac7b5-4aa4-4c27-a5a1-1c3c2c18614b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:46.316195 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cac7b5-4aa4-4c27-a5a1-1c3c2c18614b admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:46.383974 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0dee8c-755e-4b81-b5aa-04e00cffe06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:46.384886 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dee8c-755e-4b81-b5aa-04e00cffe06b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:46.385270 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dee8c-755e-4b81-b5aa-04e00cffe06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:46.385665 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dee8c-755e-4b81-b5aa-04e00cffe06b admin admin] PATH_INFO: `/v3/projects/4a848bffb6ea4ed9a41bda00f90ad2f6` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:46.386980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dee8c-755e-4b81-b5aa-04e00cffe06b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a848bffb6ea4ed9a41bda00f90ad2f6)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:46.388967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dee8c-755e-4b81-b5aa-04e00cffe06b admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:46.412969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:10:46.454809 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-6c0dee8c-755e-4b81-b5aa-04e00cffe06b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a848bffb6ea4ed9a41bda00f90ad2f6', 'request_id': 'req-6c0dee8c-755e-4b81-b5aa-04e00cffe06b'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:46.462341 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-6c0dee8c-755e-4b81-b5aa-04e00cffe06b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a848bffb6ea4ed9a41bda00f90ad2f6', 'request_id': 'req-6c0dee8c-755e-4b81-b5aa-04e00cffe06b'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:46.472523 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-6c0dee8c-755e-4b81-b5aa-04e00cffe06b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a848bffb6ea4ed9a41bda00f90ad2f6', 'request_id': 'req-6c0dee8c-755e-4b81-b5aa-04e00cffe06b'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:46.487642 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-6c0dee8c-755e-4b81-b5aa-04e00cffe06b admin admin] The token cache is being invalidate because project 4a848bffb6ea4ed9a41bda00f90ad2f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:10:46.488019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-6c0dee8c-755e-4b81-b5aa-04e00cffe06b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:46.488864 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-6c0dee8c-755e-4b81-b5aa-04e00cffe06b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:10:46.490657 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1248/2478] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:10:46 2022] DELETE /identity/v3/projects/4a848bffb6ea4ed9a41bda00f90ad2f6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:10:46.495439 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff1ba0-e011-45a5-9430-96cb93a531d1 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:46.495821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff1ba0-e011-45a5-9430-96cb93a531d1 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:46.496170 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff1ba0-e011-45a5-9430-96cb93a531d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:46.517208 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-35ff1ba0-e011-45a5-9430-96cb93a531d1 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:10:46.518497 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-35ff1ba0-e011-45a5-9430-96cb93a531d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:46.603461 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1231/2479] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:10:46.608349 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3e2b6-b448-4741-aa5b-87e01ad60fef None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:46.608702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3e2b6-b448-4741-aa5b-87e01ad60fef None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:46.609082 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3e2b6-b448-4741-aa5b-87e01ad60fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:46.631051 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-61b3e2b6-b448-4741-aa5b-87e01ad60fef None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:10:46.633270 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-61b3e2b6-b448-4741-aa5b-87e01ad60fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:46.641787 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1249/2480] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:10:46.646668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff1ba0-e011-45a5-9430-96cb93a531d1 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:46.656857 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff1ba0-e011-45a5-9430-96cb93a531d1 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:46.662121 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc01020-b039-4f4f-a471-219cea18ad09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:46.662922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc01020-b039-4f4f-a471-219cea18ad09 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:46.663306 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc01020-b039-4f4f-a471-219cea18ad09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:46.663705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc01020-b039-4f4f-a471-219cea18ad09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:46.664576 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc01020-b039-4f4f-a471-219cea18ad09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:10:46.665020 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc01020-b039-4f4f-a471-219cea18ad09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:46.666776 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc01020-b039-4f4f-a471-219cea18ad09 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:46.680475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1232/2481] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:10:46.685953 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3e2b6-b448-4741-aa5b-87e01ad60fef None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:46.696595 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3e2b6-b448-4741-aa5b-87e01ad60fef None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:46.702651 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017f0e8-8d45-4d6f-9bb3-43e3f4d24050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:46.703378 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017f0e8-8d45-4d6f-9bb3-43e3f4d24050 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:46.703689 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017f0e8-8d45-4d6f-9bb3-43e3f4d24050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:46.703965 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017f0e8-8d45-4d6f-9bb3-43e3f4d24050 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:46.704677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017f0e8-8d45-4d6f-9bb3-43e3f4d24050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:46.707076 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017f0e8-8d45-4d6f-9bb3-43e3f4d24050 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:46.742987 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1250/2482] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:10:46 2022] POST /identity/v3/projects => generated 357 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:10:46.744840 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc01020-b039-4f4f-a471-219cea18ad09 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:46.756920 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc01020-b039-4f4f-a471-219cea18ad09 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:46.833806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9386c-fffe-4a94-846e-173486c819fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:46.834557 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9386c-fffe-4a94-846e-173486c819fe admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:46.834931 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9386c-fffe-4a94-846e-173486c819fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:46.835618 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9386c-fffe-4a94-846e-173486c819fe admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:46.836636 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9386c-fffe-4a94-846e-173486c819fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:46.838669 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9386c-fffe-4a94-846e-173486c819fe admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:46.867818 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1233/2483] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:10:46 2022] POST /identity/v3/users => generated 279 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:10:46.869115 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017f0e8-8d45-4d6f-9bb3-43e3f4d24050 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:46.883392 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017f0e8-8d45-4d6f-9bb3-43e3f4d24050 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:46.889989 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826cd0e-fbb0-4125-af32-57019327078d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:46.890764 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826cd0e-fbb0-4125-af32-57019327078d admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:46.891127 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826cd0e-fbb0-4125-af32-57019327078d admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:46.893828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826cd0e-fbb0-4125-af32-57019327078d admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:46.893828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826cd0e-fbb0-4125-af32-57019327078d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:46.894078 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826cd0e-fbb0-4125-af32-57019327078d admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:46.907453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1251/2484] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:10:46.911702 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9386c-fffe-4a94-846e-173486c819fe admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:46.923516 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9386c-fffe-4a94-846e-173486c819fe admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:46.933346 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd59c05-9a67-44df-8a87-7bcab7482ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:46.934248 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd59c05-9a67-44df-8a87-7bcab7482ded admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:46.934615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd59c05-9a67-44df-8a87-7bcab7482ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:46.935015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd59c05-9a67-44df-8a87-7bcab7482ded admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:46.936032 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd59c05-9a67-44df-8a87-7bcab7482ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:46.937766 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd59c05-9a67-44df-8a87-7bcab7482ded admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:46.951459 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1234/2485] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:10:46.960282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826cd0e-fbb0-4125-af32-57019327078d admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:46.971921 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826cd0e-fbb0-4125-af32-57019327078d admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:46.977368 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa2280-2c78-46b2-b890-d486b8a50569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:46.978322 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa2280-2c78-46b2-b890-d486b8a50569 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:46.978607 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa2280-2c78-46b2-b890-d486b8a50569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:46.978885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa2280-2c78-46b2-b890-d486b8a50569 admin admin] PATH_INFO: `/v3/projects/1dada217572d488794a0b19c2fdb7405/users/d361340e47084f81b0d7087d03787306/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:47.003052 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa2280-2c78-46b2-b890-d486b8a50569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dada217572d488794a0b19c2fdb7405, user_id=d361340e47084f81b0d7087d03787306, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:47.006825 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa2280-2c78-46b2-b890-d486b8a50569 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:47.026375 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1252/2486] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:10:46 2022] PUT /identity/v3/projects/1dada217572d488794a0b19c2fdb7405/users/d361340e47084f81b0d7087d03787306/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:10:47.036889 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d226e1-cb94-4409-9710-755b971535df None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:47.037490 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d226e1-cb94-4409-9710-755b971535df None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:47.037945 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d226e1-cb94-4409-9710-755b971535df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:47.068380 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-34d226e1-cb94-4409-9710-755b971535df None None] MFA Rules not processed for user `d361340e47084f81b0d7087d03787306`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:10:47.069727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-34d226e1-cb94-4409-9710-755b971535df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:47.123172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:10:47.156059 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1235/2487] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:10:47 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:10:47.160810 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa2280-2c78-46b2-b890-d486b8a50569 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:47.256311 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa2280-2c78-46b2-b890-d486b8a50569 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:47.261155 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797363a1-293a-4a28-861b-78dcb5ac5e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:47.261849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797363a1-293a-4a28-861b-78dcb5ac5e6d admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:47.262134 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797363a1-293a-4a28-861b-78dcb5ac5e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:47.262407 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797363a1-293a-4a28-861b-78dcb5ac5e6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:47.263115 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797363a1-293a-4a28-861b-78dcb5ac5e6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:47.265114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797363a1-293a-4a28-861b-78dcb5ac5e6d admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:47.296782 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1253/2488] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:10:47 2022] POST /identity/v3/projects => generated 355 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:10:47.301367 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d226e1-cb94-4409-9710-755b971535df None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:47.313496 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d226e1-cb94-4409-9710-755b971535df None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:47.379610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb14ab-54a2-43e3-bd90-022a8ee00998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:47.380458 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb14ab-54a2-43e3-bd90-022a8ee00998 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:47.380839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb14ab-54a2-43e3-bd90-022a8ee00998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:47.381181 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb14ab-54a2-43e3-bd90-022a8ee00998 admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:47.382062 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb14ab-54a2-43e3-bd90-022a8ee00998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:47.384410 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb14ab-54a2-43e3-bd90-022a8ee00998 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:47.416651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1236/2489] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:10:47 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:10:47.421862 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797363a1-293a-4a28-861b-78dcb5ac5e6d admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:47.437962 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797363a1-293a-4a28-861b-78dcb5ac5e6d admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:47.442796 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58f424-4d15-4057-8a8c-ed4982963675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:47.443514 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58f424-4d15-4057-8a8c-ed4982963675 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:47.443798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58f424-4d15-4057-8a8c-ed4982963675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:47.444070 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58f424-4d15-4057-8a8c-ed4982963675 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:47.444833 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58f424-4d15-4057-8a8c-ed4982963675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:47.446670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58f424-4d15-4057-8a8c-ed4982963675 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:47.465158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1254/2490] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:10:47.466628 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb14ab-54a2-43e3-bd90-022a8ee00998 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:47.479356 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb14ab-54a2-43e3-bd90-022a8ee00998 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:47.490613 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859614bd-176c-42b9-a3a9-80fd7c96c001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:47.491689 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859614bd-176c-42b9-a3a9-80fd7c96c001 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:47.492036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859614bd-176c-42b9-a3a9-80fd7c96c001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:47.492377 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859614bd-176c-42b9-a3a9-80fd7c96c001 admin admin] PATH_INFO: `/v3/projects/cd8bf542bdf2409da3d76424d237d6bb/users/5fefa3ffc2de4d189a24250e81818382/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:47.508444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859614bd-176c-42b9-a3a9-80fd7c96c001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8bf542bdf2409da3d76424d237d6bb, user_id=5fefa3ffc2de4d189a24250e81818382, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:47.514445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859614bd-176c-42b9-a3a9-80fd7c96c001 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:47.530995 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1237/2491] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:10:47 2022] PUT /identity/v3/projects/cd8bf542bdf2409da3d76424d237d6bb/users/5fefa3ffc2de4d189a24250e81818382/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:10:47.538257 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58f424-4d15-4057-8a8c-ed4982963675 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:47.559778 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58f424-4d15-4057-8a8c-ed4982963675 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:47.579113 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:10:47.622924 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ab23a-407b-497f-aa92-90ad23e2f9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:47.623684 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ab23a-407b-497f-aa92-90ad23e2f9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:47.623912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ab23a-407b-497f-aa92-90ad23e2f9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:47.624184 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ab23a-407b-497f-aa92-90ad23e2f9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:47.624916 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ab23a-407b-497f-aa92-90ad23e2f9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:47.626540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ab23a-407b-497f-aa92-90ad23e2f9e1 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:47.637950 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1255/2492] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:10:47.641856 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859614bd-176c-42b9-a3a9-80fd7c96c001 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:47.652505 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859614bd-176c-42b9-a3a9-80fd7c96c001 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:47.657896 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad120d-d48f-403b-a857-233226660481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:47.659134 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad120d-d48f-403b-a857-233226660481 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:47.659543 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad120d-d48f-403b-a857-233226660481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:47.659913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad120d-d48f-403b-a857-233226660481 admin admin] PATH_INFO: `/v3/projects/cd8bf542bdf2409da3d76424d237d6bb/users/5fefa3ffc2de4d189a24250e81818382/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:47.662084 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad120d-d48f-403b-a857-233226660481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8bf542bdf2409da3d76424d237d6bb, user_id=5fefa3ffc2de4d189a24250e81818382, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:47.664962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad120d-d48f-403b-a857-233226660481 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:47.676230 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1238/2493] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:10:47 2022] PUT /identity/v3/projects/cd8bf542bdf2409da3d76424d237d6bb/users/5fefa3ffc2de4d189a24250e81818382/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:10:47.687849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77596bbe-e9f6-43b6-b3ee-1608e0b8c8d2 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:47.688133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77596bbe-e9f6-43b6-b3ee-1608e0b8c8d2 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:47.688404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77596bbe-e9f6-43b6-b3ee-1608e0b8c8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:47.718445 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-77596bbe-e9f6-43b6-b3ee-1608e0b8c8d2 None None] MFA Rules not processed for user `5fefa3ffc2de4d189a24250e81818382`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:10:47.719692 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-77596bbe-e9f6-43b6-b3ee-1608e0b8c8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:47.791875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1256/2494] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:10:47 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:10:47.804552 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad120d-d48f-403b-a857-233226660481 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:47.806397 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a2ad120d-d48f-403b-a857-233226660481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:47.869922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad120d-d48f-403b-a857-233226660481 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:47.874402 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e0fee-0a16-41e6-a3ec-88fddcd267a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:47.875011 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e0fee-0a16-41e6-a3ec-88fddcd267a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:47.875290 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e0fee-0a16-41e6-a3ec-88fddcd267a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:47.875619 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e0fee-0a16-41e6-a3ec-88fddcd267a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:47.886746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e0fee-0a16-41e6-a3ec-88fddcd267a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:47.888786 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e0fee-0a16-41e6-a3ec-88fddcd267a9 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:47.901588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1239/2495] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:10:47 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:10:47.998323 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77596bbe-e9f6-43b6-b3ee-1608e0b8c8d2 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:48.013410 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77596bbe-e9f6-43b6-b3ee-1608e0b8c8d2 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:48.021112 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdcd10-c0ca-45bd-9aed-1352a88f42d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:48.022169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdcd10-c0ca-45bd-9aed-1352a88f42d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:48.022573 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdcd10-c0ca-45bd-9aed-1352a88f42d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:48.022957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdcd10-c0ca-45bd-9aed-1352a88f42d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:48.133205 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdcd10-c0ca-45bd-9aed-1352a88f42d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:48.136401 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdcd10-c0ca-45bd-9aed-1352a88f42d4 service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:48.159824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1257/2496] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:10:47 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:10:50.132968 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf2ddf-1a27-4c2c-a520-2c2fd7334bb6 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:50.133511 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf2ddf-1a27-4c2c-a520-2c2fd7334bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:50.133622 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf2ddf-1a27-4c2c-a520-2c2fd7334bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:50.177039 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-70bf2ddf-1a27-4c2c-a520-2c2fd7334bb6 None None] MFA Rules not processed for user `8d78b45727a94620b8ecab2dbb77db50`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:10:50.178325 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-70bf2ddf-1a27-4c2c-a520-2c2fd7334bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:50.211604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:10:50.254286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1240/2497] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:10:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:10:50.259196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdcd10-c0ca-45bd-9aed-1352a88f42d4 service cinder] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:50.261232 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-45fdcd10-c0ca-45bd-9aed-1352a88f42d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:50.320685 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:10:50.350620 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdcd10-c0ca-45bd-9aed-1352a88f42d4 service cinder] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:50.355438 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af4980-72d9-445f-98ce-2629fc54965a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:50.356165 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af4980-72d9-445f-98ce-2629fc54965a admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:50.356437 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af4980-72d9-445f-98ce-2629fc54965a admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:50.356705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af4980-72d9-445f-98ce-2629fc54965a admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:50.357412 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af4980-72d9-445f-98ce-2629fc54965a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:50.359946 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af4980-72d9-445f-98ce-2629fc54965a admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:50.392055 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1258/2498] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:10:50 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:10:50.397036 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf2ddf-1a27-4c2c-a520-2c2fd7334bb6 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:50.410015 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf2ddf-1a27-4c2c-a520-2c2fd7334bb6 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:50.493591 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71273a-6f69-453f-8752-5e51dac51d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:50.494305 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71273a-6f69-453f-8752-5e51dac51d83 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:50.494592 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71273a-6f69-453f-8752-5e51dac51d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:50.494889 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71273a-6f69-453f-8752-5e51dac51d83 admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:50.495621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e71273a-6f69-453f-8752-5e51dac51d83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:50.497663 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e71273a-6f69-453f-8752-5e51dac51d83 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:50.523343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1241/2499] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:10:50 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:10:50.527781 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af4980-72d9-445f-98ce-2629fc54965a admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:50.540284 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af4980-72d9-445f-98ce-2629fc54965a admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:50.546339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49beea9d-29f0-4991-bec1-6e09ed7b25a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:50.547151 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49beea9d-29f0-4991-bec1-6e09ed7b25a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:50.547458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49beea9d-29f0-4991-bec1-6e09ed7b25a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:50.547750 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49beea9d-29f0-4991-bec1-6e09ed7b25a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:50.548518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49beea9d-29f0-4991-bec1-6e09ed7b25a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:50.550318 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49beea9d-29f0-4991-bec1-6e09ed7b25a6 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:50.563438 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1259/2500] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:10:50.568083 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71273a-6f69-453f-8752-5e51dac51d83 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:50.579330 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71273a-6f69-453f-8752-5e51dac51d83 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:50.585047 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac81565-27ef-41cf-9fe9-72ea894bb259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:50.585984 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac81565-27ef-41cf-9fe9-72ea894bb259 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:50.586393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac81565-27ef-41cf-9fe9-72ea894bb259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:50.586539 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac81565-27ef-41cf-9fe9-72ea894bb259 admin admin] PATH_INFO: `/v3/projects/e98a67ee0a7244308d6ee899ee2f313f/users/f35c2e5b1a36494bba53f77518a9ea94/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:50.606743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac81565-27ef-41cf-9fe9-72ea894bb259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e98a67ee0a7244308d6ee899ee2f313f, user_id=f35c2e5b1a36494bba53f77518a9ea94, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:50.609682 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac81565-27ef-41cf-9fe9-72ea894bb259 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:50.640818 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1242/2501] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:10:50 2022] PUT /identity/v3/projects/e98a67ee0a7244308d6ee899ee2f313f/users/f35c2e5b1a36494bba53f77518a9ea94/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:10:50.644943 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49beea9d-29f0-4991-bec1-6e09ed7b25a6 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:50.659669 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49beea9d-29f0-4991-bec1-6e09ed7b25a6 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:50.778985 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1e71a-8aa3-4893-b05a-b77e847643a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:50.780253 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1e71a-8aa3-4893-b05a-b77e847643a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:50.780542 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1e71a-8aa3-4893-b05a-b77e847643a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:50.781192 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1e71a-8aa3-4893-b05a-b77e847643a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:50.781871 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1e71a-8aa3-4893-b05a-b77e847643a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:50.784583 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1e71a-8aa3-4893-b05a-b77e847643a3 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:50.811574 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1260/2502] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:10:50.817921 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac81565-27ef-41cf-9fe9-72ea894bb259 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:50.831806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac81565-27ef-41cf-9fe9-72ea894bb259 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:50.837867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39186015-77d1-4553-952f-79de4b0c31b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:50.838555 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39186015-77d1-4553-952f-79de4b0c31b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:50.838834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39186015-77d1-4553-952f-79de4b0c31b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:50.839100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39186015-77d1-4553-952f-79de4b0c31b9 admin admin] PATH_INFO: `/v3/projects/e98a67ee0a7244308d6ee899ee2f313f/users/f35c2e5b1a36494bba53f77518a9ea94/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:50.841279 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39186015-77d1-4553-952f-79de4b0c31b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e98a67ee0a7244308d6ee899ee2f313f, user_id=f35c2e5b1a36494bba53f77518a9ea94, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:50.848969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39186015-77d1-4553-952f-79de4b0c31b9 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:50.879625 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1243/2503] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:10:50 2022] PUT /identity/v3/projects/e98a67ee0a7244308d6ee899ee2f313f/users/f35c2e5b1a36494bba53f77518a9ea94/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:10:55.560651 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a59f41-3915-4359-8770-5e2403006370 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:55.561146 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a59f41-3915-4359-8770-5e2403006370 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:55.561282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a59f41-3915-4359-8770-5e2403006370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:55.602401 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-37a59f41-3915-4359-8770-5e2403006370 None None] MFA Rules not processed for user `f35c2e5b1a36494bba53f77518a9ea94`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:10:55.603883 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-37a59f41-3915-4359-8770-5e2403006370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:55.711572 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1261/2504] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:10:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:10:55.728554 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39186015-77d1-4553-952f-79de4b0c31b9 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:10:55.732533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-39186015-77d1-4553-952f-79de4b0c31b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:55.829171 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39186015-77d1-4553-952f-79de4b0c31b9 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:10:55.836221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1733f-6d19-480d-92be-8ed9de5f00c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:10:55.836916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1733f-6d19-480d-92be-8ed9de5f00c2 service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:55.837206 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1733f-6d19-480d-92be-8ed9de5f00c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:55.837494 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1733f-6d19-480d-92be-8ed9de5f00c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:55.857143 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:10:55.910434 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1733f-6d19-480d-92be-8ed9de5f00c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:10:55.912229 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1733f-6d19-480d-92be-8ed9de5f00c2 service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:10:55.923613 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1244/2505] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:10:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:10:57.027741 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7519a-fc20-440e-ac76-34bf7b551870 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:10:57.028269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7519a-fc20-440e-ac76-34bf7b551870 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:10:57.028460 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7519a-fc20-440e-ac76-34bf7b551870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:10:57.050445 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-dba7519a-fc20-440e-ac76-34bf7b551870 None None] MFA Rules not processed for user `8d78b45727a94620b8ecab2dbb77db50`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:10:57.051830 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-dba7519a-fc20-440e-ac76-34bf7b551870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:10:57.060609 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1262/2506] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:10:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:04.120093 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1733f-6d19-480d-92be-8ed9de5f00c2 service nova] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:04.191502 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1733f-6d19-480d-92be-8ed9de5f00c2 service nova] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:04.196561 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f11a44-e8aa-448f-94ad-6635b578058e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:04.197602 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f11a44-e8aa-448f-94ad-6635b578058e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:04.197884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f11a44-e8aa-448f-94ad-6635b578058e admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:04.198160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f11a44-e8aa-448f-94ad-6635b578058e admin admin] PATH_INFO: `/v3/users/d361340e47084f81b0d7087d03787306` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:04.199367 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f11a44-e8aa-448f-94ad-6635b578058e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d361340e47084f81b0d7087d03787306)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:04.201341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f11a44-e8aa-448f-94ad-6635b578058e admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:04.257707 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d2f11a44-e8aa-448f-94ad-6635b578058e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd361340e47084f81b0d7087d03787306'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:04.272668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d2f11a44-e8aa-448f-94ad-6635b578058e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd361340e47084f81b0d7087d03787306'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:04.280709 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d2f11a44-e8aa-448f-94ad-6635b578058e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd361340e47084f81b0d7087d03787306'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:04.281526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d2f11a44-e8aa-448f-94ad-6635b578058e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd361340e47084f81b0d7087d03787306'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:04.291912 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-d2f11a44-e8aa-448f-94ad-6635b578058e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd361340e47084f81b0d7087d03787306'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:04.304092 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1245/2507] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:11:04 2022] DELETE /identity/v3/users/d361340e47084f81b0d7087d03787306 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:11:04.305810 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526a95a-9f8f-46cf-bbde-f89c3d85c96a None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:04.306280 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526a95a-9f8f-46cf-bbde-f89c3d85c96a None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:04.306545 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526a95a-9f8f-46cf-bbde-f89c3d85c96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:04.326081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-6526a95a-9f8f-46cf-bbde-f89c3d85c96a None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:04.327375 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-6526a95a-9f8f-46cf-bbde-f89c3d85c96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:04.356448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:04.397659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1263/2508] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:04.407841 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f11a44-e8aa-448f-94ad-6635b578058e admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:04.409328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-d2f11a44-e8aa-448f-94ad-6635b578058e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:04.457571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:04.475871 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f11a44-e8aa-448f-94ad-6635b578058e admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:04.480565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7a9d6-00a6-43a3-8224-3d302fa889cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:04.481227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7a9d6-00a6-43a3-8224-3d302fa889cb service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:04.481509 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7a9d6-00a6-43a3-8224-3d302fa889cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:04.481782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7a9d6-00a6-43a3-8224-3d302fa889cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:04.491308 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7a9d6-00a6-43a3-8224-3d302fa889cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:04.493168 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7a9d6-00a6-43a3-8224-3d302fa889cb service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:04.504209 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1246/2509] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:11:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:11:04.864119 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526a95a-9f8f-46cf-bbde-f89c3d85c96a None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:04.865601 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-6526a95a-9f8f-46cf-bbde-f89c3d85c96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:04.887009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526a95a-9f8f-46cf-bbde-f89c3d85c96a None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:04.892226 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e945cd-3832-4a9d-b967-2efccc1c96bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:04.893221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e945cd-3832-4a9d-b967-2efccc1c96bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:04.893500 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e945cd-3832-4a9d-b967-2efccc1c96bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:04.893785 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e945cd-3832-4a9d-b967-2efccc1c96bb admin admin] PATH_INFO: `/v3/projects/1dada217572d488794a0b19c2fdb7405` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:04.894964 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e945cd-3832-4a9d-b967-2efccc1c96bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dada217572d488794a0b19c2fdb7405)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:04.896997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e945cd-3832-4a9d-b967-2efccc1c96bb admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:04.949168 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f0e945cd-3832-4a9d-b967-2efccc1c96bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dada217572d488794a0b19c2fdb7405', 'request_id': 'req-f0e945cd-3832-4a9d-b967-2efccc1c96bb'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:04.955944 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f0e945cd-3832-4a9d-b967-2efccc1c96bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dada217572d488794a0b19c2fdb7405', 'request_id': 'req-f0e945cd-3832-4a9d-b967-2efccc1c96bb'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:04.966327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f0e945cd-3832-4a9d-b967-2efccc1c96bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dada217572d488794a0b19c2fdb7405', 'request_id': 'req-f0e945cd-3832-4a9d-b967-2efccc1c96bb'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:04.977561 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f0e945cd-3832-4a9d-b967-2efccc1c96bb admin admin] The token cache is being invalidate because project 1dada217572d488794a0b19c2fdb7405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:11:04.977919 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f0e945cd-3832-4a9d-b967-2efccc1c96bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:04.978654 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-f0e945cd-3832-4a9d-b967-2efccc1c96bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:04.980297 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1264/2510] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:11:04 2022] DELETE /identity/v3/projects/1dada217572d488794a0b19c2fdb7405 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:11:04.984673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7a9d6-00a6-43a3-8224-3d302fa889cb service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:04.996441 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7a9d6-00a6-43a3-8224-3d302fa889cb service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:05.067610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52d20c-ba6b-4fb4-98fd-4bde9769de82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:05.068404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52d20c-ba6b-4fb4-98fd-4bde9769de82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:05.068703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52d20c-ba6b-4fb4-98fd-4bde9769de82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:05.068974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52d20c-ba6b-4fb4-98fd-4bde9769de82 admin admin] PATH_INFO: `/v3/users/5fefa3ffc2de4d189a24250e81818382` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:05.070212 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52d20c-ba6b-4fb4-98fd-4bde9769de82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fefa3ffc2de4d189a24250e81818382)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:05.072263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52d20c-ba6b-4fb4-98fd-4bde9769de82 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:05.130040 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3c52d20c-ba6b-4fb4-98fd-4bde9769de82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fefa3ffc2de4d189a24250e81818382'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:05.142749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3c52d20c-ba6b-4fb4-98fd-4bde9769de82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fefa3ffc2de4d189a24250e81818382'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:05.149539 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3c52d20c-ba6b-4fb4-98fd-4bde9769de82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fefa3ffc2de4d189a24250e81818382'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:05.150313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3c52d20c-ba6b-4fb4-98fd-4bde9769de82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fefa3ffc2de4d189a24250e81818382'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:05.160649 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3c52d20c-ba6b-4fb4-98fd-4bde9769de82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fefa3ffc2de4d189a24250e81818382'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:05.167382 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1247/2511] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:11:04 2022] DELETE /identity/v3/users/5fefa3ffc2de4d189a24250e81818382 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:11:05.465175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e945cd-3832-4a9d-b967-2efccc1c96bb admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:05.466731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-f0e945cd-3832-4a9d-b967-2efccc1c96bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:05.484121 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e945cd-3832-4a9d-b967-2efccc1c96bb admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:05.544316 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf58b3-4dbb-4718-bfdc-0d9c306be3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:05.545200 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf58b3-4dbb-4718-bfdc-0d9c306be3d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:05.545478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf58b3-4dbb-4718-bfdc-0d9c306be3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:05.545747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf58b3-4dbb-4718-bfdc-0d9c306be3d5 admin admin] PATH_INFO: `/v3/projects/cd8bf542bdf2409da3d76424d237d6bb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:05.546957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf58b3-4dbb-4718-bfdc-0d9c306be3d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd8bf542bdf2409da3d76424d237d6bb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:05.548941 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf58b3-4dbb-4718-bfdc-0d9c306be3d5 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:05.598328 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-b3bf58b3-4dbb-4718-bfdc-0d9c306be3d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd8bf542bdf2409da3d76424d237d6bb', 'request_id': 'req-b3bf58b3-4dbb-4718-bfdc-0d9c306be3d5'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:05.605159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-b3bf58b3-4dbb-4718-bfdc-0d9c306be3d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd8bf542bdf2409da3d76424d237d6bb', 'request_id': 'req-b3bf58b3-4dbb-4718-bfdc-0d9c306be3d5'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:05.606921 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:05.616474 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-b3bf58b3-4dbb-4718-bfdc-0d9c306be3d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd8bf542bdf2409da3d76424d237d6bb', 'request_id': 'req-b3bf58b3-4dbb-4718-bfdc-0d9c306be3d5'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:05.628093 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-b3bf58b3-4dbb-4718-bfdc-0d9c306be3d5 admin admin] The token cache is being invalidate because project cd8bf542bdf2409da3d76424d237d6bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:11:05.628405 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-b3bf58b3-4dbb-4718-bfdc-0d9c306be3d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:05.629032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-b3bf58b3-4dbb-4718-bfdc-0d9c306be3d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:05.630744 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1265/2512] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:11:05 2022] DELETE /identity/v3/projects/cd8bf542bdf2409da3d76424d237d6bb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:11:05.637519 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e1414-bfbf-44c0-8897-b3a42b9882fd None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:05.637836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e1414-bfbf-44c0-8897-b3a42b9882fd None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:05.638115 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e1414-bfbf-44c0-8897-b3a42b9882fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:05.657996 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-123e1414-bfbf-44c0-8897-b3a42b9882fd None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:05.659229 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-123e1414-bfbf-44c0-8897-b3a42b9882fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:05.715936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:05.728170 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1248/2513] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:05.736591 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91c9b2-82cd-4af6-982c-946b0f21dff1 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:05.736897 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91c9b2-82cd-4af6-982c-946b0f21dff1 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:05.737171 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91c9b2-82cd-4af6-982c-946b0f21dff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:05.758508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-5f91c9b2-82cd-4af6-982c-946b0f21dff1 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:05.760248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5f91c9b2-82cd-4af6-982c-946b0f21dff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:05.769416 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1266/2514] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:05.774074 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e1414-bfbf-44c0-8897-b3a42b9882fd None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:05.784702 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e1414-bfbf-44c0-8897-b3a42b9882fd None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:05.789599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b734ef1-c60e-4b26-a5d7-bed572f80890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:05.790546 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b734ef1-c60e-4b26-a5d7-bed572f80890 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:05.790693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b734ef1-c60e-4b26-a5d7-bed572f80890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:05.790906 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b734ef1-c60e-4b26-a5d7-bed572f80890 admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:05.791781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b734ef1-c60e-4b26-a5d7-bed572f80890 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:11:05.792088 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b734ef1-c60e-4b26-a5d7-bed572f80890 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:05.794186 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b734ef1-c60e-4b26-a5d7-bed572f80890 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:05.807004 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1249/2515] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:11:05.816157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91c9b2-82cd-4af6-982c-946b0f21dff1 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:05.827450 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91c9b2-82cd-4af6-982c-946b0f21dff1 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:05.833811 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692a64d-120f-451d-8d95-16a4e5fad8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:05.834467 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692a64d-120f-451d-8d95-16a4e5fad8db admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:05.834838 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692a64d-120f-451d-8d95-16a4e5fad8db admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:05.835160 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692a64d-120f-451d-8d95-16a4e5fad8db admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:05.836286 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692a64d-120f-451d-8d95-16a4e5fad8db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:05.838882 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692a64d-120f-451d-8d95-16a4e5fad8db admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:05.873666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1267/2516] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:11:05 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:11:05.875530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b734ef1-c60e-4b26-a5d7-bed572f80890 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:05.888758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b734ef1-c60e-4b26-a5d7-bed572f80890 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:05.954014 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54331b-880c-45d8-a1a8-9b32e04805d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:05.954742 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54331b-880c-45d8-a1a8-9b32e04805d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:05.955028 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54331b-880c-45d8-a1a8-9b32e04805d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:05.955471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54331b-880c-45d8-a1a8-9b32e04805d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:05.956184 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54331b-880c-45d8-a1a8-9b32e04805d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:05.958275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54331b-880c-45d8-a1a8-9b32e04805d9 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:05.983987 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1250/2517] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:11:05 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:11:05.985345 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692a64d-120f-451d-8d95-16a4e5fad8db admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:05.998936 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692a64d-120f-451d-8d95-16a4e5fad8db admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:06.003681 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191fe1d-5594-4216-85bd-71e2b102ea26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:06.004364 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191fe1d-5594-4216-85bd-71e2b102ea26 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:06.004647 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191fe1d-5594-4216-85bd-71e2b102ea26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:06.004942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191fe1d-5594-4216-85bd-71e2b102ea26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:06.005656 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191fe1d-5594-4216-85bd-71e2b102ea26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:06.007284 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191fe1d-5594-4216-85bd-71e2b102ea26 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:06.018558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1268/2518] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:11:06.023068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54331b-880c-45d8-a1a8-9b32e04805d9 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:06.034197 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54331b-880c-45d8-a1a8-9b32e04805d9 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:06.039665 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf2ed7-dbb8-4709-a2cb-831d19e0515e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:06.040520 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf2ed7-dbb8-4709-a2cb-831d19e0515e admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:06.040802 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf2ed7-dbb8-4709-a2cb-831d19e0515e admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:06.041078 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf2ed7-dbb8-4709-a2cb-831d19e0515e admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:06.041817 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf2ed7-dbb8-4709-a2cb-831d19e0515e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:06.043428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf2ed7-dbb8-4709-a2cb-831d19e0515e admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:06.054411 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1251/2519] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:11:06.058900 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191fe1d-5594-4216-85bd-71e2b102ea26 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:06.069329 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191fe1d-5594-4216-85bd-71e2b102ea26 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:06.073918 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa67817-7b5a-4636-9ff7-8f2d42ec7989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:06.074817 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa67817-7b5a-4636-9ff7-8f2d42ec7989 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:06.075094 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa67817-7b5a-4636-9ff7-8f2d42ec7989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:06.075382 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa67817-7b5a-4636-9ff7-8f2d42ec7989 admin admin] PATH_INFO: `/v3/projects/d314a733ffdc4ce8b4d0fd0bf8f220c6/users/c8b396c4a51f4cf3a974873641308ac8/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:06.090784 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa67817-7b5a-4636-9ff7-8f2d42ec7989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d314a733ffdc4ce8b4d0fd0bf8f220c6, user_id=c8b396c4a51f4cf3a974873641308ac8, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:06.093604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa67817-7b5a-4636-9ff7-8f2d42ec7989 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:06.109085 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1269/2520] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:11:06 2022] PUT /identity/v3/projects/d314a733ffdc4ce8b4d0fd0bf8f220c6/users/c8b396c4a51f4cf3a974873641308ac8/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:11:06.120042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9ec2c-63a4-4229-be10-2e9306df0b84 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:06.120337 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9ec2c-63a4-4229-be10-2e9306df0b84 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:06.120690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9ec2c-63a4-4229-be10-2e9306df0b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:06.148652 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-71f9ec2c-63a4-4229-be10-2e9306df0b84 None None] MFA Rules not processed for user `c8b396c4a51f4cf3a974873641308ac8`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:06.149934 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-71f9ec2c-63a4-4229-be10-2e9306df0b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:06.225163 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1252/2521] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:11:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:06.232185 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa67817-7b5a-4636-9ff7-8f2d42ec7989 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:06.316629 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa67817-7b5a-4636-9ff7-8f2d42ec7989 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:06.325413 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08563e-50f1-458c-a14f-ed450427a438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:06.326368 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08563e-50f1-458c-a14f-ed450427a438 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:06.326720 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08563e-50f1-458c-a14f-ed450427a438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:06.327043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08563e-50f1-458c-a14f-ed450427a438 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:06.328074 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08563e-50f1-458c-a14f-ed450427a438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:06.331018 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08563e-50f1-458c-a14f-ed450427a438 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:06.361913 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1270/2522] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:11:06 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:11:06.366914 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9ec2c-63a4-4229-be10-2e9306df0b84 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:06.377840 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9ec2c-63a4-4229-be10-2e9306df0b84 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:06.432069 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:06.442124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053884fe-1d23-4daa-b048-36e826ab175b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:06.442894 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053884fe-1d23-4daa-b048-36e826ab175b admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:06.443194 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053884fe-1d23-4daa-b048-36e826ab175b admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:06.443493 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053884fe-1d23-4daa-b048-36e826ab175b admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:06.444255 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053884fe-1d23-4daa-b048-36e826ab175b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:06.446576 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053884fe-1d23-4daa-b048-36e826ab175b admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:06.469013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1253/2523] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:11:06 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:11:06.473239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08563e-50f1-458c-a14f-ed450427a438 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:06.484251 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08563e-50f1-458c-a14f-ed450427a438 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:06.489042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b324bb-b2d1-4085-a859-1396f077b79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:06.489713 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b324bb-b2d1-4085-a859-1396f077b79d admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:06.489994 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b324bb-b2d1-4085-a859-1396f077b79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:06.490270 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b324bb-b2d1-4085-a859-1396f077b79d admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:06.491001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b324bb-b2d1-4085-a859-1396f077b79d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:06.492682 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b324bb-b2d1-4085-a859-1396f077b79d admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:06.504332 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1271/2524] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:11:06.508668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053884fe-1d23-4daa-b048-36e826ab175b admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:06.522429 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053884fe-1d23-4daa-b048-36e826ab175b admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:06.529402 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf9cf4-61c7-4fad-9a2a-bee8ac1960a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:06.530093 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf9cf4-61c7-4fad-9a2a-bee8ac1960a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:06.530380 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf9cf4-61c7-4fad-9a2a-bee8ac1960a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:06.530838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf9cf4-61c7-4fad-9a2a-bee8ac1960a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:06.531631 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf9cf4-61c7-4fad-9a2a-bee8ac1960a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:06.533319 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf9cf4-61c7-4fad-9a2a-bee8ac1960a1 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:06.545271 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1254/2525] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:11:06.549760 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b324bb-b2d1-4085-a859-1396f077b79d admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:06.560752 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b324bb-b2d1-4085-a859-1396f077b79d admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:06.566129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f4a56-38b8-4dde-bfb8-dae4d5bbffea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:06.567019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f4a56-38b8-4dde-bfb8-dae4d5bbffea admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:06.567300 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f4a56-38b8-4dde-bfb8-dae4d5bbffea admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:06.567608 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f4a56-38b8-4dde-bfb8-dae4d5bbffea admin admin] PATH_INFO: `/v3/projects/e02969287c3242efbe0dc9b7fa11db87/users/397677af30d04a6cabee39fac996a04d/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:06.585878 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f4a56-38b8-4dde-bfb8-dae4d5bbffea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e02969287c3242efbe0dc9b7fa11db87, user_id=397677af30d04a6cabee39fac996a04d, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:06.589674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f4a56-38b8-4dde-bfb8-dae4d5bbffea admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:06.607495 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1272/2526] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:11:06 2022] PUT /identity/v3/projects/e02969287c3242efbe0dc9b7fa11db87/users/397677af30d04a6cabee39fac996a04d/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:11:06.619327 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d875f7-774e-49ae-9107-034e72881081 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:06.619649 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d875f7-774e-49ae-9107-034e72881081 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:06.619930 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d875f7-774e-49ae-9107-034e72881081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:06.654240 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-e7d875f7-774e-49ae-9107-034e72881081 None None] MFA Rules not processed for user `397677af30d04a6cabee39fac996a04d`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:06.655564 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-e7d875f7-774e-49ae-9107-034e72881081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:06.725146 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1255/2527] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:11:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:06.730013 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f4a56-38b8-4dde-bfb8-dae4d5bbffea admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:06.766072 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:06.800482 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f4a56-38b8-4dde-bfb8-dae4d5bbffea admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:06.807388 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6ad70-c275-4aa4-aa50-6cb60c1104f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:06.808101 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6ad70-c275-4aa4-aa50-6cb60c1104f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:06.808385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6ad70-c275-4aa4-aa50-6cb60c1104f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:06.808649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6ad70-c275-4aa4-aa50-6cb60c1104f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:06.809382 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6ad70-c275-4aa4-aa50-6cb60c1104f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:06.811357 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6ad70-c275-4aa4-aa50-6cb60c1104f7 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:06.839486 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1273/2528] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:11:06 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:11:06.843339 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d875f7-774e-49ae-9107-034e72881081 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:06.854654 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d875f7-774e-49ae-9107-034e72881081 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:06.917295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01cdb0-7ae6-4b22-ad7a-e9fd4d696e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:06.918000 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01cdb0-7ae6-4b22-ad7a-e9fd4d696e8c admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:06.918286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01cdb0-7ae6-4b22-ad7a-e9fd4d696e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:06.918563 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01cdb0-7ae6-4b22-ad7a-e9fd4d696e8c admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:06.919670 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01cdb0-7ae6-4b22-ad7a-e9fd4d696e8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:06.921645 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01cdb0-7ae6-4b22-ad7a-e9fd4d696e8c admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:06.943270 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1256/2529] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:11:06 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:11:06.949097 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6ad70-c275-4aa4-aa50-6cb60c1104f7 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:06.960364 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6ad70-c275-4aa4-aa50-6cb60c1104f7 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:06.965330 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d25b9-da11-478a-994d-996fd0a87770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:06.966021 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d25b9-da11-478a-994d-996fd0a87770 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:06.966302 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d25b9-da11-478a-994d-996fd0a87770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:06.966576 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d25b9-da11-478a-994d-996fd0a87770 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:06.967322 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d25b9-da11-478a-994d-996fd0a87770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:06.968992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d25b9-da11-478a-994d-996fd0a87770 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:06.981095 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1274/2530] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:11:06.985461 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01cdb0-7ae6-4b22-ad7a-e9fd4d696e8c admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:06.996470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01cdb0-7ae6-4b22-ad7a-e9fd4d696e8c admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:07.001311 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ed162-30fc-47da-92e7-2631a0c2290d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:07.002386 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ed162-30fc-47da-92e7-2631a0c2290d admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:07.002657 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ed162-30fc-47da-92e7-2631a0c2290d admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:07.002938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ed162-30fc-47da-92e7-2631a0c2290d admin admin] PATH_INFO: `/v3/projects/ea494d0c96024c4fafd96f737c124be2/users/8b05876d9d70442ca7d5debdc281da3c/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:07.020042 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ed162-30fc-47da-92e7-2631a0c2290d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea494d0c96024c4fafd96f737c124be2, user_id=8b05876d9d70442ca7d5debdc281da3c, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:07.022767 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ed162-30fc-47da-92e7-2631a0c2290d admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:07.037827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1257/2531] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:11:06 2022] PUT /identity/v3/projects/ea494d0c96024c4fafd96f737c124be2/users/8b05876d9d70442ca7d5debdc281da3c/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:11:07.042235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d25b9-da11-478a-994d-996fd0a87770 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:07.053998 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d25b9-da11-478a-994d-996fd0a87770 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:07.115816 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe94daf-6a97-4b55-ab64-7d80ac71edef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:07.116496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe94daf-6a97-4b55-ab64-7d80ac71edef admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:07.116773 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe94daf-6a97-4b55-ab64-7d80ac71edef admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:07.117043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe94daf-6a97-4b55-ab64-7d80ac71edef admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:07.117800 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe94daf-6a97-4b55-ab64-7d80ac71edef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:07.119514 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe94daf-6a97-4b55-ab64-7d80ac71edef admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:07.130892 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1275/2532] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:11:07.135600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ed162-30fc-47da-92e7-2631a0c2290d admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:07.146248 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ed162-30fc-47da-92e7-2631a0c2290d admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:07.151516 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af9871-8154-4764-b5b7-d81677ec71fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:07.152479 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af9871-8154-4764-b5b7-d81677ec71fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:07.152801 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af9871-8154-4764-b5b7-d81677ec71fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:07.153263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af9871-8154-4764-b5b7-d81677ec71fc admin admin] PATH_INFO: `/v3/projects/ea494d0c96024c4fafd96f737c124be2/users/8b05876d9d70442ca7d5debdc281da3c/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:07.155537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af9871-8154-4764-b5b7-d81677ec71fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea494d0c96024c4fafd96f737c124be2, user_id=8b05876d9d70442ca7d5debdc281da3c, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:07.158341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af9871-8154-4764-b5b7-d81677ec71fc admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:07.170038 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1258/2533] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:11:07 2022] PUT /identity/v3/projects/ea494d0c96024c4fafd96f737c124be2/users/8b05876d9d70442ca7d5debdc281da3c/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:11:07.180132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda7239-2f5d-43ba-ace3-bbfaf65a733b None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:07.180465 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda7239-2f5d-43ba-ace3-bbfaf65a733b None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:07.180818 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda7239-2f5d-43ba-ace3-bbfaf65a733b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:07.216138 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-fbda7239-2f5d-43ba-ace3-bbfaf65a733b None None] MFA Rules not processed for user `8b05876d9d70442ca7d5debdc281da3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:07.217858 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-fbda7239-2f5d-43ba-ace3-bbfaf65a733b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:07.295908 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1276/2534] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:11:07 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:07.308694 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af9871-8154-4764-b5b7-d81677ec71fc admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:07.311446 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-49af9871-8154-4764-b5b7-d81677ec71fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:07.332257 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:07.378633 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af9871-8154-4764-b5b7-d81677ec71fc admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:07.382572 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c7615-d4c6-4c67-94fa-65e9ddd368d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:07.383235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c7615-d4c6-4c67-94fa-65e9ddd368d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:07.383551 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c7615-d4c6-4c67-94fa-65e9ddd368d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:07.383829 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c7615-d4c6-4c67-94fa-65e9ddd368d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:07.393916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c7615-d4c6-4c67-94fa-65e9ddd368d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:07.395364 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c7615-d4c6-4c67-94fa-65e9ddd368d2 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:07.405720 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1259/2535] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:11:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:11:07.449545 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda7239-2f5d-43ba-ace3-bbfaf65a733b None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:07.451034 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-fbda7239-2f5d-43ba-ace3-bbfaf65a733b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:07.463271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda7239-2f5d-43ba-ace3-bbfaf65a733b None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:07.467065 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83e5db-7859-4703-a647-bcc287607067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:07.467778 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83e5db-7859-4703-a647-bcc287607067 service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:07.468059 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83e5db-7859-4703-a647-bcc287607067 service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:07.468335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83e5db-7859-4703-a647-bcc287607067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:07.490823 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:07.537065 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83e5db-7859-4703-a647-bcc287607067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:07.538547 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83e5db-7859-4703-a647-bcc287607067 service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:07.549006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1277/2536] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:11:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:11:10.494087 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c7615-d4c6-4c67-94fa-65e9ddd368d2 service cinder] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:10.562690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c7615-d4c6-4c67-94fa-65e9ddd368d2 service cinder] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:10.567388 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804c2a5-867b-4eb7-80ba-efc383e13611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:10.568298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804c2a5-867b-4eb7-80ba-efc383e13611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:10.568576 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804c2a5-867b-4eb7-80ba-efc383e13611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:10.568847 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804c2a5-867b-4eb7-80ba-efc383e13611 admin admin] PATH_INFO: `/v3/users/c8b396c4a51f4cf3a974873641308ac8` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:10.570033 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804c2a5-867b-4eb7-80ba-efc383e13611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8b396c4a51f4cf3a974873641308ac8)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:10.572004 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804c2a5-867b-4eb7-80ba-efc383e13611 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:10.627653 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-c804c2a5-867b-4eb7-80ba-efc383e13611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8b396c4a51f4cf3a974873641308ac8'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:10.641492 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-c804c2a5-867b-4eb7-80ba-efc383e13611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8b396c4a51f4cf3a974873641308ac8'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:10.648338 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-c804c2a5-867b-4eb7-80ba-efc383e13611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8b396c4a51f4cf3a974873641308ac8'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:10.649037 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-c804c2a5-867b-4eb7-80ba-efc383e13611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8b396c4a51f4cf3a974873641308ac8'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:10.658704 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-c804c2a5-867b-4eb7-80ba-efc383e13611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8b396c4a51f4cf3a974873641308ac8'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:10.664984 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1260/2537] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:11:10 2022] DELETE /identity/v3/users/c8b396c4a51f4cf3a974873641308ac8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:11:10.670137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b152f-f655-4c04-9874-ef34a15cbd27 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:10.670681 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b152f-f655-4c04-9874-ef34a15cbd27 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:10.670681 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b152f-f655-4c04-9874-ef34a15cbd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:10.689250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-5d8b152f-f655-4c04-9874-ef34a15cbd27 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:10.690495 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5d8b152f-f655-4c04-9874-ef34a15cbd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:10.753114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1278/2538] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:10.763469 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804c2a5-867b-4eb7-80ba-efc383e13611 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:10.764894 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-c804c2a5-867b-4eb7-80ba-efc383e13611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:10.816502 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:10.840099 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804c2a5-867b-4eb7-80ba-efc383e13611 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:10.844786 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6738f36-a409-46c2-99f8-a808c4997644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:10.845443 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6738f36-a409-46c2-99f8-a808c4997644 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:10.845752 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6738f36-a409-46c2-99f8-a808c4997644 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:10.846025 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6738f36-a409-46c2-99f8-a808c4997644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:10.855570 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6738f36-a409-46c2-99f8-a808c4997644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:10.857011 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6738f36-a409-46c2-99f8-a808c4997644 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:10.866530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1261/2539] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:11:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:11:11.149674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b152f-f655-4c04-9874-ef34a15cbd27 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:11.151284 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5d8b152f-f655-4c04-9874-ef34a15cbd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:11.163815 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b152f-f655-4c04-9874-ef34a15cbd27 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:11.168564 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b471e76-f14d-44ef-9331-6e7bbbe608a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:11.169796 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b471e76-f14d-44ef-9331-6e7bbbe608a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:11.170096 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b471e76-f14d-44ef-9331-6e7bbbe608a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:11.170365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b471e76-f14d-44ef-9331-6e7bbbe608a6 admin admin] PATH_INFO: `/v3/projects/d314a733ffdc4ce8b4d0fd0bf8f220c6` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:11.171593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b471e76-f14d-44ef-9331-6e7bbbe608a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d314a733ffdc4ce8b4d0fd0bf8f220c6)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:11.173560 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b471e76-f14d-44ef-9331-6e7bbbe608a6 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:11.220441 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-0b471e76-f14d-44ef-9331-6e7bbbe608a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd314a733ffdc4ce8b4d0fd0bf8f220c6', 'request_id': 'req-0b471e76-f14d-44ef-9331-6e7bbbe608a6'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:11.226605 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-0b471e76-f14d-44ef-9331-6e7bbbe608a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd314a733ffdc4ce8b4d0fd0bf8f220c6', 'request_id': 'req-0b471e76-f14d-44ef-9331-6e7bbbe608a6'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:11.237830 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-0b471e76-f14d-44ef-9331-6e7bbbe608a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd314a733ffdc4ce8b4d0fd0bf8f220c6', 'request_id': 'req-0b471e76-f14d-44ef-9331-6e7bbbe608a6'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:11.248766 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-0b471e76-f14d-44ef-9331-6e7bbbe608a6 admin admin] The token cache is being invalidate because project d314a733ffdc4ce8b4d0fd0bf8f220c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:11:11.249083 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-0b471e76-f14d-44ef-9331-6e7bbbe608a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:11.249769 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-0b471e76-f14d-44ef-9331-6e7bbbe608a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:11.251386 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1279/2540] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:11:11 2022] DELETE /identity/v3/projects/d314a733ffdc4ce8b4d0fd0bf8f220c6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:11:11.255481 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6738f36-a409-46c2-99f8-a808c4997644 service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:11.265843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6738f36-a409-46c2-99f8-a808c4997644 service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:11.327570 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef21df-21bb-4094-b1f7-f3a81e3d3417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:11.328638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef21df-21bb-4094-b1f7-f3a81e3d3417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:11.328919 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef21df-21bb-4094-b1f7-f3a81e3d3417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:11.329190 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef21df-21bb-4094-b1f7-f3a81e3d3417 admin admin] PATH_INFO: `/v3/users/397677af30d04a6cabee39fac996a04d` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:11.330531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef21df-21bb-4094-b1f7-f3a81e3d3417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=397677af30d04a6cabee39fac996a04d)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:11.332552 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef21df-21bb-4094-b1f7-f3a81e3d3417 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:11.383052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-72ef21df-21bb-4094-b1f7-f3a81e3d3417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '397677af30d04a6cabee39fac996a04d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:11.395190 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-72ef21df-21bb-4094-b1f7-f3a81e3d3417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '397677af30d04a6cabee39fac996a04d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:11.401867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-72ef21df-21bb-4094-b1f7-f3a81e3d3417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '397677af30d04a6cabee39fac996a04d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:11.402597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-72ef21df-21bb-4094-b1f7-f3a81e3d3417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '397677af30d04a6cabee39fac996a04d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:11.411554 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-72ef21df-21bb-4094-b1f7-f3a81e3d3417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '397677af30d04a6cabee39fac996a04d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:11.419370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1262/2541] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:11:11 2022] DELETE /identity/v3/users/397677af30d04a6cabee39fac996a04d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:11:11.688976 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b471e76-f14d-44ef-9331-6e7bbbe608a6 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:11.691341 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-0b471e76-f14d-44ef-9331-6e7bbbe608a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:11.706881 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b471e76-f14d-44ef-9331-6e7bbbe608a6 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:11.754651 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:11.770322 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c2d82-84c2-4499-8d2c-35fcf7f9279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:11.771226 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c2d82-84c2-4499-8d2c-35fcf7f9279b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:11.771532 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c2d82-84c2-4499-8d2c-35fcf7f9279b admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:11.771823 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c2d82-84c2-4499-8d2c-35fcf7f9279b admin admin] PATH_INFO: `/v3/projects/e02969287c3242efbe0dc9b7fa11db87` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:11.772996 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c2d82-84c2-4499-8d2c-35fcf7f9279b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e02969287c3242efbe0dc9b7fa11db87)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:11.774939 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c2d82-84c2-4499-8d2c-35fcf7f9279b admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:11.823296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-428c2d82-84c2-4499-8d2c-35fcf7f9279b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e02969287c3242efbe0dc9b7fa11db87', 'request_id': 'req-428c2d82-84c2-4499-8d2c-35fcf7f9279b'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:11.829864 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-428c2d82-84c2-4499-8d2c-35fcf7f9279b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e02969287c3242efbe0dc9b7fa11db87', 'request_id': 'req-428c2d82-84c2-4499-8d2c-35fcf7f9279b'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:11.840942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-428c2d82-84c2-4499-8d2c-35fcf7f9279b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e02969287c3242efbe0dc9b7fa11db87', 'request_id': 'req-428c2d82-84c2-4499-8d2c-35fcf7f9279b'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:11.852097 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-428c2d82-84c2-4499-8d2c-35fcf7f9279b admin admin] The token cache is being invalidate because project e02969287c3242efbe0dc9b7fa11db87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:11:11.852509 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-428c2d82-84c2-4499-8d2c-35fcf7f9279b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:11.853145 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-428c2d82-84c2-4499-8d2c-35fcf7f9279b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:11.854724 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1280/2542] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:11:11 2022] DELETE /identity/v3/projects/e02969287c3242efbe0dc9b7fa11db87 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:11:11.859308 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef21df-21bb-4094-b1f7-f3a81e3d3417 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:11.860766 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-72ef21df-21bb-4094-b1f7-f3a81e3d3417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:11.875204 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef21df-21bb-4094-b1f7-f3a81e3d3417 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:11.932047 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:11.939619 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab3c1b-a591-4f2d-89e2-aeb09748a8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:11.940713 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab3c1b-a591-4f2d-89e2-aeb09748a8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:11.940998 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab3c1b-a591-4f2d-89e2-aeb09748a8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:11.941291 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab3c1b-a591-4f2d-89e2-aeb09748a8c8 admin admin] PATH_INFO: `/v3/users/8b05876d9d70442ca7d5debdc281da3c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:11.942769 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab3c1b-a591-4f2d-89e2-aeb09748a8c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b05876d9d70442ca7d5debdc281da3c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:11.945166 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab3c1b-a591-4f2d-89e2-aeb09748a8c8 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:11.992809 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-34ab3c1b-a591-4f2d-89e2-aeb09748a8c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b05876d9d70442ca7d5debdc281da3c'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:12.004481 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-34ab3c1b-a591-4f2d-89e2-aeb09748a8c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b05876d9d70442ca7d5debdc281da3c'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:12.011044 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-34ab3c1b-a591-4f2d-89e2-aeb09748a8c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b05876d9d70442ca7d5debdc281da3c'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:12.011782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-34ab3c1b-a591-4f2d-89e2-aeb09748a8c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b05876d9d70442ca7d5debdc281da3c'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:12.020771 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-34ab3c1b-a591-4f2d-89e2-aeb09748a8c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b05876d9d70442ca7d5debdc281da3c'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:12.028618 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1263/2543] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:11:11 2022] DELETE /identity/v3/users/8b05876d9d70442ca7d5debdc281da3c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:11:12.317985 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c2d82-84c2-4499-8d2c-35fcf7f9279b admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:12.319504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-428c2d82-84c2-4499-8d2c-35fcf7f9279b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:12.333162 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c2d82-84c2-4499-8d2c-35fcf7f9279b admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:12.392581 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9be85-1133-4efa-9a1b-ac012ebe17f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:12.393490 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9be85-1133-4efa-9a1b-ac012ebe17f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:12.393760 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9be85-1133-4efa-9a1b-ac012ebe17f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:12.394006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9be85-1133-4efa-9a1b-ac012ebe17f8 admin admin] PATH_INFO: `/v3/projects/ea494d0c96024c4fafd96f737c124be2` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:12.395538 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9be85-1133-4efa-9a1b-ac012ebe17f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea494d0c96024c4fafd96f737c124be2)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:12.398636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9be85-1133-4efa-9a1b-ac012ebe17f8 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:12.459000 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-46f9be85-1133-4efa-9a1b-ac012ebe17f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea494d0c96024c4fafd96f737c124be2', 'request_id': 'req-46f9be85-1133-4efa-9a1b-ac012ebe17f8'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:12.465707 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-46f9be85-1133-4efa-9a1b-ac012ebe17f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea494d0c96024c4fafd96f737c124be2', 'request_id': 'req-46f9be85-1133-4efa-9a1b-ac012ebe17f8'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:12.477725 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-46f9be85-1133-4efa-9a1b-ac012ebe17f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea494d0c96024c4fafd96f737c124be2', 'request_id': 'req-46f9be85-1133-4efa-9a1b-ac012ebe17f8'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:12.488614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-46f9be85-1133-4efa-9a1b-ac012ebe17f8 admin admin] The token cache is being invalidate because project ea494d0c96024c4fafd96f737c124be2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:11:12.488898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-46f9be85-1133-4efa-9a1b-ac012ebe17f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:12.489519 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-46f9be85-1133-4efa-9a1b-ac012ebe17f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:12.491066 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1281/2544] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:11:12 2022] DELETE /identity/v3/projects/ea494d0c96024c4fafd96f737c124be2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:11:12.497234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a15ac2-6be3-47d4-bcbf-1a8341459bb2 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:12.497520 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a15ac2-6be3-47d4-bcbf-1a8341459bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:12.497827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a15ac2-6be3-47d4-bcbf-1a8341459bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:12.517727 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-43a15ac2-6be3-47d4-bcbf-1a8341459bb2 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:12.518952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-43a15ac2-6be3-47d4-bcbf-1a8341459bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:12.582530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1264/2545] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:11:12.591187 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa5e98-4819-4d94-b5ca-76e42e1ddc2b None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:12.591478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa5e98-4819-4d94-b5ca-76e42e1ddc2b None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:12.591781 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa5e98-4819-4d94-b5ca-76e42e1ddc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:12.605122 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:12.613795 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-f6aa5e98-4819-4d94-b5ca-76e42e1ddc2b None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:12.616217 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-f6aa5e98-4819-4d94-b5ca-76e42e1ddc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:12.625296 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1282/2546] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:12.629992 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a15ac2-6be3-47d4-bcbf-1a8341459bb2 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:12.639866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a15ac2-6be3-47d4-bcbf-1a8341459bb2 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:12.644839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108bea4-ae1c-436f-b3b1-1f6ced191350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:12.645503 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108bea4-ae1c-436f-b3b1-1f6ced191350 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:12.645785 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108bea4-ae1c-436f-b3b1-1f6ced191350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:12.646060 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108bea4-ae1c-436f-b3b1-1f6ced191350 admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:12.646822 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108bea4-ae1c-436f-b3b1-1f6ced191350 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:11:12.647131 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108bea4-ae1c-436f-b3b1-1f6ced191350 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:12.648789 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108bea4-ae1c-436f-b3b1-1f6ced191350 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:12.660478 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1265/2547] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:11:12.666583 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa5e98-4819-4d94-b5ca-76e42e1ddc2b None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:12.677184 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa5e98-4819-4d94-b5ca-76e42e1ddc2b None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:12.683127 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0ebd6-207e-4084-ba68-69fb1e9e8636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:12.683832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0ebd6-207e-4084-ba68-69fb1e9e8636 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:12.684112 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0ebd6-207e-4084-ba68-69fb1e9e8636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:12.684383 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0ebd6-207e-4084-ba68-69fb1e9e8636 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:12.685106 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0ebd6-207e-4084-ba68-69fb1e9e8636 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:12.687142 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0ebd6-207e-4084-ba68-69fb1e9e8636 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:12.717158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1283/2548] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:11:12 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:11:12.721611 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108bea4-ae1c-436f-b3b1-1f6ced191350 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:12.731826 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108bea4-ae1c-436f-b3b1-1f6ced191350 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:12.791613 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680fe94-db7c-4a61-b252-393f6662fd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:12.792292 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680fe94-db7c-4a61-b252-393f6662fd5f admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:12.792614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680fe94-db7c-4a61-b252-393f6662fd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:12.792889 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680fe94-db7c-4a61-b252-393f6662fd5f admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:12.793580 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680fe94-db7c-4a61-b252-393f6662fd5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:12.795919 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680fe94-db7c-4a61-b252-393f6662fd5f admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:12.805345 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:12.824326 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1266/2549] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:11:12 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:11:12.825581 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0ebd6-207e-4084-ba68-69fb1e9e8636 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:12.836218 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0ebd6-207e-4084-ba68-69fb1e9e8636 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:12.841048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f31ccb-58a2-4c35-99ae-a7fb03755a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:12.841710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f31ccb-58a2-4c35-99ae-a7fb03755a8f admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:12.841985 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f31ccb-58a2-4c35-99ae-a7fb03755a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:12.842258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f31ccb-58a2-4c35-99ae-a7fb03755a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:12.842985 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f31ccb-58a2-4c35-99ae-a7fb03755a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:12.844680 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f31ccb-58a2-4c35-99ae-a7fb03755a8f admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:12.858298 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1284/2550] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:11:12.860541 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680fe94-db7c-4a61-b252-393f6662fd5f admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:12.871224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680fe94-db7c-4a61-b252-393f6662fd5f admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:12.877000 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef8f97-cbda-4fca-a3dd-b1efd5385a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:12.877671 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef8f97-cbda-4fca-a3dd-b1efd5385a09 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:12.877956 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef8f97-cbda-4fca-a3dd-b1efd5385a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:12.878228 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef8f97-cbda-4fca-a3dd-b1efd5385a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:12.878966 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef8f97-cbda-4fca-a3dd-b1efd5385a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:12.880615 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef8f97-cbda-4fca-a3dd-b1efd5385a09 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:12.891943 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1267/2551] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:11:12.896155 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f31ccb-58a2-4c35-99ae-a7fb03755a8f admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:12.906729 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f31ccb-58a2-4c35-99ae-a7fb03755a8f admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:12.911847 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384076ba-534c-4855-95bb-876f827bcea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:12.912733 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384076ba-534c-4855-95bb-876f827bcea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:12.913007 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384076ba-534c-4855-95bb-876f827bcea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:12.913333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384076ba-534c-4855-95bb-876f827bcea2 admin admin] PATH_INFO: `/v3/projects/17e47eabbabf480eabb29ab1e53e1f5e/users/3f4bd3057896469daa375145e219448f/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:12.929934 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384076ba-534c-4855-95bb-876f827bcea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e47eabbabf480eabb29ab1e53e1f5e, user_id=3f4bd3057896469daa375145e219448f, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:12.932742 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384076ba-534c-4855-95bb-876f827bcea2 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:12.947904 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1285/2552] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:11:12 2022] PUT /identity/v3/projects/17e47eabbabf480eabb29ab1e53e1f5e/users/3f4bd3057896469daa375145e219448f/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:11:12.960587 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbfc63-95e2-437e-a34a-d843831e2b17 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:12.960962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbfc63-95e2-437e-a34a-d843831e2b17 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:12.961301 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbfc63-95e2-437e-a34a-d843831e2b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:12.988991 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-09fbfc63-95e2-437e-a34a-d843831e2b17 None None] MFA Rules not processed for user `3f4bd3057896469daa375145e219448f`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:12.990224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-09fbfc63-95e2-437e-a34a-d843831e2b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:13.069873 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1268/2553] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:11:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:13.082459 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384076ba-534c-4855-95bb-876f827bcea2 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:13.084451 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-384076ba-534c-4855-95bb-876f827bcea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:13.145731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384076ba-534c-4855-95bb-876f827bcea2 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:13.149855 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db421309-49ef-4458-a501-64c872d2bd83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:13.150515 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db421309-49ef-4458-a501-64c872d2bd83 service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:13.150797 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db421309-49ef-4458-a501-64c872d2bd83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:13.151074 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db421309-49ef-4458-a501-64c872d2bd83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:13.161246 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db421309-49ef-4458-a501-64c872d2bd83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:13.162740 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db421309-49ef-4458-a501-64c872d2bd83 service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:13.172966 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1286/2554] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:11:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:11:16.230009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbfc63-95e2-437e-a34a-d843831e2b17 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:16.294577 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbfc63-95e2-437e-a34a-d843831e2b17 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:16.299953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c86df5-6ffb-4df9-8149-7c1a91efe378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:16.300896 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c86df5-6ffb-4df9-8149-7c1a91efe378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:16.301363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c86df5-6ffb-4df9-8149-7c1a91efe378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:16.301526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c86df5-6ffb-4df9-8149-7c1a91efe378 admin admin] PATH_INFO: `/v3/users/3f4bd3057896469daa375145e219448f` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:16.302914 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c86df5-6ffb-4df9-8149-7c1a91efe378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f4bd3057896469daa375145e219448f)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:16.304797 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c86df5-6ffb-4df9-8149-7c1a91efe378 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:16.354960 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-09c86df5-6ffb-4df9-8149-7c1a91efe378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f4bd3057896469daa375145e219448f'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:16.367278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-09c86df5-6ffb-4df9-8149-7c1a91efe378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f4bd3057896469daa375145e219448f'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:16.375112 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-09c86df5-6ffb-4df9-8149-7c1a91efe378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f4bd3057896469daa375145e219448f'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:16.375858 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-09c86df5-6ffb-4df9-8149-7c1a91efe378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f4bd3057896469daa375145e219448f'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:16.377686 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:INSERT=1,keystone:SELECT=90,keystone:DELETE=9 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:16.385129 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-09c86df5-6ffb-4df9-8149-7c1a91efe378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f4bd3057896469daa375145e219448f'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:16.391972 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1269/2555] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:11:16 2022] DELETE /identity/v3/users/3f4bd3057896469daa375145e219448f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:11:16.396707 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f93fde-ccc4-4925-be32-5ab485e84df3 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:16.397231 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f93fde-ccc4-4925-be32-5ab485e84df3 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:16.397364 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f93fde-ccc4-4925-be32-5ab485e84df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:16.416557 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-d7f93fde-ccc4-4925-be32-5ab485e84df3 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:16.417775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-d7f93fde-ccc4-4925-be32-5ab485e84df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:16.493888 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1287/2556] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:16.503700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c86df5-6ffb-4df9-8149-7c1a91efe378 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:16.505156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-09c86df5-6ffb-4df9-8149-7c1a91efe378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:16.572738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c86df5-6ffb-4df9-8149-7c1a91efe378 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:16.576670 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133014c-a440-4183-83ac-9d375c08a16e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:16.577272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133014c-a440-4183-83ac-9d375c08a16e service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:16.577560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133014c-a440-4183-83ac-9d375c08a16e service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:16.577859 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133014c-a440-4183-83ac-9d375c08a16e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:16.588351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133014c-a440-4183-83ac-9d375c08a16e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:16.589847 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133014c-a440-4183-83ac-9d375c08a16e service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:16.600370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1270/2557] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:11:16.937747 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f93fde-ccc4-4925-be32-5ab485e84df3 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:16.939915 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-d7f93fde-ccc4-4925-be32-5ab485e84df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:16.956099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f93fde-ccc4-4925-be32-5ab485e84df3 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:16.961201 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099f6a4-9787-4d49-ae1a-744ce6665ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:16.962042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099f6a4-9787-4d49-ae1a-744ce6665ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:16.962332 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099f6a4-9787-4d49-ae1a-744ce6665ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:16.962605 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099f6a4-9787-4d49-ae1a-744ce6665ffd admin admin] PATH_INFO: `/v3/projects/17e47eabbabf480eabb29ab1e53e1f5e` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:16.964088 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099f6a4-9787-4d49-ae1a-744ce6665ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=17e47eabbabf480eabb29ab1e53e1f5e)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:16.973304 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099f6a4-9787-4d49-ae1a-744ce6665ffd admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:17.016106 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:17.023566 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-0099f6a4-9787-4d49-ae1a-744ce6665ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17e47eabbabf480eabb29ab1e53e1f5e', 'request_id': 'req-0099f6a4-9787-4d49-ae1a-744ce6665ffd'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:17.032464 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-0099f6a4-9787-4d49-ae1a-744ce6665ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17e47eabbabf480eabb29ab1e53e1f5e', 'request_id': 'req-0099f6a4-9787-4d49-ae1a-744ce6665ffd'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:17.042912 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-0099f6a4-9787-4d49-ae1a-744ce6665ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17e47eabbabf480eabb29ab1e53e1f5e', 'request_id': 'req-0099f6a4-9787-4d49-ae1a-744ce6665ffd'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:17.054785 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-0099f6a4-9787-4d49-ae1a-744ce6665ffd admin admin] The token cache is being invalidate because project 17e47eabbabf480eabb29ab1e53e1f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:11:17.055163 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-0099f6a4-9787-4d49-ae1a-744ce6665ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:17.055905 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-0099f6a4-9787-4d49-ae1a-744ce6665ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:17.057543 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1288/2558] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:11:16 2022] DELETE /identity/v3/projects/17e47eabbabf480eabb29ab1e53e1f5e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:11:17.062945 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405f056-09fc-4d01-ab83-c20c1d11af1c None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:17.063237 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405f056-09fc-4d01-ab83-c20c1d11af1c None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:17.063546 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405f056-09fc-4d01-ab83-c20c1d11af1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:17.082569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-6405f056-09fc-4d01-ab83-c20c1d11af1c None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:17.083873 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-6405f056-09fc-4d01-ab83-c20c1d11af1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:17.146703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1271/2559] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:17.157591 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d33a3-0b89-43bf-b2bb-f5243d263b4f None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:17.157885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d33a3-0b89-43bf-b2bb-f5243d263b4f None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:17.158160 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d33a3-0b89-43bf-b2bb-f5243d263b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:17.177249 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-311d33a3-0b89-43bf-b2bb-f5243d263b4f None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:17.178460 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-311d33a3-0b89-43bf-b2bb-f5243d263b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:17.186809 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1289/2560] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:17.191124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405f056-09fc-4d01-ab83-c20c1d11af1c None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:17.201146 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405f056-09fc-4d01-ab83-c20c1d11af1c None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:17.206982 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c028f3-ddfe-45d4-b4d0-838653e46feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:17.207695 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c028f3-ddfe-45d4-b4d0-838653e46feb admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:17.207974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c028f3-ddfe-45d4-b4d0-838653e46feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:17.208249 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c028f3-ddfe-45d4-b4d0-838653e46feb admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:17.208990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c028f3-ddfe-45d4-b4d0-838653e46feb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:11:17.209295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c028f3-ddfe-45d4-b4d0-838653e46feb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:17.210910 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c028f3-ddfe-45d4-b4d0-838653e46feb admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:17.224623 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1272/2561] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 02:11:17.229277 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d33a3-0b89-43bf-b2bb-f5243d263b4f None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:17.239390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d33a3-0b89-43bf-b2bb-f5243d263b4f None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:17.244656 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062d01f-c50c-4771-8952-246fa48e9d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:17.245326 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062d01f-c50c-4771-8952-246fa48e9d2d admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:17.245610 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062d01f-c50c-4771-8952-246fa48e9d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:17.245885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062d01f-c50c-4771-8952-246fa48e9d2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:17.246576 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062d01f-c50c-4771-8952-246fa48e9d2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:17.248625 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062d01f-c50c-4771-8952-246fa48e9d2d admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:17.276887 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1290/2562] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:11:17 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:11:17.281588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c028f3-ddfe-45d4-b4d0-838653e46feb admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:17.292035 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c028f3-ddfe-45d4-b4d0-838653e46feb admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:17.352612 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7eacf2-4c8d-4f0d-bf32-d0b9a3255b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:17.353309 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7eacf2-4c8d-4f0d-bf32-d0b9a3255b01 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:17.353575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7eacf2-4c8d-4f0d-bf32-d0b9a3255b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:17.353848 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7eacf2-4c8d-4f0d-bf32-d0b9a3255b01 admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:17.354553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7eacf2-4c8d-4f0d-bf32-d0b9a3255b01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:17.356532 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7eacf2-4c8d-4f0d-bf32-d0b9a3255b01 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:17.379005 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1273/2563] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:11:17 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:11:17.384059 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062d01f-c50c-4771-8952-246fa48e9d2d admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:17.394835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062d01f-c50c-4771-8952-246fa48e9d2d admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:17.400053 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e44165-b12f-4d8d-90b2-9cbb1ddcb80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:17.400782 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e44165-b12f-4d8d-90b2-9cbb1ddcb80a admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:17.401057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e44165-b12f-4d8d-90b2-9cbb1ddcb80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:17.401254 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e44165-b12f-4d8d-90b2-9cbb1ddcb80a admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:17.401990 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e44165-b12f-4d8d-90b2-9cbb1ddcb80a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:17.403625 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e44165-b12f-4d8d-90b2-9cbb1ddcb80a admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:17.415227 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1291/2564] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:11:17.420003 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7eacf2-4c8d-4f0d-bf32-d0b9a3255b01 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:17.431955 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7eacf2-4c8d-4f0d-bf32-d0b9a3255b01 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:17.439362 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b3d42-db2c-4802-85d9-3488511e2829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:17.440440 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b3d42-db2c-4802-85d9-3488511e2829 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:17.440853 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b3d42-db2c-4802-85d9-3488511e2829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:17.441231 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b3d42-db2c-4802-85d9-3488511e2829 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:17.442893 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b3d42-db2c-4802-85d9-3488511e2829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:17.444788 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b3d42-db2c-4802-85d9-3488511e2829 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:17.450651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:17.457503 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1274/2565] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:11:17.462995 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e44165-b12f-4d8d-90b2-9cbb1ddcb80a admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:17.473292 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e44165-b12f-4d8d-90b2-9cbb1ddcb80a admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:17.478140 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f3264-8eaf-4895-8ccc-5039a42c29d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:17.478978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f3264-8eaf-4895-8ccc-5039a42c29d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:17.479255 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f3264-8eaf-4895-8ccc-5039a42c29d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:17.479565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f3264-8eaf-4895-8ccc-5039a42c29d6 admin admin] PATH_INFO: `/v3/projects/261e3e6c84b14104883301249191bfab/users/12cf0dc70dae429bb4511199212f0d8b/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:17.497162 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f3264-8eaf-4895-8ccc-5039a42c29d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=261e3e6c84b14104883301249191bfab, user_id=12cf0dc70dae429bb4511199212f0d8b, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:17.500119 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f3264-8eaf-4895-8ccc-5039a42c29d6 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:17.523851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1292/2566] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:11:17 2022] PUT /identity/v3/projects/261e3e6c84b14104883301249191bfab/users/12cf0dc70dae429bb4511199212f0d8b/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:11:17.540886 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d5e35-f730-4a2f-942d-50b11b27d9de None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:17.542214 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d5e35-f730-4a2f-942d-50b11b27d9de None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:17.542705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d5e35-f730-4a2f-942d-50b11b27d9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:17.584125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-918d5e35-f730-4a2f-942d-50b11b27d9de None None] MFA Rules not processed for user `12cf0dc70dae429bb4511199212f0d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:17.585408 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-918d5e35-f730-4a2f-942d-50b11b27d9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:17.670826 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1275/2567] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:11:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:17.682349 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f3264-8eaf-4895-8ccc-5039a42c29d6 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:17.684196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-794f3264-8eaf-4895-8ccc-5039a42c29d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:17.769837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f3264-8eaf-4895-8ccc-5039a42c29d6 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:17.773849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4525aa-48ad-43b4-8e8c-cf9932c3f62d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:17.774584 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4525aa-48ad-43b4-8e8c-cf9932c3f62d service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:17.774864 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4525aa-48ad-43b4-8e8c-cf9932c3f62d service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:17.775142 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4525aa-48ad-43b4-8e8c-cf9932c3f62d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:17.789646 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4525aa-48ad-43b4-8e8c-cf9932c3f62d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:17.791774 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4525aa-48ad-43b4-8e8c-cf9932c3f62d service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:17.803970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1293/2568] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:11:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:11:20.444518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d5e35-f730-4a2f-942d-50b11b27d9de None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:20.509565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d5e35-f730-4a2f-942d-50b11b27d9de None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:20.515190 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f54f6-5ece-46b9-ba84-de5b66fb928a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:20.516437 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f54f6-5ece-46b9-ba84-de5b66fb928a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:20.516724 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f54f6-5ece-46b9-ba84-de5b66fb928a admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:20.516998 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f54f6-5ece-46b9-ba84-de5b66fb928a admin admin] PATH_INFO: `/v3/users/12cf0dc70dae429bb4511199212f0d8b` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:20.518904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f54f6-5ece-46b9-ba84-de5b66fb928a admin admin] RBAC: Authorizing `identity:delete_user(user_id=12cf0dc70dae429bb4511199212f0d8b)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:20.522011 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f54f6-5ece-46b9-ba84-de5b66fb928a admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:20.584499 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-142f54f6-5ece-46b9-ba84-de5b66fb928a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12cf0dc70dae429bb4511199212f0d8b'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:20.597163 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-142f54f6-5ece-46b9-ba84-de5b66fb928a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12cf0dc70dae429bb4511199212f0d8b'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:20.604468 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-142f54f6-5ece-46b9-ba84-de5b66fb928a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12cf0dc70dae429bb4511199212f0d8b'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:20.605184 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-142f54f6-5ece-46b9-ba84-de5b66fb928a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12cf0dc70dae429bb4511199212f0d8b'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:20.614718 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-142f54f6-5ece-46b9-ba84-de5b66fb928a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12cf0dc70dae429bb4511199212f0d8b'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:20.620818 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1276/2569] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:11:20 2022] DELETE /identity/v3/users/12cf0dc70dae429bb4511199212f0d8b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:11:20.625587 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe99914-a268-457b-9711-729315e3c9fb None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:20.626005 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe99914-a268-457b-9711-729315e3c9fb None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:20.626103 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe99914-a268-457b-9711-729315e3c9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:20.644136 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-4fe99914-a268-457b-9711-729315e3c9fb None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:20.645339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-4fe99914-a268-457b-9711-729315e3c9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:20.703921 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1294/2570] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:20.713683 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f54f6-5ece-46b9-ba84-de5b66fb928a admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:20.715190 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-142f54f6-5ece-46b9-ba84-de5b66fb928a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:20.727151 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:20.776658 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f54f6-5ece-46b9-ba84-de5b66fb928a admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:20.780656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee3640-560f-493a-aa63-a3b06a68680b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:20.781348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee3640-560f-493a-aa63-a3b06a68680b service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:20.781622 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee3640-560f-493a-aa63-a3b06a68680b service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:20.781905 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee3640-560f-493a-aa63-a3b06a68680b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:20.791173 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee3640-560f-493a-aa63-a3b06a68680b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:20.792639 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee3640-560f-493a-aa63-a3b06a68680b service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:20.802690 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1277/2571] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:11:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:11:21.087155 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe99914-a268-457b-9711-729315e3c9fb None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:21.089119 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-4fe99914-a268-457b-9711-729315e3c9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:21.105200 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe99914-a268-457b-9711-729315e3c9fb None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:21.111198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02503b-efd5-4ad7-9ddb-2198d8ecf2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:21.112354 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02503b-efd5-4ad7-9ddb-2198d8ecf2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:21.112777 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02503b-efd5-4ad7-9ddb-2198d8ecf2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:21.113475 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02503b-efd5-4ad7-9ddb-2198d8ecf2d7 admin admin] PATH_INFO: `/v3/projects/261e3e6c84b14104883301249191bfab` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:21.114968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02503b-efd5-4ad7-9ddb-2198d8ecf2d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=261e3e6c84b14104883301249191bfab)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:21.117693 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02503b-efd5-4ad7-9ddb-2198d8ecf2d7 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:21.120573 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:21.177411 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-8b02503b-efd5-4ad7-9ddb-2198d8ecf2d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '261e3e6c84b14104883301249191bfab', 'request_id': 'req-8b02503b-efd5-4ad7-9ddb-2198d8ecf2d7'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:21.184646 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-8b02503b-efd5-4ad7-9ddb-2198d8ecf2d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '261e3e6c84b14104883301249191bfab', 'request_id': 'req-8b02503b-efd5-4ad7-9ddb-2198d8ecf2d7'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:21.193852 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-8b02503b-efd5-4ad7-9ddb-2198d8ecf2d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '261e3e6c84b14104883301249191bfab', 'request_id': 'req-8b02503b-efd5-4ad7-9ddb-2198d8ecf2d7'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:21.206130 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-8b02503b-efd5-4ad7-9ddb-2198d8ecf2d7 admin admin] The token cache is being invalidate because project 261e3e6c84b14104883301249191bfab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:11:21.206427 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-8b02503b-efd5-4ad7-9ddb-2198d8ecf2d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:21.207104 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-8b02503b-efd5-4ad7-9ddb-2198d8ecf2d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:21.208703 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1295/2572] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:11:21 2022] DELETE /identity/v3/projects/261e3e6c84b14104883301249191bfab => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:11:21.213829 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82b4de-7fe5-4dd5-ac7b-779047bbafdd None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:21.214153 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82b4de-7fe5-4dd5-ac7b-779047bbafdd None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:21.214441 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82b4de-7fe5-4dd5-ac7b-779047bbafdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:21.233265 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-0c82b4de-7fe5-4dd5-ac7b-779047bbafdd None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:21.234512 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-0c82b4de-7fe5-4dd5-ac7b-779047bbafdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:21.292497 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1278/2573] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:21.301243 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fef78-6717-45c8-a7c5-a92231c476ed None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:21.301512 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fef78-6717-45c8-a7c5-a92231c476ed None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:21.301789 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fef78-6717-45c8-a7c5-a92231c476ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:21.321563 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-8d5fef78-6717-45c8-a7c5-a92231c476ed None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:21.322763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-8d5fef78-6717-45c8-a7c5-a92231c476ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:21.331344 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1296/2574] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:11:21.337150 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82b4de-7fe5-4dd5-ac7b-779047bbafdd None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:21.347126 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82b4de-7fe5-4dd5-ac7b-779047bbafdd None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:21.352373 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd022b4a-0a18-49b2-a35c-395cd19b532f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:21.353029 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd022b4a-0a18-49b2-a35c-395cd19b532f admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:21.353310 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd022b4a-0a18-49b2-a35c-395cd19b532f admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:21.353577 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd022b4a-0a18-49b2-a35c-395cd19b532f admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:21.354308 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd022b4a-0a18-49b2-a35c-395cd19b532f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:11:21.354630 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd022b4a-0a18-49b2-a35c-395cd19b532f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:21.356263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd022b4a-0a18-49b2-a35c-395cd19b532f admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:21.367818 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1279/2575] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 02:11:21.372175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fef78-6717-45c8-a7c5-a92231c476ed None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:21.382156 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fef78-6717-45c8-a7c5-a92231c476ed None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:21.387214 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9bc23-8e22-4648-9126-18393ef3c368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:21.387916 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9bc23-8e22-4648-9126-18393ef3c368 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:21.388297 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9bc23-8e22-4648-9126-18393ef3c368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:21.388462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9bc23-8e22-4648-9126-18393ef3c368 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:21.389159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9bc23-8e22-4648-9126-18393ef3c368 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:21.391911 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9bc23-8e22-4648-9126-18393ef3c368 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:21.420750 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1297/2576] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:11:21 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:11:21.425805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd022b4a-0a18-49b2-a35c-395cd19b532f admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:21.436324 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd022b4a-0a18-49b2-a35c-395cd19b532f admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:21.496975 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0397eb5-c96a-4cae-8792-db5bc3eb34f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:21.497649 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0397eb5-c96a-4cae-8792-db5bc3eb34f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:21.497934 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0397eb5-c96a-4cae-8792-db5bc3eb34f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:21.498209 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0397eb5-c96a-4cae-8792-db5bc3eb34f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:21.498935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0397eb5-c96a-4cae-8792-db5bc3eb34f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:21.501599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0397eb5-c96a-4cae-8792-db5bc3eb34f6 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:21.526313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1280/2577] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:11:21 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:11:21.527614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9bc23-8e22-4648-9126-18393ef3c368 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:21.538807 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9bc23-8e22-4648-9126-18393ef3c368 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:21.548302 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edbd37-b865-4f25-bafd-ab1ddd07440d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:21.548985 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edbd37-b865-4f25-bafd-ab1ddd07440d admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:21.549335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edbd37-b865-4f25-bafd-ab1ddd07440d admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:21.549670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edbd37-b865-4f25-bafd-ab1ddd07440d admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:21.550428 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98edbd37-b865-4f25-bafd-ab1ddd07440d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:21.552058 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98edbd37-b865-4f25-bafd-ab1ddd07440d admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:21.566914 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1298/2578] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:11:21.570961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0397eb5-c96a-4cae-8792-db5bc3eb34f6 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:21.582522 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0397eb5-c96a-4cae-8792-db5bc3eb34f6 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:21.588112 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1c004-1a6a-4aa5-aa10-d7d0efa73b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:21.588803 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1c004-1a6a-4aa5-aa10-d7d0efa73b1c admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:21.589083 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1c004-1a6a-4aa5-aa10-d7d0efa73b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:21.589389 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1c004-1a6a-4aa5-aa10-d7d0efa73b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:21.590120 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1c004-1a6a-4aa5-aa10-d7d0efa73b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:21.591780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1c004-1a6a-4aa5-aa10-d7d0efa73b1c admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:21.602597 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1281/2579] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:11:21.606970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edbd37-b865-4f25-bafd-ab1ddd07440d admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:21.617888 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edbd37-b865-4f25-bafd-ab1ddd07440d admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:21.622822 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940eeba-673e-4357-9170-76fc69198da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:21.623767 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940eeba-673e-4357-9170-76fc69198da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:21.624042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940eeba-673e-4357-9170-76fc69198da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:21.624289 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940eeba-673e-4357-9170-76fc69198da4 admin admin] PATH_INFO: `/v3/projects/d296325dd0e34afc99bc10b7779bf87d/users/9d5fa926df914584a9e56e4d535bc873/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:21.639862 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940eeba-673e-4357-9170-76fc69198da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d296325dd0e34afc99bc10b7779bf87d, user_id=9d5fa926df914584a9e56e4d535bc873, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:21.643317 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940eeba-673e-4357-9170-76fc69198da4 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:21.658121 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1299/2580] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:11:21 2022] PUT /identity/v3/projects/d296325dd0e34afc99bc10b7779bf87d/users/9d5fa926df914584a9e56e4d535bc873/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:11:21.668984 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36a2e2-c7d0-4c94-b5d3-bcba213fb251 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:21.669275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36a2e2-c7d0-4c94-b5d3-bcba213fb251 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:21.669548 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36a2e2-c7d0-4c94-b5d3-bcba213fb251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:21.697683 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-cd36a2e2-c7d0-4c94-b5d3-bcba213fb251 None None] MFA Rules not processed for user `9d5fa926df914584a9e56e4d535bc873`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:21.699034 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-cd36a2e2-c7d0-4c94-b5d3-bcba213fb251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:21.704747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:21.768948 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1282/2581] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:11:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:11:21.780690 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940eeba-673e-4357-9170-76fc69198da4 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:21.783192 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-b940eeba-673e-4357-9170-76fc69198da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:21.843954 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940eeba-673e-4357-9170-76fc69198da4 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:21.847931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ecda46-09e6-41ed-85e3-c2193821e7b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:21.848593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecda46-09e6-41ed-85e3-c2193821e7b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:21.848870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecda46-09e6-41ed-85e3-c2193821e7b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:21.849140 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecda46-09e6-41ed-85e3-c2193821e7b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:21.858837 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ecda46-09e6-41ed-85e3-c2193821e7b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:21.860482 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ecda46-09e6-41ed-85e3-c2193821e7b9 service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:21.872041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1300/2582] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:11:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:11:28.515100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36a2e2-c7d0-4c94-b5d3-bcba213fb251 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:28.516888 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-cd36a2e2-c7d0-4c94-b5d3-bcba213fb251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:28.576072 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36a2e2-c7d0-4c94-b5d3-bcba213fb251 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:28.579970 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebcdac-8a4f-4449-b7aa-08b51f71d404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:28.580616 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebcdac-8a4f-4449-b7aa-08b51f71d404 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:28.580895 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebcdac-8a4f-4449-b7aa-08b51f71d404 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:28.581166 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebcdac-8a4f-4449-b7aa-08b51f71d404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:28.582995 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-69ebcdac-8a4f-4449-b7aa-08b51f71d404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:28.659403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebcdac-8a4f-4449-b7aa-08b51f71d404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:28.661144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebcdac-8a4f-4449-b7aa-08b51f71d404 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:28.672195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1283/2583] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:11:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:11:31.775094 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ecda46-09e6-41ed-85e3-c2193821e7b9 service cinder] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:31.815224 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:31.847584 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ecda46-09e6-41ed-85e3-c2193821e7b9 service cinder] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:31.852282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c0bb3-2913-4c9e-afb4-a4f556cf3048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:31.853176 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c0bb3-2913-4c9e-afb4-a4f556cf3048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:31.853475 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c0bb3-2913-4c9e-afb4-a4f556cf3048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:31.853745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c0bb3-2913-4c9e-afb4-a4f556cf3048 admin admin] PATH_INFO: `/v3/users/9d5fa926df914584a9e56e4d535bc873` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:31.854952 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c0bb3-2913-4c9e-afb4-a4f556cf3048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d5fa926df914584a9e56e4d535bc873)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:31.856950 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c0bb3-2913-4c9e-afb4-a4f556cf3048 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:31.914989 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-888c0bb3-2913-4c9e-afb4-a4f556cf3048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d5fa926df914584a9e56e4d535bc873'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:31.923908 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-888c0bb3-2913-4c9e-afb4-a4f556cf3048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d5fa926df914584a9e56e4d535bc873'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:31.924680 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-888c0bb3-2913-4c9e-afb4-a4f556cf3048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d5fa926df914584a9e56e4d535bc873'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:31.925400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-888c0bb3-2913-4c9e-afb4-a4f556cf3048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d5fa926df914584a9e56e4d535bc873'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:31.938501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-888c0bb3-2913-4c9e-afb4-a4f556cf3048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d5fa926df914584a9e56e4d535bc873'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:31.954376 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1301/2584] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:11:31 2022] DELETE /identity/v3/users/9d5fa926df914584a9e56e4d535bc873 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:11:31.959205 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4dea6-93b7-4a0b-8d11-1ec199c52e44 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:31.959698 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4dea6-93b7-4a0b-8d11-1ec199c52e44 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:31.959821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4dea6-93b7-4a0b-8d11-1ec199c52e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:31.977801 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-01c4dea6-93b7-4a0b-8d11-1ec199c52e44 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:31.979014 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-01c4dea6-93b7-4a0b-8d11-1ec199c52e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:32.030395 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:32.041192 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1284/2585] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:32.051726 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c0bb3-2913-4c9e-afb4-a4f556cf3048 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:32.053256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-888c0bb3-2913-4c9e-afb4-a4f556cf3048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:32.115359 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c0bb3-2913-4c9e-afb4-a4f556cf3048 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:32.119790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff528958-706a-44a5-ba21-697820a362b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:32.120459 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff528958-706a-44a5-ba21-697820a362b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:32.120737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff528958-706a-44a5-ba21-697820a362b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:32.121016 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff528958-706a-44a5-ba21-697820a362b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:32.131402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff528958-706a-44a5-ba21-697820a362b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:32.132885 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff528958-706a-44a5-ba21-697820a362b8 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:32.143330 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1302/2586] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:11:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:11:32.736540 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4dea6-93b7-4a0b-8d11-1ec199c52e44 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:32.738194 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-01c4dea6-93b7-4a0b-8d11-1ec199c52e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:32.750965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4dea6-93b7-4a0b-8d11-1ec199c52e44 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:32.756581 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d21680-6471-4cd0-bd47-f6f7166a250a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:32.757508 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d21680-6471-4cd0-bd47-f6f7166a250a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:32.757948 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d21680-6471-4cd0-bd47-f6f7166a250a admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:32.758096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d21680-6471-4cd0-bd47-f6f7166a250a admin admin] PATH_INFO: `/v3/projects/d296325dd0e34afc99bc10b7779bf87d` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:32.759599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d21680-6471-4cd0-bd47-f6f7166a250a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d296325dd0e34afc99bc10b7779bf87d)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:32.761959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d21680-6471-4cd0-bd47-f6f7166a250a admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:32.811630 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-05d21680-6471-4cd0-bd47-f6f7166a250a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd296325dd0e34afc99bc10b7779bf87d', 'request_id': 'req-05d21680-6471-4cd0-bd47-f6f7166a250a'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:32.820683 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-05d21680-6471-4cd0-bd47-f6f7166a250a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd296325dd0e34afc99bc10b7779bf87d', 'request_id': 'req-05d21680-6471-4cd0-bd47-f6f7166a250a'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:32.826240 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-05d21680-6471-4cd0-bd47-f6f7166a250a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd296325dd0e34afc99bc10b7779bf87d', 'request_id': 'req-05d21680-6471-4cd0-bd47-f6f7166a250a'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:32.838367 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-05d21680-6471-4cd0-bd47-f6f7166a250a admin admin] The token cache is being invalidate because project d296325dd0e34afc99bc10b7779bf87d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:11:32.838688 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-05d21680-6471-4cd0-bd47-f6f7166a250a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:32.839534 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-05d21680-6471-4cd0-bd47-f6f7166a250a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:32.841257 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1285/2587] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:11:32 2022] DELETE /identity/v3/projects/d296325dd0e34afc99bc10b7779bf87d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:11:32.849464 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af91a1-17fa-48d7-8394-2b00f5c5a8fe None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:32.850074 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af91a1-17fa-48d7-8394-2b00f5c5a8fe None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:32.850239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af91a1-17fa-48d7-8394-2b00f5c5a8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:32.877586 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-e7af91a1-17fa-48d7-8394-2b00f5c5a8fe None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:32.878958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-e7af91a1-17fa-48d7-8394-2b00f5c5a8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:32.936003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:32.951208 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1303/2588] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:33.015918 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93101cbe-6e8f-4eeb-8b2d-82ffa1fccffa None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:33.016540 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93101cbe-6e8f-4eeb-8b2d-82ffa1fccffa None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:33.016540 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93101cbe-6e8f-4eeb-8b2d-82ffa1fccffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:33.038288 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-93101cbe-6e8f-4eeb-8b2d-82ffa1fccffa None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:33.039730 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-93101cbe-6e8f-4eeb-8b2d-82ffa1fccffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:33.049366 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1286/2589] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:33.053894 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af91a1-17fa-48d7-8394-2b00f5c5a8fe None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:33.072343 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af91a1-17fa-48d7-8394-2b00f5c5a8fe None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:33.078340 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ed704-f530-41d6-9633-38cb47b6f075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:33.079086 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ed704-f530-41d6-9633-38cb47b6f075 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:33.079373 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ed704-f530-41d6-9633-38cb47b6f075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:33.079696 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ed704-f530-41d6-9633-38cb47b6f075 admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:33.080439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ed704-f530-41d6-9633-38cb47b6f075 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:11:33.080749 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ed704-f530-41d6-9633-38cb47b6f075 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:33.082385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ed704-f530-41d6-9633-38cb47b6f075 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:33.096501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1304/2590] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:11:33.100966 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93101cbe-6e8f-4eeb-8b2d-82ffa1fccffa None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:33.110703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93101cbe-6e8f-4eeb-8b2d-82ffa1fccffa None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:33.115870 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c30d59-1db8-42f1-a192-227ae2e3c1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:33.116960 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c30d59-1db8-42f1-a192-227ae2e3c1fc admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:33.116960 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c30d59-1db8-42f1-a192-227ae2e3c1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:33.117119 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c30d59-1db8-42f1-a192-227ae2e3c1fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:33.117893 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c30d59-1db8-42f1-a192-227ae2e3c1fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:33.119836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c30d59-1db8-42f1-a192-227ae2e3c1fc admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:33.154895 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1287/2591] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:11:33 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:11:33.159310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ed704-f530-41d6-9633-38cb47b6f075 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:33.170707 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ed704-f530-41d6-9633-38cb47b6f075 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:33.230166 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f12521-a0d5-4a8a-87b7-86362db960fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:33.230854 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f12521-a0d5-4a8a-87b7-86362db960fd admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:33.231136 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f12521-a0d5-4a8a-87b7-86362db960fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:33.231426 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f12521-a0d5-4a8a-87b7-86362db960fd admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:33.232139 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f12521-a0d5-4a8a-87b7-86362db960fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:33.234283 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f12521-a0d5-4a8a-87b7-86362db960fd admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:33.259118 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1305/2592] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:11:33 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:11:33.260428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c30d59-1db8-42f1-a192-227ae2e3c1fc admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:33.272510 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c30d59-1db8-42f1-a192-227ae2e3c1fc admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:33.278053 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4eb489-4e87-4cbf-b3d8-c2cd5eb535e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:33.278780 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4eb489-4e87-4cbf-b3d8-c2cd5eb535e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:33.279059 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4eb489-4e87-4cbf-b3d8-c2cd5eb535e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:33.279335 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4eb489-4e87-4cbf-b3d8-c2cd5eb535e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:33.280101 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4eb489-4e87-4cbf-b3d8-c2cd5eb535e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:33.282088 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4eb489-4e87-4cbf-b3d8-c2cd5eb535e5 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:33.294594 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1288/2593] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:11:33.301096 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f12521-a0d5-4a8a-87b7-86362db960fd admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:33.314455 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f12521-a0d5-4a8a-87b7-86362db960fd admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:33.320609 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe06665-1dd8-48f1-97f7-c1c57fd268ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:33.321259 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe06665-1dd8-48f1-97f7-c1c57fd268ca admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:33.321597 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe06665-1dd8-48f1-97f7-c1c57fd268ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:33.321841 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe06665-1dd8-48f1-97f7-c1c57fd268ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:33.322641 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe06665-1dd8-48f1-97f7-c1c57fd268ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:33.324335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe06665-1dd8-48f1-97f7-c1c57fd268ca admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:33.335903 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1306/2594] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:11:33.340421 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4eb489-4e87-4cbf-b3d8-c2cd5eb535e5 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:33.352475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4eb489-4e87-4cbf-b3d8-c2cd5eb535e5 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:33.357461 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc2498-aea5-41f8-a2c3-bb8e95aeae10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:33.358379 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc2498-aea5-41f8-a2c3-bb8e95aeae10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:33.358659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230c183-41bf-4243-b407-fe7b4eea1f10 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:33.358766 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc2498-aea5-41f8-a2c3-bb8e95aeae10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:33.359075 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230c183-41bf-4243-b407-fe7b4eea1f10 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:33.359216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc2498-aea5-41f8-a2c3-bb8e95aeae10 admin admin] PATH_INFO: `/v3/projects/26e0dbd1a0784a9d8b6b86a5581facff/users/a05e0301b8924b47ad228729f43e0c6a/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:33.359660 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230c183-41bf-4243-b407-fe7b4eea1f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:33.375845 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc2498-aea5-41f8-a2c3-bb8e95aeae10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e0dbd1a0784a9d8b6b86a5581facff, user_id=a05e0301b8924b47ad228729f43e0c6a, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:33.380130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc2498-aea5-41f8-a2c3-bb8e95aeae10 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:33.380904 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-d230c183-41bf-4243-b407-fe7b4eea1f10 None None] MFA Rules not processed for user `0dbf596d8f964d4695944a23dd8e4cef`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:33.382191 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-d230c183-41bf-4243-b407-fe7b4eea1f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:33.398835 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1289/2595] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:11:33 2022] PUT /identity/v3/projects/26e0dbd1a0784a9d8b6b86a5581facff/users/a05e0301b8924b47ad228729f43e0c6a/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:11:33.409322 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af5101-80bc-44e9-9441-20f13288a561 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:33.409614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af5101-80bc-44e9-9441-20f13288a561 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:33.409895 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af5101-80bc-44e9-9441-20f13288a561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:33.441181 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-37af5101-80bc-44e9-9441-20f13288a561 None None] MFA Rules not processed for user `a05e0301b8924b47ad228729f43e0c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:33.443070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-37af5101-80bc-44e9-9441-20f13288a561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:33.448555 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1307/2596] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 02:11:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:11:33.464871 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230c183-41bf-4243-b407-fe7b4eea1f10 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:33.467850 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-d230c183-41bf-4243-b407-fe7b4eea1f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:33.522489 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1290/2597] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:11:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:11:33.534226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af5101-80bc-44e9-9441-20f13288a561 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:33.535746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-37af5101-80bc-44e9-9441-20f13288a561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:33.543786 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230c183-41bf-4243-b407-fe7b4eea1f10 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:33.545963 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:33.547803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:33.599933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af5101-80bc-44e9-9441-20f13288a561 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:33.603624 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f086d-f21c-4c21-be3c-eaea8a5469ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:33.604528 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f086d-f21c-4c21-be3c-eaea8a5469ac service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:33.604814 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f086d-f21c-4c21-be3c-eaea8a5469ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:33.605096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f086d-f21c-4c21-be3c-eaea8a5469ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:33.614343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f086d-f21c-4c21-be3c-eaea8a5469ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:33.615845 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f086d-f21c-4c21-be3c-eaea8a5469ac service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:33.622391 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495d6f6-3476-43d9-803c-065352620b10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae132c4d0b5461aa26ab929a017cb08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:33.623091 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495d6f6-3476-43d9-803c-065352620b10 service swift] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:33.623371 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495d6f6-3476-43d9-803c-065352620b10 service swift] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:33.623675 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495d6f6-3476-43d9-803c-065352620b10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:33.626356 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1291/2598] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:11:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:11:33.683673 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495d6f6-3476-43d9-803c-065352620b10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:33.685397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495d6f6-3476-43d9-803c-065352620b10 service swift] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:33.694628 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1308/2599] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 02:11:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 02:11:35.064864 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7ab88-640a-4350-91c6-9ad095a73f3b None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:35.065477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7ab88-640a-4350-91c6-9ad095a73f3b None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:35.065477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7ab88-640a-4350-91c6-9ad095a73f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:35.084434 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-baa7ab88-640a-4350-91c6-9ad095a73f3b None None] MFA Rules not processed for user `a05e0301b8924b47ad228729f43e0c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:35.085695 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-baa7ab88-640a-4350-91c6-9ad095a73f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:35.092724 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1292/2600] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:11:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:43.691042 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=51 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:45.078698 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=26 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:50.623759 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4748e91-4dc8-447c-8af3-4c332efec2c4 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:50.624268 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4748e91-4dc8-447c-8af3-4c332efec2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:50.624370 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4748e91-4dc8-447c-8af3-4c332efec2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:50.642273 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-a4748e91-4dc8-447c-8af3-4c332efec2c4 None None] MFA Rules not processed for user `0dbf596d8f964d4695944a23dd8e4cef`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:50.643545 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-a4748e91-4dc8-447c-8af3-4c332efec2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:50.652298 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1309/2601] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 02:11:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:50.664472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7ab88-640a-4350-91c6-9ad095a73f3b None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:50.677431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7ab88-640a-4350-91c6-9ad095a73f3b None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:50.682854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc734c-d271-4f17-a577-413115748e6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae132c4d0b5461aa26ab929a017cb08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:50.683545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc734c-d271-4f17-a577-413115748e6e service swift] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:50.683834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc734c-d271-4f17-a577-413115748e6e service swift] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:50.684109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc734c-d271-4f17-a577-413115748e6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:50.693079 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc734c-d271-4f17-a577-413115748e6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:50.694793 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc734c-d271-4f17-a577-413115748e6e service swift] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:50.702978 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1293/2602] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 02:11:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 02:11:51.234723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc43a7-22a6-4a6b-815b-1b2671b45126 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:51.235076 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc43a7-22a6-4a6b-815b-1b2671b45126 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:51.235392 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc43a7-22a6-4a6b-815b-1b2671b45126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:51.254589 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-35dc43a7-22a6-4a6b-815b-1b2671b45126 None None] MFA Rules not processed for user `0dbf596d8f964d4695944a23dd8e4cef`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:51.255818 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-35dc43a7-22a6-4a6b-815b-1b2671b45126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:51.263668 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1310/2603] 10.222.0.13 () {58 vars in 967 bytes} [Thu Jun 23 02:11:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:51.275717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc734c-d271-4f17-a577-413115748e6e service swift] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:51.286610 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc734c-d271-4f17-a577-413115748e6e service swift] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:51.292056 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a639de9-6dc9-438a-86e5-c6dffcf5cc33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae132c4d0b5461aa26ab929a017cb08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:51.292707 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a639de9-6dc9-438a-86e5-c6dffcf5cc33 service swift] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:51.292982 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a639de9-6dc9-438a-86e5-c6dffcf5cc33 service swift] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:51.293590 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a639de9-6dc9-438a-86e5-c6dffcf5cc33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:51.303722 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a639de9-6dc9-438a-86e5-c6dffcf5cc33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:51.305425 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a639de9-6dc9-438a-86e5-c6dffcf5cc33 service swift] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:51.314136 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1294/2604] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 02:11:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 02:11:51.518316 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c02aa-1617-4ede-8e96-01c0c1f76289 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:51.518661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c02aa-1617-4ede-8e96-01c0c1f76289 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:51.518999 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c02aa-1617-4ede-8e96-01c0c1f76289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:51.538631 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-d79c02aa-1617-4ede-8e96-01c0c1f76289 None None] MFA Rules not processed for user `0dbf596d8f964d4695944a23dd8e4cef`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:51.541175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-d79c02aa-1617-4ede-8e96-01c0c1f76289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:51.554813 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1311/2605] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 02:11:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:51.571983 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a639de9-6dc9-438a-86e5-c6dffcf5cc33 service swift] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:51.583093 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a639de9-6dc9-438a-86e5-c6dffcf5cc33 service swift] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:51.588750 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f667131-9493-4d94-9895-367fb70ec865 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae132c4d0b5461aa26ab929a017cb08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:51.589673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f667131-9493-4d94-9895-367fb70ec865 service swift] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:51.590144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f667131-9493-4d94-9895-367fb70ec865 service swift] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:51.590617 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f667131-9493-4d94-9895-367fb70ec865 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:51.599803 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f667131-9493-4d94-9895-367fb70ec865 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:51.601620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f667131-9493-4d94-9895-367fb70ec865 service swift] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:51.610315 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1295/2606] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 02:11:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 02:11:51.976953 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4f34f-3dd5-4b4b-b947-c622f4801dd5 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:51.977425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4f34f-3dd5-4b4b-b947-c622f4801dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:51.977518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4f34f-3dd5-4b4b-b947-c622f4801dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:51.995348 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-43b4f34f-3dd5-4b4b-b947-c622f4801dd5 None None] MFA Rules not processed for user `0dbf596d8f964d4695944a23dd8e4cef`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:51.996612 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-43b4f34f-3dd5-4b4b-b947-c622f4801dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:52.007575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1312/2607] 10.222.0.13 () {58 vars in 967 bytes} [Thu Jun 23 02:11:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:52.016864 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f667131-9493-4d94-9895-367fb70ec865 service swift] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:52.028324 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f667131-9493-4d94-9895-367fb70ec865 service swift] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:52.033863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8146d-6286-466a-af89-682cc17d2711 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae132c4d0b5461aa26ab929a017cb08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:52.034500 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8146d-6286-466a-af89-682cc17d2711 service swift] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:52.034782 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8146d-6286-466a-af89-682cc17d2711 service swift] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:52.035057 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8146d-6286-466a-af89-682cc17d2711 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:52.043937 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8146d-6286-466a-af89-682cc17d2711 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:52.045519 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8146d-6286-466a-af89-682cc17d2711 service swift] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:52.053841 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1296/2608] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 02:11:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 02:11:52.198831 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5e3fd-eb56-4065-86b0-354ebeae2fe5 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:52.199170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5e3fd-eb56-4065-86b0-354ebeae2fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:52.199464 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5e3fd-eb56-4065-86b0-354ebeae2fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:52.219397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-65b5e3fd-eb56-4065-86b0-354ebeae2fe5 None None] MFA Rules not processed for user `0dbf596d8f964d4695944a23dd8e4cef`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:52.220874 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-65b5e3fd-eb56-4065-86b0-354ebeae2fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:52.228968 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1313/2609] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 23 02:11:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:52.242061 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8146d-6286-466a-af89-682cc17d2711 service swift] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:52.257019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8146d-6286-466a-af89-682cc17d2711 service swift] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:52.262470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976d762-e21c-4ddf-99a9-b19c07f76f88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae132c4d0b5461aa26ab929a017cb08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:52.264054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976d762-e21c-4ddf-99a9-b19c07f76f88 service swift] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:52.264054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976d762-e21c-4ddf-99a9-b19c07f76f88 service swift] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:52.264054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976d762-e21c-4ddf-99a9-b19c07f76f88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:52.272696 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976d762-e21c-4ddf-99a9-b19c07f76f88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:52.274281 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976d762-e21c-4ddf-99a9-b19c07f76f88 service swift] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:52.282459 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1297/2610] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 02:11:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 02:11:54.376523 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5e3fd-eb56-4065-86b0-354ebeae2fe5 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:54.449758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5e3fd-eb56-4065-86b0-354ebeae2fe5 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:54.454728 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57b42a-6ff7-49e9-8f5b-80b2afa57482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:54.455679 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57b42a-6ff7-49e9-8f5b-80b2afa57482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:54.455957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57b42a-6ff7-49e9-8f5b-80b2afa57482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:54.456228 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57b42a-6ff7-49e9-8f5b-80b2afa57482 admin admin] PATH_INFO: `/v3/users/a05e0301b8924b47ad228729f43e0c6a` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:54.457459 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57b42a-6ff7-49e9-8f5b-80b2afa57482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a05e0301b8924b47ad228729f43e0c6a)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:54.459444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57b42a-6ff7-49e9-8f5b-80b2afa57482 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:54.512639 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-3a57b42a-6ff7-49e9-8f5b-80b2afa57482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a05e0301b8924b47ad228729f43e0c6a'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:54.520790 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-3a57b42a-6ff7-49e9-8f5b-80b2afa57482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a05e0301b8924b47ad228729f43e0c6a'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:54.521586 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-3a57b42a-6ff7-49e9-8f5b-80b2afa57482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a05e0301b8924b47ad228729f43e0c6a'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:54.522269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-3a57b42a-6ff7-49e9-8f5b-80b2afa57482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a05e0301b8924b47ad228729f43e0c6a'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:54.536394 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-3a57b42a-6ff7-49e9-8f5b-80b2afa57482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a05e0301b8924b47ad228729f43e0c6a'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:54.552096 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1314/2611] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:11:54 2022] DELETE /identity/v3/users/a05e0301b8924b47ad228729f43e0c6a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:11:54.556921 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2203d-3499-4410-aa1a-f7b5ba13a26a None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:54.557427 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2203d-3499-4410-aa1a-f7b5ba13a26a None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:54.557564 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2203d-3499-4410-aa1a-f7b5ba13a26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:54.575781 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-dcd2203d-3499-4410-aa1a-f7b5ba13a26a None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:11:54.577290 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-dcd2203d-3499-4410-aa1a-f7b5ba13a26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:54.640502 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1298/2612] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:11:54.651196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57b42a-6ff7-49e9-8f5b-80b2afa57482 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:54.652956 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-3a57b42a-6ff7-49e9-8f5b-80b2afa57482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:54.713473 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:11:54.719059 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57b42a-6ff7-49e9-8f5b-80b2afa57482 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:54.726857 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3cd1d-93f0-4a34-b3fe-3b6ad013d4d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:54.727993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3cd1d-93f0-4a34-b3fe-3b6ad013d4d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:54.728327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3cd1d-93f0-4a34-b3fe-3b6ad013d4d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:54.728687 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3cd1d-93f0-4a34-b3fe-3b6ad013d4d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:54.739698 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3cd1d-93f0-4a34-b3fe-3b6ad013d4d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:54.741311 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3cd1d-93f0-4a34-b3fe-3b6ad013d4d7 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:54.752550 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1315/2613] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:11:54.941582 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2203d-3499-4410-aa1a-f7b5ba13a26a None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:11:54.943058 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-dcd2203d-3499-4410-aa1a-f7b5ba13a26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:11:54.955571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2203d-3499-4410-aa1a-f7b5ba13a26a None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:11:54.963314 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29010302-92ff-45c4-aca7-874265733392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:11:54.964244 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29010302-92ff-45c4-aca7-874265733392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:11:54.964525 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29010302-92ff-45c4-aca7-874265733392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:11:54.964800 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29010302-92ff-45c4-aca7-874265733392 admin admin] PATH_INFO: `/v3/projects/26e0dbd1a0784a9d8b6b86a5581facff` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:11:54.966009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29010302-92ff-45c4-aca7-874265733392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26e0dbd1a0784a9d8b6b86a5581facff)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:11:54.968101 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29010302-92ff-45c4-aca7-874265733392 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:11:55.020655 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-29010302-92ff-45c4-aca7-874265733392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26e0dbd1a0784a9d8b6b86a5581facff', 'request_id': 'req-29010302-92ff-45c4-aca7-874265733392'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:55.035220 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-29010302-92ff-45c4-aca7-874265733392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26e0dbd1a0784a9d8b6b86a5581facff', 'request_id': 'req-29010302-92ff-45c4-aca7-874265733392'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:55.041421 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-29010302-92ff-45c4-aca7-874265733392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26e0dbd1a0784a9d8b6b86a5581facff', 'request_id': 'req-29010302-92ff-45c4-aca7-874265733392'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:55.054026 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-29010302-92ff-45c4-aca7-874265733392 admin admin] The token cache is being invalidate because project 26e0dbd1a0784a9d8b6b86a5581facff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:11:55.054225 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-29010302-92ff-45c4-aca7-874265733392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:55.054880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-29010302-92ff-45c4-aca7-874265733392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:11:55.056600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1299/2614] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:11:54 2022] DELETE /identity/v3/projects/26e0dbd1a0784a9d8b6b86a5581facff => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:04.747390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=5 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:05.050922 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:13.533170 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f5cb4-47b6-4d66-b882-1686ed2329f7 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:13.533677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f5cb4-47b6-4d66-b882-1686ed2329f7 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:13.533903 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f5cb4-47b6-4d66-b882-1686ed2329f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:13.554986 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-7a2f5cb4-47b6-4d66-b882-1686ed2329f7 None None] MFA Rules not processed for user `0dbf596d8f964d4695944a23dd8e4cef`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:13.556300 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-7a2f5cb4-47b6-4d66-b882-1686ed2329f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:13.618575 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1316/2615] 10.222.0.13 () {58 vars in 967 bytes} [Thu Jun 23 02:12:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:12:13.631785 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29010302-92ff-45c4-aca7-874265733392 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:13.634012 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-29010302-92ff-45c4-aca7-874265733392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:13.705235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29010302-92ff-45c4-aca7-874265733392 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:13.710513 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f04235-7a09-43f5-8ab9-5b3963704a6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae132c4d0b5461aa26ab929a017cb08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:13.711177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f04235-7a09-43f5-8ab9-5b3963704a6d service swift] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:13.711492 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f04235-7a09-43f5-8ab9-5b3963704a6d service swift] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:13.711771 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f04235-7a09-43f5-8ab9-5b3963704a6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:13.719799 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f04235-7a09-43f5-8ab9-5b3963704a6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:13.721477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f04235-7a09-43f5-8ab9-5b3963704a6d service swift] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:13.729394 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1300/2616] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 23 02:12:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 02:12:21.402108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f5cb4-47b6-4d66-b882-1686ed2329f7 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:21.404237 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-7a2f5cb4-47b6-4d66-b882-1686ed2329f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:21.480537 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f5cb4-47b6-4d66-b882-1686ed2329f7 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:21.485798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d335f26-5e65-4e21-a3f6-f8ad5754bdb2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9756f5b9de8a4f23b365a96d309d86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:21.486469 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d335f26-5e65-4e21-a3f6-f8ad5754bdb2 service placement] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:21.486752 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d335f26-5e65-4e21-a3f6-f8ad5754bdb2 service placement] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:21.487030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d335f26-5e65-4e21-a3f6-f8ad5754bdb2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:21.488941 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-9d335f26-5e65-4e21-a3f6-f8ad5754bdb2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:21.501117 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d335f26-5e65-4e21-a3f6-f8ad5754bdb2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:21.502741 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d335f26-5e65-4e21-a3f6-f8ad5754bdb2 service placement] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:21.513034 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1317/2617] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:12:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:12:23.726278 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=32 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:27.083943 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f04235-7a09-43f5-8ab9-5b3963704a6d service swift] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:27.085547 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-f9f04235-7a09-43f5-8ab9-5b3963704a6d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:27.148850 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f04235-7a09-43f5-8ab9-5b3963704a6d service swift] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:27.153277 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1cbac-c8f3-4f6a-aad1-413765e5ce26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:27.153940 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1cbac-c8f3-4f6a-aad1-413765e5ce26 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:27.154250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1cbac-c8f3-4f6a-aad1-413765e5ce26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:27.154531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1cbac-c8f3-4f6a-aad1-413765e5ce26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:27.156736 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-49a1cbac-c8f3-4f6a-aad1-413765e5ce26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:27.220307 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1cbac-c8f3-4f6a-aad1-413765e5ce26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:27.221668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1cbac-c8f3-4f6a-aad1-413765e5ce26 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:27.232314 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1301/2618] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:12:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:12:30.380710 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d335f26-5e65-4e21-a3f6-f8ad5754bdb2 service placement] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:30.382239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-9d335f26-5e65-4e21-a3f6-f8ad5754bdb2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:30.396660 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d335f26-5e65-4e21-a3f6-f8ad5754bdb2 service placement] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:30.401289 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b0b15-e002-4e00-8cbd-b12277204fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:30.402179 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b0b15-e002-4e00-8cbd-b12277204fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:30.402463 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b0b15-e002-4e00-8cbd-b12277204fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:30.402739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b0b15-e002-4e00-8cbd-b12277204fbc admin admin] PATH_INFO: `/v3/users/042853e4abce41f9a3e8263d1fc8ac00` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:30.404021 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b0b15-e002-4e00-8cbd-b12277204fbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=042853e4abce41f9a3e8263d1fc8ac00)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:30.406656 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b0b15-e002-4e00-8cbd-b12277204fbc admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:30.457433 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-753b0b15-e002-4e00-8cbd-b12277204fbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042853e4abce41f9a3e8263d1fc8ac00'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:30.464748 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-753b0b15-e002-4e00-8cbd-b12277204fbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042853e4abce41f9a3e8263d1fc8ac00'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:30.465419 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-753b0b15-e002-4e00-8cbd-b12277204fbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042853e4abce41f9a3e8263d1fc8ac00'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:30.466020 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-753b0b15-e002-4e00-8cbd-b12277204fbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042853e4abce41f9a3e8263d1fc8ac00'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:30.479604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-753b0b15-e002-4e00-8cbd-b12277204fbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042853e4abce41f9a3e8263d1fc8ac00'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:30.495645 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1318/2619] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:12:30 2022] DELETE /identity/v3/users/042853e4abce41f9a3e8263d1fc8ac00 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:30.681852 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1cbac-c8f3-4f6a-aad1-413765e5ce26 service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:30.698019 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1cbac-c8f3-4f6a-aad1-413765e5ce26 service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:30.769509 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9ddbc-6ab9-42c5-8fbf-829c5801b48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:30.771158 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9ddbc-6ab9-42c5-8fbf-829c5801b48d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:30.771445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9ddbc-6ab9-42c5-8fbf-829c5801b48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:30.771748 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9ddbc-6ab9-42c5-8fbf-829c5801b48d admin admin] PATH_INFO: `/v3/projects/1768c8ce529f4c8abe6158f67088ba35` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:30.772963 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9ddbc-6ab9-42c5-8fbf-829c5801b48d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1768c8ce529f4c8abe6158f67088ba35)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:30.774955 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9ddbc-6ab9-42c5-8fbf-829c5801b48d admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:30.824758 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e1f9ddbc-6ab9-42c5-8fbf-829c5801b48d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1768c8ce529f4c8abe6158f67088ba35', 'request_id': 'req-e1f9ddbc-6ab9-42c5-8fbf-829c5801b48d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:30.827451 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:30.834600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e1f9ddbc-6ab9-42c5-8fbf-829c5801b48d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1768c8ce529f4c8abe6158f67088ba35', 'request_id': 'req-e1f9ddbc-6ab9-42c5-8fbf-829c5801b48d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:30.841409 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e1f9ddbc-6ab9-42c5-8fbf-829c5801b48d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1768c8ce529f4c8abe6158f67088ba35', 'request_id': 'req-e1f9ddbc-6ab9-42c5-8fbf-829c5801b48d'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:30.852578 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e1f9ddbc-6ab9-42c5-8fbf-829c5801b48d admin admin] The token cache is being invalidate because project 1768c8ce529f4c8abe6158f67088ba35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:12:30.852860 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e1f9ddbc-6ab9-42c5-8fbf-829c5801b48d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:30.853483 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-e1f9ddbc-6ab9-42c5-8fbf-829c5801b48d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:30.855032 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1302/2620] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:12:30 2022] DELETE /identity/v3/projects/1768c8ce529f4c8abe6158f67088ba35 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:30.860367 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b223eb-c652-4b75-bc67-2ea2f7e744d1 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:30.860628 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b223eb-c652-4b75-bc67-2ea2f7e744d1 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:30.860905 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b223eb-c652-4b75-bc67-2ea2f7e744d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:30.873240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:30.882555 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-29b223eb-c652-4b75-bc67-2ea2f7e744d1 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:30.884470 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-29b223eb-c652-4b75-bc67-2ea2f7e744d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:30.953755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1319/2621] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:12:30.961894 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231884dc-431e-4498-90a0-c55a24cf7c40 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:30.962183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231884dc-431e-4498-90a0-c55a24cf7c40 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:30.962463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231884dc-431e-4498-90a0-c55a24cf7c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:30.986162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-231884dc-431e-4498-90a0-c55a24cf7c40 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:30.987395 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-231884dc-431e-4498-90a0-c55a24cf7c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:30.996111 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1303/2622] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:12:31.002112 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b223eb-c652-4b75-bc67-2ea2f7e744d1 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:31.012484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b223eb-c652-4b75-bc67-2ea2f7e744d1 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:31.018742 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe326418-2397-47e4-8295-28394f4ca745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:31.019433 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe326418-2397-47e4-8295-28394f4ca745 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:31.019731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe326418-2397-47e4-8295-28394f4ca745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:31.020002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe326418-2397-47e4-8295-28394f4ca745 admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:31.020888 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe326418-2397-47e4-8295-28394f4ca745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:12:31.021201 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe326418-2397-47e4-8295-28394f4ca745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:31.022825 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe326418-2397-47e4-8295-28394f4ca745 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:31.035468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1320/2623] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:12:31.040231 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231884dc-431e-4498-90a0-c55a24cf7c40 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:31.050733 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231884dc-431e-4498-90a0-c55a24cf7c40 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:31.059283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4a8d8-c87b-4927-8bdf-d14a1f676779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:31.060155 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4a8d8-c87b-4927-8bdf-d14a1f676779 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:31.060857 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4a8d8-c87b-4927-8bdf-d14a1f676779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:31.061138 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4a8d8-c87b-4927-8bdf-d14a1f676779 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:31.061834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4a8d8-c87b-4927-8bdf-d14a1f676779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:31.063794 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4a8d8-c87b-4927-8bdf-d14a1f676779 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:31.095070 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1304/2624] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:12:31 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:12:31.099425 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe326418-2397-47e4-8295-28394f4ca745 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:31.110233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe326418-2397-47e4-8295-28394f4ca745 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:31.173832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b521f2-ac09-42b1-9d98-05209ce80cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:31.174505 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b521f2-ac09-42b1-9d98-05209ce80cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:31.174808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b521f2-ac09-42b1-9d98-05209ce80cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:31.175106 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b521f2-ac09-42b1-9d98-05209ce80cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:31.175831 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b521f2-ac09-42b1-9d98-05209ce80cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:31.177817 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b521f2-ac09-42b1-9d98-05209ce80cf3 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:31.199081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1321/2625] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:12:31 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:12:31.204787 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4a8d8-c87b-4927-8bdf-d14a1f676779 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:31.219370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4a8d8-c87b-4927-8bdf-d14a1f676779 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:31.225363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c8857-f00a-4294-9373-ef793fd9a1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:31.226301 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c8857-f00a-4294-9373-ef793fd9a1ae admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:31.226639 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c8857-f00a-4294-9373-ef793fd9a1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:31.226968 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c8857-f00a-4294-9373-ef793fd9a1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:31.228143 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c8857-f00a-4294-9373-ef793fd9a1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:31.230767 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c8857-f00a-4294-9373-ef793fd9a1ae admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:31.246892 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1305/2626] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:12:31.251057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b521f2-ac09-42b1-9d98-05209ce80cf3 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:31.261558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b521f2-ac09-42b1-9d98-05209ce80cf3 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:31.266655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4e098-736f-441a-a349-889af882bce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:31.267323 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4e098-736f-441a-a349-889af882bce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:31.267632 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4e098-736f-441a-a349-889af882bce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:31.267908 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4e098-736f-441a-a349-889af882bce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:31.268648 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4e098-736f-441a-a349-889af882bce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:31.270304 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4e098-736f-441a-a349-889af882bce1 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:31.280461 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1322/2627] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:12:31.286617 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c8857-f00a-4294-9373-ef793fd9a1ae admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:31.302686 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c8857-f00a-4294-9373-ef793fd9a1ae admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:31.310743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71cf6a8-91a5-4abe-aeaf-47f8ff653f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:31.311669 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cf6a8-91a5-4abe-aeaf-47f8ff653f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:31.311947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cf6a8-91a5-4abe-aeaf-47f8ff653f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:31.312218 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cf6a8-91a5-4abe-aeaf-47f8ff653f5f admin admin] PATH_INFO: `/v3/projects/72398bb0deae41be949c70d0900b4ce6/users/3715cea606024f0d9f3fb07ae5b3d45c/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:31.329499 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71cf6a8-91a5-4abe-aeaf-47f8ff653f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=72398bb0deae41be949c70d0900b4ce6, user_id=3715cea606024f0d9f3fb07ae5b3d45c, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:31.332336 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71cf6a8-91a5-4abe-aeaf-47f8ff653f5f admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:31.349315 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1306/2628] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:12:31 2022] PUT /identity/v3/projects/72398bb0deae41be949c70d0900b4ce6/users/3715cea606024f0d9f3fb07ae5b3d45c/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:31.359719 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb57ee-668c-415e-8697-913ca760c5f7 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:31.360006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb57ee-668c-415e-8697-913ca760c5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:31.360277 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb57ee-668c-415e-8697-913ca760c5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:31.388304 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-b1cb57ee-668c-415e-8697-913ca760c5f7 None None] MFA Rules not processed for user `3715cea606024f0d9f3fb07ae5b3d45c`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:31.390037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-b1cb57ee-668c-415e-8697-913ca760c5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:31.459009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1323/2629] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:12:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:12:31.471129 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71cf6a8-91a5-4abe-aeaf-47f8ff653f5f admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:31.473205 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-d71cf6a8-91a5-4abe-aeaf-47f8ff653f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:31.548127 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71cf6a8-91a5-4abe-aeaf-47f8ff653f5f admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:31.553989 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3f6ef-3562-40ee-832f-a9a3b44f722a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:31.554645 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3f6ef-3562-40ee-832f-a9a3b44f722a service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:31.554927 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3f6ef-3562-40ee-832f-a9a3b44f722a service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:31.555192 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3f6ef-3562-40ee-832f-a9a3b44f722a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:31.563165 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3f6ef-3562-40ee-832f-a9a3b44f722a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:31.564728 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3f6ef-3562-40ee-832f-a9a3b44f722a service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:31.573410 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1307/2630] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:12:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:12:36.851883 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb57ee-668c-415e-8697-913ca760c5f7 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:36.855304 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:36.921228 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb57ee-668c-415e-8697-913ca760c5f7 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:36.928444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955db246-591b-4973-91a8-0850fe03f03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:36.929348 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955db246-591b-4973-91a8-0850fe03f03f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:36.929629 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955db246-591b-4973-91a8-0850fe03f03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:36.929905 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955db246-591b-4973-91a8-0850fe03f03f admin admin] PATH_INFO: `/v3/users/3715cea606024f0d9f3fb07ae5b3d45c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:36.931237 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955db246-591b-4973-91a8-0850fe03f03f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3715cea606024f0d9f3fb07ae5b3d45c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:36.933274 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955db246-591b-4973-91a8-0850fe03f03f admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:36.987405 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-955db246-591b-4973-91a8-0850fe03f03f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3715cea606024f0d9f3fb07ae5b3d45c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:36.994251 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-955db246-591b-4973-91a8-0850fe03f03f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3715cea606024f0d9f3fb07ae5b3d45c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:36.994915 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-955db246-591b-4973-91a8-0850fe03f03f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3715cea606024f0d9f3fb07ae5b3d45c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:36.995558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-955db246-591b-4973-91a8-0850fe03f03f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3715cea606024f0d9f3fb07ae5b3d45c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:37.007822 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-955db246-591b-4973-91a8-0850fe03f03f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3715cea606024f0d9f3fb07ae5b3d45c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:37.022572 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1324/2631] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:12:36 2022] DELETE /identity/v3/users/3715cea606024f0d9f3fb07ae5b3d45c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:37.027192 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad26ce6-6faf-49d7-a59f-b2048207bba2 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:37.027736 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad26ce6-6faf-49d7-a59f-b2048207bba2 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:37.027736 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad26ce6-6faf-49d7-a59f-b2048207bba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:37.046339 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-1ad26ce6-6faf-49d7-a59f-b2048207bba2 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:37.047619 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-1ad26ce6-6faf-49d7-a59f-b2048207bba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:37.122668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1308/2632] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:12:37.137602 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955db246-591b-4973-91a8-0850fe03f03f admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:37.139077 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-955db246-591b-4973-91a8-0850fe03f03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:37.204729 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955db246-591b-4973-91a8-0850fe03f03f admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:37.208977 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90fa06-0c8d-452a-b918-2e96786c583c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:37.209653 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90fa06-0c8d-452a-b918-2e96786c583c service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:37.209933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90fa06-0c8d-452a-b918-2e96786c583c service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:37.210201 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90fa06-0c8d-452a-b918-2e96786c583c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:37.220166 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd90fa06-0c8d-452a-b918-2e96786c583c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:37.221643 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd90fa06-0c8d-452a-b918-2e96786c583c service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:37.231265 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1325/2633] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:12:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 02:12:37.516064 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad26ce6-6faf-49d7-a59f-b2048207bba2 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:37.518131 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-1ad26ce6-6faf-49d7-a59f-b2048207bba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:37.525216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:37.537317 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad26ce6-6faf-49d7-a59f-b2048207bba2 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:37.544850 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5517a1-9b96-4ea5-8f02-bff37a6d0298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:37.545745 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5517a1-9b96-4ea5-8f02-bff37a6d0298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:37.546016 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5517a1-9b96-4ea5-8f02-bff37a6d0298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:37.546296 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5517a1-9b96-4ea5-8f02-bff37a6d0298 admin admin] PATH_INFO: `/v3/projects/72398bb0deae41be949c70d0900b4ce6` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:37.547595 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5517a1-9b96-4ea5-8f02-bff37a6d0298 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72398bb0deae41be949c70d0900b4ce6)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:37.549650 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5517a1-9b96-4ea5-8f02-bff37a6d0298 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:37.598326 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-4a5517a1-9b96-4ea5-8f02-bff37a6d0298 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72398bb0deae41be949c70d0900b4ce6', 'request_id': 'req-4a5517a1-9b96-4ea5-8f02-bff37a6d0298'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:37.607277 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-4a5517a1-9b96-4ea5-8f02-bff37a6d0298 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72398bb0deae41be949c70d0900b4ce6', 'request_id': 'req-4a5517a1-9b96-4ea5-8f02-bff37a6d0298'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:37.613134 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-4a5517a1-9b96-4ea5-8f02-bff37a6d0298 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72398bb0deae41be949c70d0900b4ce6', 'request_id': 'req-4a5517a1-9b96-4ea5-8f02-bff37a6d0298'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:37.624272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-4a5517a1-9b96-4ea5-8f02-bff37a6d0298 admin admin] The token cache is being invalidate because project 72398bb0deae41be949c70d0900b4ce6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:12:37.624559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-4a5517a1-9b96-4ea5-8f02-bff37a6d0298 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:37.625207 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-4a5517a1-9b96-4ea5-8f02-bff37a6d0298 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:37.627090 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1309/2634] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:12:37 2022] DELETE /identity/v3/projects/72398bb0deae41be949c70d0900b4ce6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:37.632283 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94382137-ee2c-46df-9edf-70fbe858f6bd None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:37.632590 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94382137-ee2c-46df-9edf-70fbe858f6bd None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:37.632866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94382137-ee2c-46df-9edf-70fbe858f6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:37.651099 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-94382137-ee2c-46df-9edf-70fbe858f6bd None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:37.652445 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-94382137-ee2c-46df-9edf-70fbe858f6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:37.674402 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:37.716852 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1326/2635] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:12:37.725130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e02ff-479a-46b4-823b-0f961cbfb0c4 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:37.725426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e02ff-479a-46b4-823b-0f961cbfb0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:37.725706 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e02ff-479a-46b4-823b-0f961cbfb0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:37.745696 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-8f8e02ff-479a-46b4-823b-0f961cbfb0c4 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:37.746924 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-8f8e02ff-479a-46b4-823b-0f961cbfb0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:37.759557 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1310/2636] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:12:37.764259 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94382137-ee2c-46df-9edf-70fbe858f6bd None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:37.775896 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94382137-ee2c-46df-9edf-70fbe858f6bd None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:37.780554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891914b-0d53-466b-8cf7-77400163bfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:37.781218 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891914b-0d53-466b-8cf7-77400163bfe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:37.781500 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891914b-0d53-466b-8cf7-77400163bfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:37.781777 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891914b-0d53-466b-8cf7-77400163bfe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:37.782583 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891914b-0d53-466b-8cf7-77400163bfe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:12:37.782872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891914b-0d53-466b-8cf7-77400163bfe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:37.784524 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891914b-0d53-466b-8cf7-77400163bfe7 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:37.796523 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1327/2637] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 02:12:37.800944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e02ff-479a-46b4-823b-0f961cbfb0c4 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:37.810200 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e02ff-479a-46b4-823b-0f961cbfb0c4 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:37.815611 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee344ceb-25a3-4cb1-8beb-fc7640f62ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:37.816276 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee344ceb-25a3-4cb1-8beb-fc7640f62ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:37.816560 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee344ceb-25a3-4cb1-8beb-fc7640f62ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:37.816839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee344ceb-25a3-4cb1-8beb-fc7640f62ad7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:37.817547 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee344ceb-25a3-4cb1-8beb-fc7640f62ad7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:37.819501 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee344ceb-25a3-4cb1-8beb-fc7640f62ad7 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:37.845904 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1311/2638] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:12:37 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:12:37.850247 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891914b-0d53-466b-8cf7-77400163bfe7 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:37.860779 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891914b-0d53-466b-8cf7-77400163bfe7 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:37.920917 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e114096-44a5-46f0-8c7a-c98f7a95cb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:37.921580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e114096-44a5-46f0-8c7a-c98f7a95cb37 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:37.921863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e114096-44a5-46f0-8c7a-c98f7a95cb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:37.922136 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e114096-44a5-46f0-8c7a-c98f7a95cb37 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:37.922913 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e114096-44a5-46f0-8c7a-c98f7a95cb37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:37.924897 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e114096-44a5-46f0-8c7a-c98f7a95cb37 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:37.947209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1328/2639] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:12:37 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:12:37.951393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee344ceb-25a3-4cb1-8beb-fc7640f62ad7 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:37.962250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee344ceb-25a3-4cb1-8beb-fc7640f62ad7 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:37.967670 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249ec15-7bb0-4721-a313-965dc0fcefaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:37.968272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249ec15-7bb0-4721-a313-965dc0fcefaa admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:37.968547 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249ec15-7bb0-4721-a313-965dc0fcefaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:37.968805 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249ec15-7bb0-4721-a313-965dc0fcefaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:37.969530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249ec15-7bb0-4721-a313-965dc0fcefaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:37.971274 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249ec15-7bb0-4721-a313-965dc0fcefaa admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:37.982197 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1312/2640] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:12:37.986077 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e114096-44a5-46f0-8c7a-c98f7a95cb37 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:37.996310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e114096-44a5-46f0-8c7a-c98f7a95cb37 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:38.001497 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ed0cc-2ef4-4012-8b5a-813ccaa4e8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:38.002163 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ed0cc-2ef4-4012-8b5a-813ccaa4e8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:38.002450 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ed0cc-2ef4-4012-8b5a-813ccaa4e8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:38.002727 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ed0cc-2ef4-4012-8b5a-813ccaa4e8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:38.003453 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ed0cc-2ef4-4012-8b5a-813ccaa4e8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:38.005111 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ed0cc-2ef4-4012-8b5a-813ccaa4e8d0 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:38.015248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1329/2641] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:12:38.019490 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249ec15-7bb0-4721-a313-965dc0fcefaa admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:38.030107 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249ec15-7bb0-4721-a313-965dc0fcefaa admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:38.036005 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba2dd3-9b01-4735-82b6-2690ccfbf572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:38.036898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba2dd3-9b01-4735-82b6-2690ccfbf572 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:38.037190 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba2dd3-9b01-4735-82b6-2690ccfbf572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:38.037459 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba2dd3-9b01-4735-82b6-2690ccfbf572 admin admin] PATH_INFO: `/v3/projects/55fd5bc17769417caa953bfdcefe1a22/users/cbee0a4d08364687b16dd70be6b3e838/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:38.053455 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba2dd3-9b01-4735-82b6-2690ccfbf572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55fd5bc17769417caa953bfdcefe1a22, user_id=cbee0a4d08364687b16dd70be6b3e838, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:38.056200 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba2dd3-9b01-4735-82b6-2690ccfbf572 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:38.070919 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1313/2642] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:12:38 2022] PUT /identity/v3/projects/55fd5bc17769417caa953bfdcefe1a22/users/cbee0a4d08364687b16dd70be6b3e838/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:38.081367 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ae7eb-274b-4d0a-8f40-114ad4962e93 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:38.081655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ae7eb-274b-4d0a-8f40-114ad4962e93 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:38.081929 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ae7eb-274b-4d0a-8f40-114ad4962e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:38.110863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-e42ae7eb-274b-4d0a-8f40-114ad4962e93 None None] MFA Rules not processed for user `cbee0a4d08364687b16dd70be6b3e838`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:38.112212 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-e42ae7eb-274b-4d0a-8f40-114ad4962e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:38.179842 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1330/2643] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:12:38 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:12:38.184593 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba2dd3-9b01-4735-82b6-2690ccfbf572 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:38.250913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba2dd3-9b01-4735-82b6-2690ccfbf572 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:38.259836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9bd55-51cc-4a74-82b2-ec75c1af3683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:38.260881 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9bd55-51cc-4a74-82b2-ec75c1af3683 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:38.261224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9bd55-51cc-4a74-82b2-ec75c1af3683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:38.261499 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9bd55-51cc-4a74-82b2-ec75c1af3683 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:38.262607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9bd55-51cc-4a74-82b2-ec75c1af3683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:38.265807 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9bd55-51cc-4a74-82b2-ec75c1af3683 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:38.293691 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1314/2644] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:12:38 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:12:38.297894 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ae7eb-274b-4d0a-8f40-114ad4962e93 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:38.309162 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ae7eb-274b-4d0a-8f40-114ad4962e93 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:38.326159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:38.369927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd0eaa-4654-4dcc-9066-49e773c037d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:38.370598 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd0eaa-4654-4dcc-9066-49e773c037d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:38.370874 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd0eaa-4654-4dcc-9066-49e773c037d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:38.371143 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd0eaa-4654-4dcc-9066-49e773c037d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:38.371867 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd0eaa-4654-4dcc-9066-49e773c037d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:38.373802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd0eaa-4654-4dcc-9066-49e773c037d3 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:38.394802 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1331/2645] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:12:38 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:12:38.398933 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9bd55-51cc-4a74-82b2-ec75c1af3683 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:38.409779 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9bd55-51cc-4a74-82b2-ec75c1af3683 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:38.417068 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa975dba-adce-4949-8deb-adac320dae77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:38.418079 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa975dba-adce-4949-8deb-adac320dae77 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:38.418806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa975dba-adce-4949-8deb-adac320dae77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:38.419178 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa975dba-adce-4949-8deb-adac320dae77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:38.420387 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa975dba-adce-4949-8deb-adac320dae77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:38.422878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa975dba-adce-4949-8deb-adac320dae77 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:38.424830 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:38.439483 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1315/2646] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:12:38.443774 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd0eaa-4654-4dcc-9066-49e773c037d3 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:38.454749 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd0eaa-4654-4dcc-9066-49e773c037d3 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:38.460955 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bf493-13c0-4b06-b552-d6a2da38d376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:38.461835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bf493-13c0-4b06-b552-d6a2da38d376 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:38.462115 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bf493-13c0-4b06-b552-d6a2da38d376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:38.462385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bf493-13c0-4b06-b552-d6a2da38d376 admin admin] PATH_INFO: `/v3/projects/4988d55055be4add9fe12b0b0907e3ea/users/44b263b1c1db49a5847b7c9f79cd1c83/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:38.477963 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bf493-13c0-4b06-b552-d6a2da38d376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4988d55055be4add9fe12b0b0907e3ea, user_id=44b263b1c1db49a5847b7c9f79cd1c83, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:38.480676 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bf493-13c0-4b06-b552-d6a2da38d376 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:38.495359 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1332/2647] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:12:38 2022] PUT /identity/v3/projects/4988d55055be4add9fe12b0b0907e3ea/users/44b263b1c1db49a5847b7c9f79cd1c83/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:12:38.499584 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa975dba-adce-4949-8deb-adac320dae77 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:38.509884 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa975dba-adce-4949-8deb-adac320dae77 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:38.572177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe184621-be4f-4194-af48-919cfea97c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:38.572854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe184621-be4f-4194-af48-919cfea97c93 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:38.573139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe184621-be4f-4194-af48-919cfea97c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:38.573418 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe184621-be4f-4194-af48-919cfea97c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:38.574157 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe184621-be4f-4194-af48-919cfea97c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:38.575825 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe184621-be4f-4194-af48-919cfea97c93 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:38.585644 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1316/2648] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:12:38.589918 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bf493-13c0-4b06-b552-d6a2da38d376 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:38.600342 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bf493-13c0-4b06-b552-d6a2da38d376 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:38.605902 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6270263-72fe-4f88-a6d4-44cb5b654552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:38.606797 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6270263-72fe-4f88-a6d4-44cb5b654552 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:38.607073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6270263-72fe-4f88-a6d4-44cb5b654552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:38.607341 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6270263-72fe-4f88-a6d4-44cb5b654552 admin admin] PATH_INFO: `/v3/projects/4988d55055be4add9fe12b0b0907e3ea/users/44b263b1c1db49a5847b7c9f79cd1c83/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:38.609552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6270263-72fe-4f88-a6d4-44cb5b654552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4988d55055be4add9fe12b0b0907e3ea, user_id=44b263b1c1db49a5847b7c9f79cd1c83, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:38.612312 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6270263-72fe-4f88-a6d4-44cb5b654552 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:38.623070 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1333/2649] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:12:38 2022] PUT /identity/v3/projects/4988d55055be4add9fe12b0b0907e3ea/users/44b263b1c1db49a5847b7c9f79cd1c83/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:38.634692 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4618a33-3186-4da9-9913-cd7bd76bc43c None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:38.634980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4618a33-3186-4da9-9913-cd7bd76bc43c None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:38.635249 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4618a33-3186-4da9-9913-cd7bd76bc43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:38.663187 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-a4618a33-3186-4da9-9913-cd7bd76bc43c None None] MFA Rules not processed for user `44b263b1c1db49a5847b7c9f79cd1c83`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:38.664470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a4618a33-3186-4da9-9913-cd7bd76bc43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:38.734180 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1317/2650] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:12:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:12:38.746013 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6270263-72fe-4f88-a6d4-44cb5b654552 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:38.748088 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-d6270263-72fe-4f88-a6d4-44cb5b654552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:38.823487 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6270263-72fe-4f88-a6d4-44cb5b654552 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:38.830281 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70796e18-883d-4917-ba87-b069731ac4e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:38.830932 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70796e18-883d-4917-ba87-b069731ac4e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:38.831184 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70796e18-883d-4917-ba87-b069731ac4e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:38.831475 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70796e18-883d-4917-ba87-b069731ac4e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:38.841700 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70796e18-883d-4917-ba87-b069731ac4e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:38.843156 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70796e18-883d-4917-ba87-b069731ac4e7 service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:38.852939 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1334/2651] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:12:38 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:12:38.932595 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4618a33-3186-4da9-9913-cd7bd76bc43c None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:38.947702 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4618a33-3186-4da9-9913-cd7bd76bc43c None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:38.953577 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca7b8c-6182-4ec4-8721-7afbdedea427 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:38.954321 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca7b8c-6182-4ec4-8721-7afbdedea427 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:38.954608 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca7b8c-6182-4ec4-8721-7afbdedea427 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:38.954901 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca7b8c-6182-4ec4-8721-7afbdedea427 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:39.021681 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca7b8c-6182-4ec4-8721-7afbdedea427 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:39.023174 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca7b8c-6182-4ec4-8721-7afbdedea427 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:39.032602 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1318/2652] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:12:38 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:12:46.122661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70796e18-883d-4917-ba87-b069731ac4e7 service cinder] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:46.186130 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70796e18-883d-4917-ba87-b069731ac4e7 service cinder] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:46.190865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406b8b9-7f99-4321-9cd4-a21e3ff2c0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:46.191956 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406b8b9-7f99-4321-9cd4-a21e3ff2c0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:46.192229 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406b8b9-7f99-4321-9cd4-a21e3ff2c0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:46.192440 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406b8b9-7f99-4321-9cd4-a21e3ff2c0d0 admin admin] PATH_INFO: `/v3/users/cbee0a4d08364687b16dd70be6b3e838` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:46.193659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406b8b9-7f99-4321-9cd4-a21e3ff2c0d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbee0a4d08364687b16dd70be6b3e838)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:46.195660 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406b8b9-7f99-4321-9cd4-a21e3ff2c0d0 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:46.211385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:46.246173 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-4406b8b9-7f99-4321-9cd4-a21e3ff2c0d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbee0a4d08364687b16dd70be6b3e838'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:46.253136 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-4406b8b9-7f99-4321-9cd4-a21e3ff2c0d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbee0a4d08364687b16dd70be6b3e838'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:46.253811 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-4406b8b9-7f99-4321-9cd4-a21e3ff2c0d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbee0a4d08364687b16dd70be6b3e838'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:46.254460 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-4406b8b9-7f99-4321-9cd4-a21e3ff2c0d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbee0a4d08364687b16dd70be6b3e838'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:46.266583 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-4406b8b9-7f99-4321-9cd4-a21e3ff2c0d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbee0a4d08364687b16dd70be6b3e838'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:46.282803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1335/2653] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:12:46 2022] DELETE /identity/v3/users/cbee0a4d08364687b16dd70be6b3e838 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:46.288751 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65618933-dcd7-43f9-a828-b1ef1c6a8ef6 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:46.289250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65618933-dcd7-43f9-a828-b1ef1c6a8ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:46.289378 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65618933-dcd7-43f9-a828-b1ef1c6a8ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:46.308628 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-65618933-dcd7-43f9-a828-b1ef1c6a8ef6 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:46.309899 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-65618933-dcd7-43f9-a828-b1ef1c6a8ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:46.320347 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=100 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:46.374557 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1319/2654] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:12:46.384590 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406b8b9-7f99-4321-9cd4-a21e3ff2c0d0 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:46.386129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-4406b8b9-7f99-4321-9cd4-a21e3ff2c0d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:46.444798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406b8b9-7f99-4321-9cd4-a21e3ff2c0d0 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:46.448773 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0d1cb-9919-4b27-a529-44c8a4890dbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:46.449435 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0d1cb-9919-4b27-a529-44c8a4890dbb service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:46.449713 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0d1cb-9919-4b27-a529-44c8a4890dbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:46.449972 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0d1cb-9919-4b27-a529-44c8a4890dbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:46.459691 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0d1cb-9919-4b27-a529-44c8a4890dbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:46.461157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0d1cb-9919-4b27-a529-44c8a4890dbb service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:46.470775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1336/2655] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:12:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:12:46.788147 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65618933-dcd7-43f9-a828-b1ef1c6a8ef6 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:46.789789 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-65618933-dcd7-43f9-a828-b1ef1c6a8ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:46.805304 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65618933-dcd7-43f9-a828-b1ef1c6a8ef6 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:46.810656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81e9a1-6b64-4088-9839-23f25a905ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:46.812495 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81e9a1-6b64-4088-9839-23f25a905ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:46.812898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81e9a1-6b64-4088-9839-23f25a905ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:46.813295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81e9a1-6b64-4088-9839-23f25a905ef6 admin admin] PATH_INFO: `/v3/projects/55fd5bc17769417caa953bfdcefe1a22` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:46.814838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81e9a1-6b64-4088-9839-23f25a905ef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55fd5bc17769417caa953bfdcefe1a22)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:46.817353 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81e9a1-6b64-4088-9839-23f25a905ef6 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:46.867792 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-5d81e9a1-6b64-4088-9839-23f25a905ef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55fd5bc17769417caa953bfdcefe1a22', 'request_id': 'req-5d81e9a1-6b64-4088-9839-23f25a905ef6'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:46.876100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-5d81e9a1-6b64-4088-9839-23f25a905ef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55fd5bc17769417caa953bfdcefe1a22', 'request_id': 'req-5d81e9a1-6b64-4088-9839-23f25a905ef6'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:46.882885 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-5d81e9a1-6b64-4088-9839-23f25a905ef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55fd5bc17769417caa953bfdcefe1a22', 'request_id': 'req-5d81e9a1-6b64-4088-9839-23f25a905ef6'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:46.893994 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-5d81e9a1-6b64-4088-9839-23f25a905ef6 admin admin] The token cache is being invalidate because project 55fd5bc17769417caa953bfdcefe1a22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:12:46.894287 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-5d81e9a1-6b64-4088-9839-23f25a905ef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:46.894940 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-5d81e9a1-6b64-4088-9839-23f25a905ef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:46.896540 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1320/2656] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:12:46 2022] DELETE /identity/v3/projects/55fd5bc17769417caa953bfdcefe1a22 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:46.900947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0d1cb-9919-4b27-a529-44c8a4890dbb service neutron] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:46.910874 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0d1cb-9919-4b27-a529-44c8a4890dbb service neutron] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:46.971620 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55eb94-fec9-4d77-b893-42e665ddcdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:46.972435 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55eb94-fec9-4d77-b893-42e665ddcdfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:46.972704 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55eb94-fec9-4d77-b893-42e665ddcdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:46.972981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55eb94-fec9-4d77-b893-42e665ddcdfd admin admin] PATH_INFO: `/v3/users/44b263b1c1db49a5847b7c9f79cd1c83` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:46.974180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55eb94-fec9-4d77-b893-42e665ddcdfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=44b263b1c1db49a5847b7c9f79cd1c83)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:46.976179 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55eb94-fec9-4d77-b893-42e665ddcdfd admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:47.025400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:47.033685 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-0c55eb94-fec9-4d77-b893-42e665ddcdfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44b263b1c1db49a5847b7c9f79cd1c83'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:47.041008 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-0c55eb94-fec9-4d77-b893-42e665ddcdfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44b263b1c1db49a5847b7c9f79cd1c83'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:47.041738 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-0c55eb94-fec9-4d77-b893-42e665ddcdfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44b263b1c1db49a5847b7c9f79cd1c83'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:47.042414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-0c55eb94-fec9-4d77-b893-42e665ddcdfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44b263b1c1db49a5847b7c9f79cd1c83'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:47.055267 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-0c55eb94-fec9-4d77-b893-42e665ddcdfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44b263b1c1db49a5847b7c9f79cd1c83'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:47.070000 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1337/2657] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:12:46 2022] DELETE /identity/v3/users/44b263b1c1db49a5847b7c9f79cd1c83 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:47.350490 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81e9a1-6b64-4088-9839-23f25a905ef6 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:47.352085 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-5d81e9a1-6b64-4088-9839-23f25a905ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:47.366442 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81e9a1-6b64-4088-9839-23f25a905ef6 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:47.428355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9a63c-2827-446b-a155-baba7006b846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:47.429301 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9a63c-2827-446b-a155-baba7006b846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:47.429581 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9a63c-2827-446b-a155-baba7006b846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:47.429855 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9a63c-2827-446b-a155-baba7006b846 admin admin] PATH_INFO: `/v3/projects/4988d55055be4add9fe12b0b0907e3ea` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:47.431194 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9a63c-2827-446b-a155-baba7006b846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4988d55055be4add9fe12b0b0907e3ea)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:47.433252 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9a63c-2827-446b-a155-baba7006b846 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:47.477551 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:47.485665 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-00c9a63c-2827-446b-a155-baba7006b846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4988d55055be4add9fe12b0b0907e3ea', 'request_id': 'req-00c9a63c-2827-446b-a155-baba7006b846'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:47.494905 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-00c9a63c-2827-446b-a155-baba7006b846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4988d55055be4add9fe12b0b0907e3ea', 'request_id': 'req-00c9a63c-2827-446b-a155-baba7006b846'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:47.502926 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-00c9a63c-2827-446b-a155-baba7006b846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4988d55055be4add9fe12b0b0907e3ea', 'request_id': 'req-00c9a63c-2827-446b-a155-baba7006b846'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:47.515025 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-00c9a63c-2827-446b-a155-baba7006b846 admin admin] The token cache is being invalidate because project 4988d55055be4add9fe12b0b0907e3ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:12:47.515311 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-00c9a63c-2827-446b-a155-baba7006b846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:47.516004 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-00c9a63c-2827-446b-a155-baba7006b846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:47.517604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1321/2658] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:12:47 2022] DELETE /identity/v3/projects/4988d55055be4add9fe12b0b0907e3ea => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:12:47.523565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43878813-3fd5-4254-b662-405d3fe0e831 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:47.524051 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43878813-3fd5-4254-b662-405d3fe0e831 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:47.524147 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43878813-3fd5-4254-b662-405d3fe0e831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:47.542602 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-43878813-3fd5-4254-b662-405d3fe0e831 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:47.544163 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-43878813-3fd5-4254-b662-405d3fe0e831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:47.605606 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1338/2659] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:12:47.613745 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9e83c-ca61-431d-8893-157ec53a736e None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:47.614032 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9e83c-ca61-431d-8893-157ec53a736e None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:47.614317 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9e83c-ca61-431d-8893-157ec53a736e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:47.634839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-92c9e83c-ca61-431d-8893-157ec53a736e None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:47.636112 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-92c9e83c-ca61-431d-8893-157ec53a736e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:47.646064 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1322/2660] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:12:47.652560 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43878813-3fd5-4254-b662-405d3fe0e831 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:47.666131 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43878813-3fd5-4254-b662-405d3fe0e831 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:47.672363 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68526a4c-a745-45f0-a768-238ba747df72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:47.673048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68526a4c-a745-45f0-a768-238ba747df72 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:47.673325 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68526a4c-a745-45f0-a768-238ba747df72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:47.673593 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68526a4c-a745-45f0-a768-238ba747df72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:47.674307 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68526a4c-a745-45f0-a768-238ba747df72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:12:47.674615 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68526a4c-a745-45f0-a768-238ba747df72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:47.676276 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68526a4c-a745-45f0-a768-238ba747df72 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:47.689057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1339/2661] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:12:47.693700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9e83c-ca61-431d-8893-157ec53a736e None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:47.703567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9e83c-ca61-431d-8893-157ec53a736e None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:47.709723 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d47abe-966a-4b5e-b43a-7190ff819e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:47.710387 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d47abe-966a-4b5e-b43a-7190ff819e21 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:47.710670 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d47abe-966a-4b5e-b43a-7190ff819e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:47.710948 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d47abe-966a-4b5e-b43a-7190ff819e21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:47.711688 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d47abe-966a-4b5e-b43a-7190ff819e21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:47.713628 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d47abe-966a-4b5e-b43a-7190ff819e21 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:47.745196 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1323/2662] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:12:47 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:12:47.749529 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68526a4c-a745-45f0-a768-238ba747df72 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:47.760466 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68526a4c-a745-45f0-a768-238ba747df72 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:47.819271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84f121-1c51-41e2-879c-7dcc35cd2e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:47.820040 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84f121-1c51-41e2-879c-7dcc35cd2e61 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:47.820327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84f121-1c51-41e2-879c-7dcc35cd2e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:47.820586 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84f121-1c51-41e2-879c-7dcc35cd2e61 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:47.821279 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84f121-1c51-41e2-879c-7dcc35cd2e61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:47.823330 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84f121-1c51-41e2-879c-7dcc35cd2e61 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:47.851057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1340/2663] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:12:47 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:12:47.859187 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d47abe-966a-4b5e-b43a-7190ff819e21 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:47.870181 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d47abe-966a-4b5e-b43a-7190ff819e21 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:47.875105 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ad6a6-267a-4e0f-b4d9-e61905372d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:47.875822 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ad6a6-267a-4e0f-b4d9-e61905372d53 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:47.876107 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ad6a6-267a-4e0f-b4d9-e61905372d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:47.876386 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ad6a6-267a-4e0f-b4d9-e61905372d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:47.877125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ad6a6-267a-4e0f-b4d9-e61905372d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:47.878802 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ad6a6-267a-4e0f-b4d9-e61905372d53 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:47.889672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1324/2664] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:12:47.893889 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84f121-1c51-41e2-879c-7dcc35cd2e61 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:47.904714 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84f121-1c51-41e2-879c-7dcc35cd2e61 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:47.910613 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663d4e2-de73-409f-aae9-88fcd11b84c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:47.911490 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663d4e2-de73-409f-aae9-88fcd11b84c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:47.911772 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663d4e2-de73-409f-aae9-88fcd11b84c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:47.912046 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663d4e2-de73-409f-aae9-88fcd11b84c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:47.912788 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663d4e2-de73-409f-aae9-88fcd11b84c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:47.914415 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663d4e2-de73-409f-aae9-88fcd11b84c5 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:47.926473 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1341/2665] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:12:47.930154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ad6a6-267a-4e0f-b4d9-e61905372d53 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:47.941263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ad6a6-267a-4e0f-b4d9-e61905372d53 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:47.946810 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f8d84-1eb3-4110-bedf-4b4a13079562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:47.947743 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f8d84-1eb3-4110-bedf-4b4a13079562 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:47.948022 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f8d84-1eb3-4110-bedf-4b4a13079562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:47.948299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f8d84-1eb3-4110-bedf-4b4a13079562 admin admin] PATH_INFO: `/v3/projects/e2b2b92f486b4bdd9850ebae67b7a762/users/dd667d6988ce40289dd48fd1b4394655/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:47.964611 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f8d84-1eb3-4110-bedf-4b4a13079562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b2b92f486b4bdd9850ebae67b7a762, user_id=dd667d6988ce40289dd48fd1b4394655, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:47.967292 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f8d84-1eb3-4110-bedf-4b4a13079562 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:47.982926 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1325/2666] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:12:47 2022] PUT /identity/v3/projects/e2b2b92f486b4bdd9850ebae67b7a762/users/dd667d6988ce40289dd48fd1b4394655/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:47.994920 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc429e6-61e0-4a6f-8d19-2d5242eb1cad None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:47.995188 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc429e6-61e0-4a6f-8d19-2d5242eb1cad None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:47.995633 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc429e6-61e0-4a6f-8d19-2d5242eb1cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:48.033030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-0dc429e6-61e0-4a6f-8d19-2d5242eb1cad None None] MFA Rules not processed for user `dd667d6988ce40289dd48fd1b4394655`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:48.034281 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-0dc429e6-61e0-4a6f-8d19-2d5242eb1cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:48.045156 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:48.105977 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1342/2667] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:12:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:12:48.110568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f8d84-1eb3-4110-bedf-4b4a13079562 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:48.178750 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f8d84-1eb3-4110-bedf-4b4a13079562 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:48.184956 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3290333-3b09-46cd-8bf5-a312ec982a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:48.185633 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3290333-3b09-46cd-8bf5-a312ec982a03 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:48.185913 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3290333-3b09-46cd-8bf5-a312ec982a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:48.186189 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3290333-3b09-46cd-8bf5-a312ec982a03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:48.186888 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3290333-3b09-46cd-8bf5-a312ec982a03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:48.188860 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3290333-3b09-46cd-8bf5-a312ec982a03 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:48.217084 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1326/2668] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:12:48 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:12:48.221318 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc429e6-61e0-4a6f-8d19-2d5242eb1cad None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:48.232446 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc429e6-61e0-4a6f-8d19-2d5242eb1cad None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:48.297680 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee730b1-0361-4400-b8db-46e9bd144548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:48.298584 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee730b1-0361-4400-b8db-46e9bd144548 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:48.298867 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee730b1-0361-4400-b8db-46e9bd144548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:48.299141 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee730b1-0361-4400-b8db-46e9bd144548 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:48.299866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee730b1-0361-4400-b8db-46e9bd144548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:48.301835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee730b1-0361-4400-b8db-46e9bd144548 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:48.325008 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1343/2669] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:12:48 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:12:48.329224 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3290333-3b09-46cd-8bf5-a312ec982a03 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:48.339996 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3290333-3b09-46cd-8bf5-a312ec982a03 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:48.344994 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c0d86-5369-4fa6-8447-c530135f0a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:48.345679 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c0d86-5369-4fa6-8447-c530135f0a3a admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:48.345964 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c0d86-5369-4fa6-8447-c530135f0a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:48.346242 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c0d86-5369-4fa6-8447-c530135f0a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:48.346983 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c0d86-5369-4fa6-8447-c530135f0a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:48.348724 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c0d86-5369-4fa6-8447-c530135f0a3a admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:48.359790 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1327/2670] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:12:48.365406 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee730b1-0361-4400-b8db-46e9bd144548 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:48.383716 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee730b1-0361-4400-b8db-46e9bd144548 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:48.389412 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e5a8a-de76-414f-a54f-3201d17f1eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:48.390294 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e5a8a-de76-414f-a54f-3201d17f1eab admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:48.390574 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e5a8a-de76-414f-a54f-3201d17f1eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:48.390836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e5a8a-de76-414f-a54f-3201d17f1eab admin admin] PATH_INFO: `/v3/projects/0ad40ce4530e4612b010661d196f8bde/users/4d63c74629a846fe998d956174f5301b/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:48.406302 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e5a8a-de76-414f-a54f-3201d17f1eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ad40ce4530e4612b010661d196f8bde, user_id=4d63c74629a846fe998d956174f5301b, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:48.409032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e5a8a-de76-414f-a54f-3201d17f1eab admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:48.429212 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1344/2671] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:12:48 2022] PUT /identity/v3/projects/0ad40ce4530e4612b010661d196f8bde/users/4d63c74629a846fe998d956174f5301b/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:48.435401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c0d86-5369-4fa6-8447-c530135f0a3a admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:48.448968 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c0d86-5369-4fa6-8447-c530135f0a3a admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:48.492488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:48.512252 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef62f7b-027a-4143-825f-561cb0a1c127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:48.512953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef62f7b-027a-4143-825f-561cb0a1c127 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:48.513238 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef62f7b-027a-4143-825f-561cb0a1c127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:48.513514 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef62f7b-027a-4143-825f-561cb0a1c127 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:48.514272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef62f7b-027a-4143-825f-561cb0a1c127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:48.515948 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef62f7b-027a-4143-825f-561cb0a1c127 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:48.525898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1328/2672] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:12:48.530117 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e5a8a-de76-414f-a54f-3201d17f1eab admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:48.541587 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e5a8a-de76-414f-a54f-3201d17f1eab admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:48.548030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee8f32-4fed-4fac-9eb8-12f1bf866183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:48.548852 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee8f32-4fed-4fac-9eb8-12f1bf866183 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:48.549127 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee8f32-4fed-4fac-9eb8-12f1bf866183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:48.549398 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee8f32-4fed-4fac-9eb8-12f1bf866183 admin admin] PATH_INFO: `/v3/projects/0ad40ce4530e4612b010661d196f8bde/users/4d63c74629a846fe998d956174f5301b/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:48.551663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee8f32-4fed-4fac-9eb8-12f1bf866183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ad40ce4530e4612b010661d196f8bde, user_id=4d63c74629a846fe998d956174f5301b, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:48.555180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee8f32-4fed-4fac-9eb8-12f1bf866183 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:48.567916 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1345/2673] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:12:48 2022] PUT /identity/v3/projects/0ad40ce4530e4612b010661d196f8bde/users/4d63c74629a846fe998d956174f5301b/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:48.580087 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb82ac-8c0b-4fbf-bc63-8776a5afe879 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:48.580382 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb82ac-8c0b-4fbf-bc63-8776a5afe879 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:48.580660 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb82ac-8c0b-4fbf-bc63-8776a5afe879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:48.619257 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-2ffb82ac-8c0b-4fbf-bc63-8776a5afe879 None None] MFA Rules not processed for user `4d63c74629a846fe998d956174f5301b`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:48.620540 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-2ffb82ac-8c0b-4fbf-bc63-8776a5afe879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:48.695981 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1329/2674] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:12:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:12:48.710971 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee8f32-4fed-4fac-9eb8-12f1bf866183 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:48.713242 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-7aee8f32-4fed-4fac-9eb8-12f1bf866183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:48.787067 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee8f32-4fed-4fac-9eb8-12f1bf866183 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:48.791668 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61577934-b13a-4b1b-89bd-efa4ff87c637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:48.792313 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61577934-b13a-4b1b-89bd-efa4ff87c637 service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:48.792596 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61577934-b13a-4b1b-89bd-efa4ff87c637 service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:48.792874 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61577934-b13a-4b1b-89bd-efa4ff87c637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:48.803960 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61577934-b13a-4b1b-89bd-efa4ff87c637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:48.805347 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61577934-b13a-4b1b-89bd-efa4ff87c637 service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:48.814909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1346/2675] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:12:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:12:48.844223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb82ac-8c0b-4fbf-bc63-8776a5afe879 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:48.909249 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb82ac-8c0b-4fbf-bc63-8776a5afe879 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:48.915043 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5ed5c-b44a-4ffe-9d37-d65696fadd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:48.915984 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5ed5c-b44a-4ffe-9d37-d65696fadd5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:48.916308 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5ed5c-b44a-4ffe-9d37-d65696fadd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:48.916586 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5ed5c-b44a-4ffe-9d37-d65696fadd5f admin admin] PATH_INFO: `/v3/users/dd667d6988ce40289dd48fd1b4394655` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:48.917906 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5ed5c-b44a-4ffe-9d37-d65696fadd5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd667d6988ce40289dd48fd1b4394655)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:48.920253 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5ed5c-b44a-4ffe-9d37-d65696fadd5f admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:48.971911 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-24c5ed5c-b44a-4ffe-9d37-d65696fadd5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd667d6988ce40289dd48fd1b4394655'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:48.982462 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:48.983722 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-24c5ed5c-b44a-4ffe-9d37-d65696fadd5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd667d6988ce40289dd48fd1b4394655'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:48.991426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-24c5ed5c-b44a-4ffe-9d37-d65696fadd5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd667d6988ce40289dd48fd1b4394655'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:48.992111 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-24c5ed5c-b44a-4ffe-9d37-d65696fadd5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd667d6988ce40289dd48fd1b4394655'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:48.999993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-24c5ed5c-b44a-4ffe-9d37-d65696fadd5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd667d6988ce40289dd48fd1b4394655'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:49.006052 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1330/2676] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:12:48 2022] DELETE /identity/v3/users/dd667d6988ce40289dd48fd1b4394655 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:49.010826 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e35a0-bde1-48e9-90c4-6d7491ea1fd2 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:49.011126 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e35a0-bde1-48e9-90c4-6d7491ea1fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:49.011405 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e35a0-bde1-48e9-90c4-6d7491ea1fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:49.023907 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:49.031184 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-532e35a0-bde1-48e9-90c4-6d7491ea1fd2 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:49.032474 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-532e35a0-bde1-48e9-90c4-6d7491ea1fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:49.106037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1347/2677] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:12:49.116031 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5ed5c-b44a-4ffe-9d37-d65696fadd5f admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:49.117779 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-24c5ed5c-b44a-4ffe-9d37-d65696fadd5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:49.187519 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5ed5c-b44a-4ffe-9d37-d65696fadd5f admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:49.191568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91258886-3d22-4038-9e89-efb03aa50047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:49.192323 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91258886-3d22-4038-9e89-efb03aa50047 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:49.192544 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91258886-3d22-4038-9e89-efb03aa50047 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:49.192819 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91258886-3d22-4038-9e89-efb03aa50047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:49.202491 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91258886-3d22-4038-9e89-efb03aa50047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:49.203968 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91258886-3d22-4038-9e89-efb03aa50047 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:49.213518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1331/2678] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:12:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:12:49.502670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e35a0-bde1-48e9-90c4-6d7491ea1fd2 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:49.504271 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-532e35a0-bde1-48e9-90c4-6d7491ea1fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:49.520704 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e35a0-bde1-48e9-90c4-6d7491ea1fd2 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:49.526298 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f05ea4-dedb-42e8-a913-127f549a8314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:49.527228 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f05ea4-dedb-42e8-a913-127f549a8314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:49.527445 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f05ea4-dedb-42e8-a913-127f549a8314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:49.527715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f05ea4-dedb-42e8-a913-127f549a8314 admin admin] PATH_INFO: `/v3/projects/e2b2b92f486b4bdd9850ebae67b7a762` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:49.528998 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f05ea4-dedb-42e8-a913-127f549a8314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b2b92f486b4bdd9850ebae67b7a762)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:49.530949 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f05ea4-dedb-42e8-a913-127f549a8314 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:49.585029 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-24f05ea4-dedb-42e8-a913-127f549a8314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b2b92f486b4bdd9850ebae67b7a762', 'request_id': 'req-24f05ea4-dedb-42e8-a913-127f549a8314'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:49.593954 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-24f05ea4-dedb-42e8-a913-127f549a8314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b2b92f486b4bdd9850ebae67b7a762', 'request_id': 'req-24f05ea4-dedb-42e8-a913-127f549a8314'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:49.605493 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-24f05ea4-dedb-42e8-a913-127f549a8314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b2b92f486b4bdd9850ebae67b7a762', 'request_id': 'req-24f05ea4-dedb-42e8-a913-127f549a8314'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:49.616667 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-24f05ea4-dedb-42e8-a913-127f549a8314 admin admin] The token cache is being invalidate because project e2b2b92f486b4bdd9850ebae67b7a762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:12:49.616859 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-24f05ea4-dedb-42e8-a913-127f549a8314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:49.617517 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-24f05ea4-dedb-42e8-a913-127f549a8314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:49.619104 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1348/2679] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:12:49 2022] DELETE /identity/v3/projects/e2b2b92f486b4bdd9850ebae67b7a762 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:12:49.624856 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91258886-3d22-4038-9e89-efb03aa50047 service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:49.634715 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91258886-3d22-4038-9e89-efb03aa50047 service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:49.693575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cb96d-53f7-4262-9fd5-9179da588d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:49.694485 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cb96d-53f7-4262-9fd5-9179da588d78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:49.694769 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cb96d-53f7-4262-9fd5-9179da588d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:49.695049 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cb96d-53f7-4262-9fd5-9179da588d78 admin admin] PATH_INFO: `/v3/users/4d63c74629a846fe998d956174f5301b` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:49.696320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022cb96d-53f7-4262-9fd5-9179da588d78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d63c74629a846fe998d956174f5301b)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:49.698265 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022cb96d-53f7-4262-9fd5-9179da588d78 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:49.749881 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-022cb96d-53f7-4262-9fd5-9179da588d78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d63c74629a846fe998d956174f5301b'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:49.763374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-022cb96d-53f7-4262-9fd5-9179da588d78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d63c74629a846fe998d956174f5301b'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:49.771656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-022cb96d-53f7-4262-9fd5-9179da588d78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d63c74629a846fe998d956174f5301b'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:49.772375 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-022cb96d-53f7-4262-9fd5-9179da588d78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d63c74629a846fe998d956174f5301b'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:49.780888 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-022cb96d-53f7-4262-9fd5-9179da588d78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d63c74629a846fe998d956174f5301b'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:49.787050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1332/2680] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:12:49 2022] DELETE /identity/v3/users/4d63c74629a846fe998d956174f5301b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:50.079390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f05ea4-dedb-42e8-a913-127f549a8314 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:50.081194 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-24f05ea4-dedb-42e8-a913-127f549a8314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:50.094854 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f05ea4-dedb-42e8-a913-127f549a8314 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:50.156201 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7059b2-a0c8-49cc-8c7e-6890ac95cf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:50.156992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7059b2-a0c8-49cc-8c7e-6890ac95cf42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:50.157269 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7059b2-a0c8-49cc-8c7e-6890ac95cf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:50.157541 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7059b2-a0c8-49cc-8c7e-6890ac95cf42 admin admin] PATH_INFO: `/v3/projects/0ad40ce4530e4612b010661d196f8bde` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:50.158789 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7059b2-a0c8-49cc-8c7e-6890ac95cf42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ad40ce4530e4612b010661d196f8bde)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:50.160875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7059b2-a0c8-49cc-8c7e-6890ac95cf42 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:50.196849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:50.211927 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-9f7059b2-a0c8-49cc-8c7e-6890ac95cf42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ad40ce4530e4612b010661d196f8bde', 'request_id': 'req-9f7059b2-a0c8-49cc-8c7e-6890ac95cf42'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:50.218124 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-9f7059b2-a0c8-49cc-8c7e-6890ac95cf42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ad40ce4530e4612b010661d196f8bde', 'request_id': 'req-9f7059b2-a0c8-49cc-8c7e-6890ac95cf42'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:50.227273 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-9f7059b2-a0c8-49cc-8c7e-6890ac95cf42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ad40ce4530e4612b010661d196f8bde', 'request_id': 'req-9f7059b2-a0c8-49cc-8c7e-6890ac95cf42'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:50.239227 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-9f7059b2-a0c8-49cc-8c7e-6890ac95cf42 admin admin] The token cache is being invalidate because project 0ad40ce4530e4612b010661d196f8bde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:12:50.239547 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-9f7059b2-a0c8-49cc-8c7e-6890ac95cf42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:50.240183 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-9f7059b2-a0c8-49cc-8c7e-6890ac95cf42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:50.241779 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1349/2681] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:12:50 2022] DELETE /identity/v3/projects/0ad40ce4530e4612b010661d196f8bde => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:50.247125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c8080-1a00-4c31-92a3-d41f877aff37 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:50.247427 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c8080-1a00-4c31-92a3-d41f877aff37 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:50.247707 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c8080-1a00-4c31-92a3-d41f877aff37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:50.254176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:50.268901 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-6e5c8080-1a00-4c31-92a3-d41f877aff37 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:50.270678 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-6e5c8080-1a00-4c31-92a3-d41f877aff37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:50.333100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1333/2682] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:12:50.340982 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7257c47-69d8-42ce-842c-8001dc36a209 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:50.341270 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7257c47-69d8-42ce-842c-8001dc36a209 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:50.341646 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7257c47-69d8-42ce-842c-8001dc36a209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:50.362233 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-f7257c47-69d8-42ce-842c-8001dc36a209 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:50.363456 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-f7257c47-69d8-42ce-842c-8001dc36a209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:50.373475 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1350/2683] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:12:50.378567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c8080-1a00-4c31-92a3-d41f877aff37 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:50.390700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c8080-1a00-4c31-92a3-d41f877aff37 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:50.397213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b35123-f22b-48fb-bff2-8bd1f159e96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:50.397888 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b35123-f22b-48fb-bff2-8bd1f159e96f admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:50.398171 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b35123-f22b-48fb-bff2-8bd1f159e96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:50.398445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b35123-f22b-48fb-bff2-8bd1f159e96f admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:50.399192 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b35123-f22b-48fb-bff2-8bd1f159e96f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:12:50.399546 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b35123-f22b-48fb-bff2-8bd1f159e96f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:50.401247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b35123-f22b-48fb-bff2-8bd1f159e96f admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:50.414317 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1334/2684] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:12:50.421419 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7257c47-69d8-42ce-842c-8001dc36a209 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:50.436322 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7257c47-69d8-42ce-842c-8001dc36a209 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:50.444811 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d200e-c3f8-428f-ac2c-df44a8304edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:50.445474 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d200e-c3f8-428f-ac2c-df44a8304edc admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:50.445750 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d200e-c3f8-428f-ac2c-df44a8304edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:50.446019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d200e-c3f8-428f-ac2c-df44a8304edc admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:50.446715 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d200e-c3f8-428f-ac2c-df44a8304edc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:50.448679 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d200e-c3f8-428f-ac2c-df44a8304edc admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:50.477682 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1351/2685] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:12:50 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:12:50.482317 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b35123-f22b-48fb-bff2-8bd1f159e96f admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:50.492814 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b35123-f22b-48fb-bff2-8bd1f159e96f admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:50.551157 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99aec8-8186-4d4a-9965-37999d847b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:50.551863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99aec8-8186-4d4a-9965-37999d847b59 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:50.552144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99aec8-8186-4d4a-9965-37999d847b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:50.552462 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99aec8-8186-4d4a-9965-37999d847b59 admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:50.553343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99aec8-8186-4d4a-9965-37999d847b59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:50.555328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99aec8-8186-4d4a-9965-37999d847b59 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:50.582716 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1335/2686] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:12:50 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:12:50.588234 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d200e-c3f8-428f-ac2c-df44a8304edc admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:50.599199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d200e-c3f8-428f-ac2c-df44a8304edc admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:50.604397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258ea0a-5670-4184-a0dc-845fcdf25da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:50.605115 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258ea0a-5670-4184-a0dc-845fcdf25da7 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:50.605417 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258ea0a-5670-4184-a0dc-845fcdf25da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:50.605689 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258ea0a-5670-4184-a0dc-845fcdf25da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:50.606421 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258ea0a-5670-4184-a0dc-845fcdf25da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:50.608100 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258ea0a-5670-4184-a0dc-845fcdf25da7 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:50.619045 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1352/2687] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:12:50.623163 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99aec8-8186-4d4a-9965-37999d847b59 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:50.633944 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99aec8-8186-4d4a-9965-37999d847b59 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:50.639108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e0695-cb8e-4ce8-a932-90677f165522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:50.639801 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e0695-cb8e-4ce8-a932-90677f165522 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:50.640084 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e0695-cb8e-4ce8-a932-90677f165522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:50.640385 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e0695-cb8e-4ce8-a932-90677f165522 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:50.641129 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e0695-cb8e-4ce8-a932-90677f165522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:50.642732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e0695-cb8e-4ce8-a932-90677f165522 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:50.652746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1336/2688] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:12:50.656759 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258ea0a-5670-4184-a0dc-845fcdf25da7 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:50.668018 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258ea0a-5670-4184-a0dc-845fcdf25da7 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:50.674214 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b1758-c004-478e-b3ce-d2ec2db45465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:50.675114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b1758-c004-478e-b3ce-d2ec2db45465 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:50.675373 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b1758-c004-478e-b3ce-d2ec2db45465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:50.675677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b1758-c004-478e-b3ce-d2ec2db45465 admin admin] PATH_INFO: `/v3/projects/d20b2ea9d1224094b5d59e9e1f61dae4/users/22873cff714548d8889f9dd0a3072c5a/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:50.691664 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b1758-c004-478e-b3ce-d2ec2db45465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d20b2ea9d1224094b5d59e9e1f61dae4, user_id=22873cff714548d8889f9dd0a3072c5a, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:50.694659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b1758-c004-478e-b3ce-d2ec2db45465 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:50.714337 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1353/2689] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:12:50 2022] PUT /identity/v3/projects/d20b2ea9d1224094b5d59e9e1f61dae4/users/22873cff714548d8889f9dd0a3072c5a/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:12:50.730209 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d796ab2-b8e1-4d95-b994-2809c551ad15 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:50.730522 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d796ab2-b8e1-4d95-b994-2809c551ad15 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:50.730813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d796ab2-b8e1-4d95-b994-2809c551ad15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:50.760183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-2d796ab2-b8e1-4d95-b994-2809c551ad15 None None] MFA Rules not processed for user `22873cff714548d8889f9dd0a3072c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:50.761431 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-2d796ab2-b8e1-4d95-b994-2809c551ad15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:50.831016 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:50.838348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1337/2690] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:12:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:12:50.843315 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b1758-c004-478e-b3ce-d2ec2db45465 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:50.910201 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b1758-c004-478e-b3ce-d2ec2db45465 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:50.919173 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a7103-cb11-4dcd-bbd1-60bc69774c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:50.919813 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a7103-cb11-4dcd-bbd1-60bc69774c29 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:50.920096 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a7103-cb11-4dcd-bbd1-60bc69774c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:50.920374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a7103-cb11-4dcd-bbd1-60bc69774c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:50.921073 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a7103-cb11-4dcd-bbd1-60bc69774c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:50.923029 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a7103-cb11-4dcd-bbd1-60bc69774c29 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:50.952260 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1354/2691] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:12:50 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:12:50.957895 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d796ab2-b8e1-4d95-b994-2809c551ad15 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:50.969528 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d796ab2-b8e1-4d95-b994-2809c551ad15 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:51.026588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8100d7-65f8-4541-88f7-46959c9a2714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:51.027267 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8100d7-65f8-4541-88f7-46959c9a2714 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:51.027599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8100d7-65f8-4541-88f7-46959c9a2714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:51.027891 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8100d7-65f8-4541-88f7-46959c9a2714 admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:51.028570 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8100d7-65f8-4541-88f7-46959c9a2714 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:51.030521 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8100d7-65f8-4541-88f7-46959c9a2714 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:51.054638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1338/2692] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:12:50 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:12:51.058819 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a7103-cb11-4dcd-bbd1-60bc69774c29 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:51.070465 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a7103-cb11-4dcd-bbd1-60bc69774c29 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:51.075663 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ef45b-69aa-4452-8bcd-6ad32d617403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:51.076339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ef45b-69aa-4452-8bcd-6ad32d617403 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:51.076762 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ef45b-69aa-4452-8bcd-6ad32d617403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:51.077039 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ef45b-69aa-4452-8bcd-6ad32d617403 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:51.077767 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ef45b-69aa-4452-8bcd-6ad32d617403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:51.079427 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ef45b-69aa-4452-8bcd-6ad32d617403 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:51.094759 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1355/2693] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:12:51.099056 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8100d7-65f8-4541-88f7-46959c9a2714 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:51.112811 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8100d7-65f8-4541-88f7-46959c9a2714 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:51.118639 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdc5d7-d5b8-4fd3-a28f-808a03c07f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:51.119557 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdc5d7-d5b8-4fd3-a28f-808a03c07f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:51.119871 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdc5d7-d5b8-4fd3-a28f-808a03c07f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:51.120149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdc5d7-d5b8-4fd3-a28f-808a03c07f4b admin admin] PATH_INFO: `/v3/projects/4d572a2fb87b4dca8aabab28901263c1/users/04e4b9789af348f58bedda37b43b059e/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:51.138039 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdc5d7-d5b8-4fd3-a28f-808a03c07f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d572a2fb87b4dca8aabab28901263c1, user_id=04e4b9789af348f58bedda37b43b059e, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:51.140790 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdc5d7-d5b8-4fd3-a28f-808a03c07f4b admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:51.160996 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1339/2694] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:12:51 2022] PUT /identity/v3/projects/4d572a2fb87b4dca8aabab28901263c1/users/04e4b9789af348f58bedda37b43b059e/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:12:51.166085 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ef45b-69aa-4452-8bcd-6ad32d617403 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:51.181865 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ef45b-69aa-4452-8bcd-6ad32d617403 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:51.216256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:51.248746 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864952a7-2b10-41a7-b82d-e298af0ba2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:51.249459 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864952a7-2b10-41a7-b82d-e298af0ba2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:51.249737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864952a7-2b10-41a7-b82d-e298af0ba2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:51.250009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864952a7-2b10-41a7-b82d-e298af0ba2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:51.250758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864952a7-2b10-41a7-b82d-e298af0ba2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:51.252434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864952a7-2b10-41a7-b82d-e298af0ba2c6 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:51.262561 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1356/2695] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:12:51.266883 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdc5d7-d5b8-4fd3-a28f-808a03c07f4b admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:51.277391 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdc5d7-d5b8-4fd3-a28f-808a03c07f4b admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:51.282262 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69873d-b97c-4785-a4cb-1d99e6ffb491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:51.283160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69873d-b97c-4785-a4cb-1d99e6ffb491 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:51.283443 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69873d-b97c-4785-a4cb-1d99e6ffb491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:51.283750 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69873d-b97c-4785-a4cb-1d99e6ffb491 admin admin] PATH_INFO: `/v3/projects/4d572a2fb87b4dca8aabab28901263c1/users/04e4b9789af348f58bedda37b43b059e/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:51.285735 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69873d-b97c-4785-a4cb-1d99e6ffb491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d572a2fb87b4dca8aabab28901263c1, user_id=04e4b9789af348f58bedda37b43b059e, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:51.288518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69873d-b97c-4785-a4cb-1d99e6ffb491 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:51.299267 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1340/2696] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:12:51 2022] PUT /identity/v3/projects/4d572a2fb87b4dca8aabab28901263c1/users/04e4b9789af348f58bedda37b43b059e/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:51.311800 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcc3c7-b906-4dfb-b700-7c9b355c7d4f None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:51.312119 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcc3c7-b906-4dfb-b700-7c9b355c7d4f None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:51.312454 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcc3c7-b906-4dfb-b700-7c9b355c7d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:51.342299 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-78dcc3c7-b906-4dfb-b700-7c9b355c7d4f None None] MFA Rules not processed for user `04e4b9789af348f58bedda37b43b059e`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:51.343545 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-78dcc3c7-b906-4dfb-b700-7c9b355c7d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:51.419640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1357/2697] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:12:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:12:51.431080 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69873d-b97c-4785-a4cb-1d99e6ffb491 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:51.433387 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-1b69873d-b97c-4785-a4cb-1d99e6ffb491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:51.503575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69873d-b97c-4785-a4cb-1d99e6ffb491 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:51.507871 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcfa1e-7624-4306-b502-a10ac61833dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:51.508521 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcfa1e-7624-4306-b502-a10ac61833dc service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:51.508803 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcfa1e-7624-4306-b502-a10ac61833dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:51.509059 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcfa1e-7624-4306-b502-a10ac61833dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:51.518716 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdcfa1e-7624-4306-b502-a10ac61833dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:51.520210 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdcfa1e-7624-4306-b502-a10ac61833dc service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:51.530564 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1341/2698] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:12:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:12:51.633893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcc3c7-b906-4dfb-b700-7c9b355c7d4f None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:51.648479 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcc3c7-b906-4dfb-b700-7c9b355c7d4f None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:51.652608 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019605e6-53ca-46a6-8b27-5a6f52149a9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:51.653250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019605e6-53ca-46a6-8b27-5a6f52149a9c service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:51.653548 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019605e6-53ca-46a6-8b27-5a6f52149a9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:51.653815 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019605e6-53ca-46a6-8b27-5a6f52149a9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:51.713252 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019605e6-53ca-46a6-8b27-5a6f52149a9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:51.714614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019605e6-53ca-46a6-8b27-5a6f52149a9c service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:51.723929 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1358/2699] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:12:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:12:54.348276 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcfa1e-7624-4306-b502-a10ac61833dc service cinder] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:54.403434 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:54.415588 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcfa1e-7624-4306-b502-a10ac61833dc service cinder] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:54.421442 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1cb14-d24f-4c01-82a4-936c1faae9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:54.422348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1cb14-d24f-4c01-82a4-936c1faae9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:54.422629 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1cb14-d24f-4c01-82a4-936c1faae9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:54.422906 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1cb14-d24f-4c01-82a4-936c1faae9eb admin admin] PATH_INFO: `/v3/users/22873cff714548d8889f9dd0a3072c5a` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:54.424144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1cb14-d24f-4c01-82a4-936c1faae9eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=22873cff714548d8889f9dd0a3072c5a)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:54.426086 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1cb14-d24f-4c01-82a4-936c1faae9eb admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:54.476820 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-35e1cb14-d24f-4c01-82a4-936c1faae9eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22873cff714548d8889f9dd0a3072c5a'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:54.488530 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-35e1cb14-d24f-4c01-82a4-936c1faae9eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22873cff714548d8889f9dd0a3072c5a'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:54.495238 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-35e1cb14-d24f-4c01-82a4-936c1faae9eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22873cff714548d8889f9dd0a3072c5a'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:54.495936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-35e1cb14-d24f-4c01-82a4-936c1faae9eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22873cff714548d8889f9dd0a3072c5a'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:54.504336 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-35e1cb14-d24f-4c01-82a4-936c1faae9eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22873cff714548d8889f9dd0a3072c5a'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:54.511186 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1342/2700] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:12:54 2022] DELETE /identity/v3/users/22873cff714548d8889f9dd0a3072c5a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:54.516973 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3aca6-32c0-45da-9270-f53a99ede245 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:54.517509 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3aca6-32c0-45da-9270-f53a99ede245 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:54.517609 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3aca6-32c0-45da-9270-f53a99ede245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:54.540748 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-afd3aca6-32c0-45da-9270-f53a99ede245 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:54.541979 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-afd3aca6-32c0-45da-9270-f53a99ede245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:54.599556 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:54.617895 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1359/2701] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:12:54.629467 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1cb14-d24f-4c01-82a4-936c1faae9eb admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:54.630940 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-35e1cb14-d24f-4c01-82a4-936c1faae9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:54.697640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1cb14-d24f-4c01-82a4-936c1faae9eb admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:54.701618 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80487ef-9afd-441c-a4d9-af76cc713710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:54.702275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80487ef-9afd-441c-a4d9-af76cc713710 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:54.702554 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80487ef-9afd-441c-a4d9-af76cc713710 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:54.702851 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80487ef-9afd-441c-a4d9-af76cc713710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:54.712363 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80487ef-9afd-441c-a4d9-af76cc713710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:54.713833 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80487ef-9afd-441c-a4d9-af76cc713710 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:54.724025 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1343/2702] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:12:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:12:55.003768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3aca6-32c0-45da-9270-f53a99ede245 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:55.005270 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-afd3aca6-32c0-45da-9270-f53a99ede245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:55.019957 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3aca6-32c0-45da-9270-f53a99ede245 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:55.026460 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b93fe3-3e6b-4c3d-9fdc-80a2248a10c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:55.027511 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b93fe3-3e6b-4c3d-9fdc-80a2248a10c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:55.027816 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b93fe3-3e6b-4c3d-9fdc-80a2248a10c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:55.028110 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b93fe3-3e6b-4c3d-9fdc-80a2248a10c3 admin admin] PATH_INFO: `/v3/projects/d20b2ea9d1224094b5d59e9e1f61dae4` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:55.029313 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b93fe3-3e6b-4c3d-9fdc-80a2248a10c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d20b2ea9d1224094b5d59e9e1f61dae4)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:55.031280 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b93fe3-3e6b-4c3d-9fdc-80a2248a10c3 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:55.082052 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-d9b93fe3-3e6b-4c3d-9fdc-80a2248a10c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd20b2ea9d1224094b5d59e9e1f61dae4', 'request_id': 'req-d9b93fe3-3e6b-4c3d-9fdc-80a2248a10c3'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:55.088969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-d9b93fe3-3e6b-4c3d-9fdc-80a2248a10c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd20b2ea9d1224094b5d59e9e1f61dae4', 'request_id': 'req-d9b93fe3-3e6b-4c3d-9fdc-80a2248a10c3'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:55.098468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-d9b93fe3-3e6b-4c3d-9fdc-80a2248a10c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd20b2ea9d1224094b5d59e9e1f61dae4', 'request_id': 'req-d9b93fe3-3e6b-4c3d-9fdc-80a2248a10c3'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:55.109529 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-d9b93fe3-3e6b-4c3d-9fdc-80a2248a10c3 admin admin] The token cache is being invalidate because project d20b2ea9d1224094b5d59e9e1f61dae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:12:55.109819 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-d9b93fe3-3e6b-4c3d-9fdc-80a2248a10c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:55.110466 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-d9b93fe3-3e6b-4c3d-9fdc-80a2248a10c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:55.112111 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1360/2703] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:12:55 2022] DELETE /identity/v3/projects/d20b2ea9d1224094b5d59e9e1f61dae4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:55.116240 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80487ef-9afd-441c-a4d9-af76cc713710 service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:55.126330 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80487ef-9afd-441c-a4d9-af76cc713710 service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:55.187722 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5f7d8-139f-4d23-b839-7493c5be4036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:55.188693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5f7d8-139f-4d23-b839-7493c5be4036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:55.188964 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5f7d8-139f-4d23-b839-7493c5be4036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:55.189239 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5f7d8-139f-4d23-b839-7493c5be4036 admin admin] PATH_INFO: `/v3/users/04e4b9789af348f58bedda37b43b059e` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:55.190481 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5f7d8-139f-4d23-b839-7493c5be4036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04e4b9789af348f58bedda37b43b059e)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:55.192549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5f7d8-139f-4d23-b839-7493c5be4036 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:55.209375 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:55.241765 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-8df5f7d8-139f-4d23-b839-7493c5be4036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04e4b9789af348f58bedda37b43b059e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:55.255444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-8df5f7d8-139f-4d23-b839-7493c5be4036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04e4b9789af348f58bedda37b43b059e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:55.263402 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-8df5f7d8-139f-4d23-b839-7493c5be4036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04e4b9789af348f58bedda37b43b059e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:55.264181 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-8df5f7d8-139f-4d23-b839-7493c5be4036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04e4b9789af348f58bedda37b43b059e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:55.274106 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-8df5f7d8-139f-4d23-b839-7493c5be4036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04e4b9789af348f58bedda37b43b059e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:55.280828 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1344/2704] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:12:55 2022] DELETE /identity/v3/users/04e4b9789af348f58bedda37b43b059e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:55.571908 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b93fe3-3e6b-4c3d-9fdc-80a2248a10c3 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:55.573205 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-d9b93fe3-3e6b-4c3d-9fdc-80a2248a10c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:55.586434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b93fe3-3e6b-4c3d-9fdc-80a2248a10c3 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:55.646840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843392c-a278-4dbf-88bc-2e613bfe9e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:55.647699 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843392c-a278-4dbf-88bc-2e613bfe9e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:55.647977 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843392c-a278-4dbf-88bc-2e613bfe9e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:55.648248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843392c-a278-4dbf-88bc-2e613bfe9e33 admin admin] PATH_INFO: `/v3/projects/4d572a2fb87b4dca8aabab28901263c1` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:55.649572 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843392c-a278-4dbf-88bc-2e613bfe9e33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d572a2fb87b4dca8aabab28901263c1)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:55.651745 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843392c-a278-4dbf-88bc-2e613bfe9e33 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:55.699377 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-a843392c-a278-4dbf-88bc-2e613bfe9e33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d572a2fb87b4dca8aabab28901263c1', 'request_id': 'req-a843392c-a278-4dbf-88bc-2e613bfe9e33'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:55.705511 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-a843392c-a278-4dbf-88bc-2e613bfe9e33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d572a2fb87b4dca8aabab28901263c1', 'request_id': 'req-a843392c-a278-4dbf-88bc-2e613bfe9e33'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:55.715379 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-a843392c-a278-4dbf-88bc-2e613bfe9e33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d572a2fb87b4dca8aabab28901263c1', 'request_id': 'req-a843392c-a278-4dbf-88bc-2e613bfe9e33'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:55.727768 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-a843392c-a278-4dbf-88bc-2e613bfe9e33 admin admin] The token cache is being invalidate because project 4d572a2fb87b4dca8aabab28901263c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:12:55.728058 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-a843392c-a278-4dbf-88bc-2e613bfe9e33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:55.728714 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-a843392c-a278-4dbf-88bc-2e613bfe9e33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:55.730270 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1361/2705] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:12:55 2022] DELETE /identity/v3/projects/4d572a2fb87b4dca8aabab28901263c1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:55.735257 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ec3a0-e702-4338-b35b-f3cc6b5cb568 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:55.735802 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ec3a0-e702-4338-b35b-f3cc6b5cb568 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:55.735911 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ec3a0-e702-4338-b35b-f3cc6b5cb568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:55.755324 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-973ec3a0-e702-4338-b35b-f3cc6b5cb568 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:55.756614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-973ec3a0-e702-4338-b35b-f3cc6b5cb568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:55.829262 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1345/2706] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:12:55.838533 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af67a9-f17c-4ed5-915e-be3860d566fc None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:55.838915 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af67a9-f17c-4ed5-915e-be3860d566fc None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:55.839255 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af67a9-f17c-4ed5-915e-be3860d566fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:55.850272 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:55.862420 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-04af67a9-f17c-4ed5-915e-be3860d566fc None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:55.864117 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-04af67a9-f17c-4ed5-915e-be3860d566fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:55.873008 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1362/2707] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:12:55.877487 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ec3a0-e702-4338-b35b-f3cc6b5cb568 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:55.887859 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ec3a0-e702-4338-b35b-f3cc6b5cb568 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:55.892628 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40394a84-a532-46d4-9038-8a0ab57ad36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:55.893392 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40394a84-a532-46d4-9038-8a0ab57ad36a admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:55.893686 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40394a84-a532-46d4-9038-8a0ab57ad36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:55.893965 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40394a84-a532-46d4-9038-8a0ab57ad36a admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:55.894701 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40394a84-a532-46d4-9038-8a0ab57ad36a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:12:55.895044 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40394a84-a532-46d4-9038-8a0ab57ad36a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:55.896715 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40394a84-a532-46d4-9038-8a0ab57ad36a admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:55.908746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1346/2708] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:12:55.913267 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af67a9-f17c-4ed5-915e-be3860d566fc None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:55.924229 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af67a9-f17c-4ed5-915e-be3860d566fc None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:55.929175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247f820-b7f6-4676-bf4d-b8fec43eeb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:55.929864 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247f820-b7f6-4676-bf4d-b8fec43eeb93 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:55.930140 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247f820-b7f6-4676-bf4d-b8fec43eeb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:55.930405 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247f820-b7f6-4676-bf4d-b8fec43eeb93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:55.931134 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247f820-b7f6-4676-bf4d-b8fec43eeb93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:55.933133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247f820-b7f6-4676-bf4d-b8fec43eeb93 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:55.962264 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1363/2709] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:12:55 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:12:55.967189 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40394a84-a532-46d4-9038-8a0ab57ad36a admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:55.977354 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40394a84-a532-46d4-9038-8a0ab57ad36a admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:56.034722 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97657541-ce53-4f4e-982b-877f060f5e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:56.035389 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97657541-ce53-4f4e-982b-877f060f5e47 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:56.035714 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97657541-ce53-4f4e-982b-877f060f5e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:56.035986 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97657541-ce53-4f4e-982b-877f060f5e47 admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:56.036673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97657541-ce53-4f4e-982b-877f060f5e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:56.038594 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97657541-ce53-4f4e-982b-877f060f5e47 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:56.062064 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1347/2710] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:12:55 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:12:56.066231 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247f820-b7f6-4676-bf4d-b8fec43eeb93 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:56.076840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247f820-b7f6-4676-bf4d-b8fec43eeb93 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:56.081680 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c617b-98f6-4262-bc7a-825c5072940b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:56.082349 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c617b-98f6-4262-bc7a-825c5072940b admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:56.082632 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c617b-98f6-4262-bc7a-825c5072940b admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:56.082909 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c617b-98f6-4262-bc7a-825c5072940b admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:56.083677 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c617b-98f6-4262-bc7a-825c5072940b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:56.085334 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c617b-98f6-4262-bc7a-825c5072940b admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:56.095866 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1364/2711] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:12:56.099768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97657541-ce53-4f4e-982b-877f060f5e47 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:56.111270 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97657541-ce53-4f4e-982b-877f060f5e47 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:56.116549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c49548-2478-4d40-871d-9a408674b5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:56.117272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c49548-2478-4d40-871d-9a408674b5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:56.117626 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c49548-2478-4d40-871d-9a408674b5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:56.117959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c49548-2478-4d40-871d-9a408674b5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:56.118775 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c49548-2478-4d40-871d-9a408674b5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:56.121157 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c49548-2478-4d40-871d-9a408674b5f7 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:56.127236 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:56.136939 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1348/2712] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:12:56.138462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c617b-98f6-4262-bc7a-825c5072940b admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:56.148862 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c617b-98f6-4262-bc7a-825c5072940b admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:56.153751 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ac811-80d4-45ae-8d04-72ffa33a5857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:56.154657 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ac811-80d4-45ae-8d04-72ffa33a5857 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:56.154939 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ac811-80d4-45ae-8d04-72ffa33a5857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:56.155212 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ac811-80d4-45ae-8d04-72ffa33a5857 admin admin] PATH_INFO: `/v3/projects/16fdead21a7143f7baf35f2905eb1cce/users/8859203523ac4feabb52a2dec2ff3165/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:56.171719 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ac811-80d4-45ae-8d04-72ffa33a5857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16fdead21a7143f7baf35f2905eb1cce, user_id=8859203523ac4feabb52a2dec2ff3165, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:56.174388 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ac811-80d4-45ae-8d04-72ffa33a5857 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:56.188459 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1365/2713] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:12:56 2022] PUT /identity/v3/projects/16fdead21a7143f7baf35f2905eb1cce/users/8859203523ac4feabb52a2dec2ff3165/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:56.201175 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f848d-fbc7-4856-a0e6-15d9399638fe None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:56.201605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f848d-fbc7-4856-a0e6-15d9399638fe None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:56.201977 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f848d-fbc7-4856-a0e6-15d9399638fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:56.238491 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-b24f848d-fbc7-4856-a0e6-15d9399638fe None None] MFA Rules not processed for user `8859203523ac4feabb52a2dec2ff3165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:56.239716 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-b24f848d-fbc7-4856-a0e6-15d9399638fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:56.313621 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1349/2714] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:12:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:12:56.318628 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ac811-80d4-45ae-8d04-72ffa33a5857 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:56.383549 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ac811-80d4-45ae-8d04-72ffa33a5857 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:56.388808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81852e64-9e88-40fa-822d-8124f49f6130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:56.389447 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81852e64-9e88-40fa-822d-8124f49f6130 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:56.389726 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81852e64-9e88-40fa-822d-8124f49f6130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:56.390001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81852e64-9e88-40fa-822d-8124f49f6130 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:56.390680 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81852e64-9e88-40fa-822d-8124f49f6130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:56.392619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81852e64-9e88-40fa-822d-8124f49f6130 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:56.421580 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1366/2715] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:12:56 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:12:56.425812 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f848d-fbc7-4856-a0e6-15d9399638fe None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:56.436832 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f848d-fbc7-4856-a0e6-15d9399638fe None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:56.495145 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8712d-d9d8-4941-b34d-ff75b54d7dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:56.495853 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8712d-d9d8-4941-b34d-ff75b54d7dcd admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:56.496134 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8712d-d9d8-4941-b34d-ff75b54d7dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:56.496429 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8712d-d9d8-4941-b34d-ff75b54d7dcd admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:56.497114 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8712d-d9d8-4941-b34d-ff75b54d7dcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:56.499044 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8712d-d9d8-4941-b34d-ff75b54d7dcd admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:56.521381 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1350/2716] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:12:56 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:12:56.525629 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81852e64-9e88-40fa-822d-8124f49f6130 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:56.536397 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81852e64-9e88-40fa-822d-8124f49f6130 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:56.541246 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76690c9-9dff-4ae2-81bc-df5c02933e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:56.541916 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76690c9-9dff-4ae2-81bc-df5c02933e88 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:56.542196 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76690c9-9dff-4ae2-81bc-df5c02933e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:56.542471 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76690c9-9dff-4ae2-81bc-df5c02933e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:56.543231 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76690c9-9dff-4ae2-81bc-df5c02933e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:56.545220 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76690c9-9dff-4ae2-81bc-df5c02933e88 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:56.555784 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1367/2717] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:12:56.559948 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8712d-d9d8-4941-b34d-ff75b54d7dcd admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:56.570155 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8712d-d9d8-4941-b34d-ff75b54d7dcd admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:56.575534 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cf39d-3266-4590-addb-87445775f1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:56.576547 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cf39d-3266-4590-addb-87445775f1ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:56.576839 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cf39d-3266-4590-addb-87445775f1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:56.577130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cf39d-3266-4590-addb-87445775f1ca admin admin] PATH_INFO: `/v3/projects/6c83201eb4f4483caa3ce93e2862088e/users/49aa0850b24f4d8586891b7e3d9cb924/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:56.592111 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cf39d-3266-4590-addb-87445775f1ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c83201eb4f4483caa3ce93e2862088e, user_id=49aa0850b24f4d8586891b7e3d9cb924, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:56.594767 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cf39d-3266-4590-addb-87445775f1ca admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:56.609263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1351/2718] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:12:56 2022] PUT /identity/v3/projects/6c83201eb4f4483caa3ce93e2862088e/users/49aa0850b24f4d8586891b7e3d9cb924/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:56.613451 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76690c9-9dff-4ae2-81bc-df5c02933e88 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:56.624280 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76690c9-9dff-4ae2-81bc-df5c02933e88 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:56.688878 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddda3fb-339a-4fa1-b732-e6ec064e5225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:56.689603 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddda3fb-339a-4fa1-b732-e6ec064e5225 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:56.689871 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddda3fb-339a-4fa1-b732-e6ec064e5225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:56.690149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddda3fb-339a-4fa1-b732-e6ec064e5225 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:56.690884 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddda3fb-339a-4fa1-b732-e6ec064e5225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:56.692581 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddda3fb-339a-4fa1-b732-e6ec064e5225 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:56.703252 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1368/2719] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:12:56.709077 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cf39d-3266-4590-addb-87445775f1ca admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:56.720103 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cf39d-3266-4590-addb-87445775f1ca admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:56.725060 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f6c7f-9441-4819-a01e-460daf5fa06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:56.725948 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f6c7f-9441-4819-a01e-460daf5fa06c admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:56.726212 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f6c7f-9441-4819-a01e-460daf5fa06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:56.726522 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f6c7f-9441-4819-a01e-460daf5fa06c admin admin] PATH_INFO: `/v3/projects/6c83201eb4f4483caa3ce93e2862088e/users/49aa0850b24f4d8586891b7e3d9cb924/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:56.728570 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f6c7f-9441-4819-a01e-460daf5fa06c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c83201eb4f4483caa3ce93e2862088e, user_id=49aa0850b24f4d8586891b7e3d9cb924, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:56.731229 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f6c7f-9441-4819-a01e-460daf5fa06c admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:56.741618 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1352/2720] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:12:56 2022] PUT /identity/v3/projects/6c83201eb4f4483caa3ce93e2862088e/users/49aa0850b24f4d8586891b7e3d9cb924/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:56.752179 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f88160-aae9-440c-bccc-5350f4e47a59 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:56.752467 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f88160-aae9-440c-bccc-5350f4e47a59 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:56.752746 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f88160-aae9-440c-bccc-5350f4e47a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:56.775207 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:56.784840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-44f88160-aae9-440c-bccc-5350f4e47a59 None None] MFA Rules not processed for user `49aa0850b24f4d8586891b7e3d9cb924`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:56.786309 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-44f88160-aae9-440c-bccc-5350f4e47a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:56.857720 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1369/2721] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:12:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:12:56.868729 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f6c7f-9441-4819-a01e-460daf5fa06c admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:56.870916 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-293f6c7f-9441-4819-a01e-460daf5fa06c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:56.920873 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:56.935062 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f6c7f-9441-4819-a01e-460daf5fa06c admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:56.938978 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41f6c6-fcf0-41a5-8890-165498fef446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:56.939670 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41f6c6-fcf0-41a5-8890-165498fef446 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:56.939950 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41f6c6-fcf0-41a5-8890-165498fef446 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:56.940221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41f6c6-fcf0-41a5-8890-165498fef446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:57.001775 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41f6c6-fcf0-41a5-8890-165498fef446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:57.004009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41f6c6-fcf0-41a5-8890-165498fef446 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:57.015516 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1353/2722] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:12:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:12:59.589191 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f88160-aae9-440c-bccc-5350f4e47a59 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:59.654051 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f88160-aae9-440c-bccc-5350f4e47a59 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:59.658983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59333efb-c27a-4d58-b646-798bec8323f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:59.659904 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59333efb-c27a-4d58-b646-798bec8323f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:59.660189 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59333efb-c27a-4d58-b646-798bec8323f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:59.660466 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59333efb-c27a-4d58-b646-798bec8323f8 admin admin] PATH_INFO: `/v3/users/8859203523ac4feabb52a2dec2ff3165` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:59.661708 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59333efb-c27a-4d58-b646-798bec8323f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8859203523ac4feabb52a2dec2ff3165)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:59.663695 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59333efb-c27a-4d58-b646-798bec8323f8 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:59.714767 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-59333efb-c27a-4d58-b646-798bec8323f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8859203523ac4feabb52a2dec2ff3165'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:59.721843 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-59333efb-c27a-4d58-b646-798bec8323f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8859203523ac4feabb52a2dec2ff3165'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:59.722680 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-59333efb-c27a-4d58-b646-798bec8323f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8859203523ac4feabb52a2dec2ff3165'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:59.723448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-59333efb-c27a-4d58-b646-798bec8323f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8859203523ac4feabb52a2dec2ff3165'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:59.736766 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-59333efb-c27a-4d58-b646-798bec8323f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8859203523ac4feabb52a2dec2ff3165'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:12:59.751166 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1370/2723] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:12:59 2022] DELETE /identity/v3/users/8859203523ac4feabb52a2dec2ff3165 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:12:59.756104 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdc2c7-d292-4e6a-8ffd-fb3523c0b71e None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:59.756629 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdc2c7-d292-4e6a-8ffd-fb3523c0b71e None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:59.756629 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdc2c7-d292-4e6a-8ffd-fb3523c0b71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:59.775547 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-89bdc2c7-d292-4e6a-8ffd-fb3523c0b71e None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:12:59.777137 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-89bdc2c7-d292-4e6a-8ffd-fb3523c0b71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:59.844077 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1354/2724] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:12:59.853932 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59333efb-c27a-4d58-b646-798bec8323f8 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:12:59.855552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-59333efb-c27a-4d58-b646-798bec8323f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:12:59.875439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:12:59.921002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59333efb-c27a-4d58-b646-798bec8323f8 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:12:59.924941 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94daa9b-5b93-4b0e-83bf-4b3d2d95831b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:12:59.925607 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94daa9b-5b93-4b0e-83bf-4b3d2d95831b service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:12:59.925889 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94daa9b-5b93-4b0e-83bf-4b3d2d95831b service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:12:59.926167 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94daa9b-5b93-4b0e-83bf-4b3d2d95831b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:12:59.936365 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94daa9b-5b93-4b0e-83bf-4b3d2d95831b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:12:59.937827 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94daa9b-5b93-4b0e-83bf-4b3d2d95831b service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:12:59.947763 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1371/2725] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:12:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:13:00.239326 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bdc2c7-d292-4e6a-8ffd-fb3523c0b71e None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:13:00.241040 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-89bdc2c7-d292-4e6a-8ffd-fb3523c0b71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:13:00.255103 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bdc2c7-d292-4e6a-8ffd-fb3523c0b71e None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:13:00.260823 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e2c4d-2c46-4111-a37c-a21b262b1457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:13:00.261707 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e2c4d-2c46-4111-a37c-a21b262b1457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:13:00.261990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e2c4d-2c46-4111-a37c-a21b262b1457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:13:00.262264 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e2c4d-2c46-4111-a37c-a21b262b1457 admin admin] PATH_INFO: `/v3/projects/16fdead21a7143f7baf35f2905eb1cce` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:13:00.263573 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e2c4d-2c46-4111-a37c-a21b262b1457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16fdead21a7143f7baf35f2905eb1cce)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:13:00.265523 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e2c4d-2c46-4111-a37c-a21b262b1457 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:13:00.315045 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-649e2c4d-2c46-4111-a37c-a21b262b1457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16fdead21a7143f7baf35f2905eb1cce', 'request_id': 'req-649e2c4d-2c46-4111-a37c-a21b262b1457'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:00.322974 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-649e2c4d-2c46-4111-a37c-a21b262b1457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16fdead21a7143f7baf35f2905eb1cce', 'request_id': 'req-649e2c4d-2c46-4111-a37c-a21b262b1457'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:00.328749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-649e2c4d-2c46-4111-a37c-a21b262b1457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16fdead21a7143f7baf35f2905eb1cce', 'request_id': 'req-649e2c4d-2c46-4111-a37c-a21b262b1457'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:00.340507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-649e2c4d-2c46-4111-a37c-a21b262b1457 admin admin] The token cache is being invalidate because project 16fdead21a7143f7baf35f2905eb1cce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:13:00.340791 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-649e2c4d-2c46-4111-a37c-a21b262b1457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:00.341527 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-649e2c4d-2c46-4111-a37c-a21b262b1457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:00.343246 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1355/2726] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:13:00 2022] DELETE /identity/v3/projects/16fdead21a7143f7baf35f2905eb1cce => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:13:00.347658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94daa9b-5b93-4b0e-83bf-4b3d2d95831b service neutron] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:13:00.358177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94daa9b-5b93-4b0e-83bf-4b3d2d95831b service neutron] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:13:00.422592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28166ae8-7df5-41c8-a09a-e1c793811f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:13:00.423499 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28166ae8-7df5-41c8-a09a-e1c793811f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:13:00.423776 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28166ae8-7df5-41c8-a09a-e1c793811f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:13:00.424045 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28166ae8-7df5-41c8-a09a-e1c793811f0e admin admin] PATH_INFO: `/v3/users/49aa0850b24f4d8586891b7e3d9cb924` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:13:00.425303 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28166ae8-7df5-41c8-a09a-e1c793811f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=49aa0850b24f4d8586891b7e3d9cb924)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:13:00.427309 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28166ae8-7df5-41c8-a09a-e1c793811f0e admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:13:00.474262 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-28166ae8-7df5-41c8-a09a-e1c793811f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49aa0850b24f4d8586891b7e3d9cb924'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:00.481797 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-28166ae8-7df5-41c8-a09a-e1c793811f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49aa0850b24f4d8586891b7e3d9cb924'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:00.482454 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-28166ae8-7df5-41c8-a09a-e1c793811f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49aa0850b24f4d8586891b7e3d9cb924'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:00.483053 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-28166ae8-7df5-41c8-a09a-e1c793811f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49aa0850b24f4d8586891b7e3d9cb924'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:00.495071 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-28166ae8-7df5-41c8-a09a-e1c793811f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49aa0850b24f4d8586891b7e3d9cb924'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:00.508752 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1372/2727] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:13:00 2022] DELETE /identity/v3/users/49aa0850b24f4d8586891b7e3d9cb924 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:13:00.800940 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e2c4d-2c46-4111-a37c-a21b262b1457 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:13:00.802510 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-649e2c4d-2c46-4111-a37c-a21b262b1457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:13:00.816237 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e2c4d-2c46-4111-a37c-a21b262b1457 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:13:00.836574 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:13:00.884260 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd79aa-f66b-4a67-b1a6-f88da392715a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:13:00.885076 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd79aa-f66b-4a67-b1a6-f88da392715a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:13:00.885566 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd79aa-f66b-4a67-b1a6-f88da392715a admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:13:00.885739 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd79aa-f66b-4a67-b1a6-f88da392715a admin admin] PATH_INFO: `/v3/projects/6c83201eb4f4483caa3ce93e2862088e` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:13:00.887852 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd79aa-f66b-4a67-b1a6-f88da392715a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c83201eb4f4483caa3ce93e2862088e)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:13:00.890980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd79aa-f66b-4a67-b1a6-f88da392715a admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:13:00.947232 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-9edd79aa-f66b-4a67-b1a6-f88da392715a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c83201eb4f4483caa3ce93e2862088e', 'request_id': 'req-9edd79aa-f66b-4a67-b1a6-f88da392715a'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:00.956869 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-9edd79aa-f66b-4a67-b1a6-f88da392715a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c83201eb4f4483caa3ce93e2862088e', 'request_id': 'req-9edd79aa-f66b-4a67-b1a6-f88da392715a'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:00.963000 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-9edd79aa-f66b-4a67-b1a6-f88da392715a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c83201eb4f4483caa3ce93e2862088e', 'request_id': 'req-9edd79aa-f66b-4a67-b1a6-f88da392715a'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:00.974162 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-9edd79aa-f66b-4a67-b1a6-f88da392715a admin admin] The token cache is being invalidate because project 6c83201eb4f4483caa3ce93e2862088e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:13:00.974458 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-9edd79aa-f66b-4a67-b1a6-f88da392715a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:00.975118 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-9edd79aa-f66b-4a67-b1a6-f88da392715a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:00.976700 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1356/2728] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:13:00 2022] DELETE /identity/v3/projects/6c83201eb4f4483caa3ce93e2862088e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:13:10.505413 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=72,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:13:10.971127 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:13:16.685633 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28166ae8-7df5-41c8-a09a-e1c793811f0e admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:13:16.687231 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-28166ae8-7df5-41c8-a09a-e1c793811f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:13:16.763555 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28166ae8-7df5-41c8-a09a-e1c793811f0e admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:13:16.818579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1c6c2-8a90-434a-9371-237433730bd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:13:16.819237 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1c6c2-8a90-434a-9371-237433730bd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:13:16.819540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1c6c2-8a90-434a-9371-237433730bd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:13:16.819817 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1c6c2-8a90-434a-9371-237433730bd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:13:16.821750 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-f0a1c6c2-8a90-434a-9371-237433730bd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:13:16.887579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1c6c2-8a90-434a-9371-237433730bd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:13:16.889082 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1c6c2-8a90-434a-9371-237433730bd1 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:13:16.899681 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1373/2729] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:13:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:13:20.066169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd79aa-f66b-4a67-b1a6-f88da392715a admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:13:20.068426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-9edd79aa-f66b-4a67-b1a6-f88da392715a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:13:20.083901 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd79aa-f66b-4a67-b1a6-f88da392715a admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:13:20.089286 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3d9f3-71e0-4ab5-b254-29cd66446177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:13:20.090198 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3d9f3-71e0-4ab5-b254-29cd66446177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:13:20.090472 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3d9f3-71e0-4ab5-b254-29cd66446177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:13:20.090741 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3d9f3-71e0-4ab5-b254-29cd66446177 admin admin] PATH_INFO: `/v3/users/ee036a5188e8459989184fa216cc79e9` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:13:20.092241 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3d9f3-71e0-4ab5-b254-29cd66446177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee036a5188e8459989184fa216cc79e9)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:13:20.094229 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3d9f3-71e0-4ab5-b254-29cd66446177 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:13:20.145554 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-8de3d9f3-71e0-4ab5-b254-29cd66446177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee036a5188e8459989184fa216cc79e9'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:20.157664 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-8de3d9f3-71e0-4ab5-b254-29cd66446177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee036a5188e8459989184fa216cc79e9'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:20.165868 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-8de3d9f3-71e0-4ab5-b254-29cd66446177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee036a5188e8459989184fa216cc79e9'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:20.166660 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-8de3d9f3-71e0-4ab5-b254-29cd66446177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee036a5188e8459989184fa216cc79e9'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:20.178908 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-8de3d9f3-71e0-4ab5-b254-29cd66446177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee036a5188e8459989184fa216cc79e9'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:20.185806 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1357/2730] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:13:20 2022] DELETE /identity/v3/users/ee036a5188e8459989184fa216cc79e9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:13:20.371520 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1c6c2-8a90-434a-9371-237433730bd1 service neutron] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:13:20.386180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1c6c2-8a90-434a-9371-237433730bd1 service neutron] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:13:20.449331 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61281b4e-8ef0-406b-841d-93751dd012d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:13:20.450184 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61281b4e-8ef0-406b-841d-93751dd012d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:13:20.450458 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61281b4e-8ef0-406b-841d-93751dd012d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:13:20.450727 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61281b4e-8ef0-406b-841d-93751dd012d8 admin admin] PATH_INFO: `/v3/projects/259b7f5f62fa47ee90a4fce1bd6459c6` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:13:20.451929 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61281b4e-8ef0-406b-841d-93751dd012d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=259b7f5f62fa47ee90a4fce1bd6459c6)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:13:20.453859 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61281b4e-8ef0-406b-841d-93751dd012d8 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:13:20.461647 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=100 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:13:20.504247 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-61281b4e-8ef0-406b-841d-93751dd012d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '259b7f5f62fa47ee90a4fce1bd6459c6', 'request_id': 'req-61281b4e-8ef0-406b-841d-93751dd012d8'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:20.510756 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-61281b4e-8ef0-406b-841d-93751dd012d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '259b7f5f62fa47ee90a4fce1bd6459c6', 'request_id': 'req-61281b4e-8ef0-406b-841d-93751dd012d8'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:20.519360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-61281b4e-8ef0-406b-841d-93751dd012d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '259b7f5f62fa47ee90a4fce1bd6459c6', 'request_id': 'req-61281b4e-8ef0-406b-841d-93751dd012d8'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:20.532334 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-61281b4e-8ef0-406b-841d-93751dd012d8 admin admin] The token cache is being invalidate because project 259b7f5f62fa47ee90a4fce1bd6459c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:13:20.532702 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-61281b4e-8ef0-406b-841d-93751dd012d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:20.533495 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-61281b4e-8ef0-406b-841d-93751dd012d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:13:20.535596 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1374/2731] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:13:20 2022] DELETE /identity/v3/projects/259b7f5f62fa47ee90a4fce1bd6459c6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:13:20.540876 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b325f4-5ef4-4b62-824e-bee5804f7701 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:13:20.541164 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b325f4-5ef4-4b62-824e-bee5804f7701 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:13:20.541441 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b325f4-5ef4-4b62-824e-bee5804f7701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:13:20.560681 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-41b325f4-5ef4-4b62-824e-bee5804f7701 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:13:20.561888 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-41b325f4-5ef4-4b62-824e-bee5804f7701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:13:20.623422 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1358/2732] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:13:20.631511 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93735254-7124-48b9-bf49-871cea346186 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:13:20.631798 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93735254-7124-48b9-bf49-871cea346186 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:13:20.632074 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93735254-7124-48b9-bf49-871cea346186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:13:20.650373 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-93735254-7124-48b9-bf49-871cea346186 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:13:20.651651 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-93735254-7124-48b9-bf49-871cea346186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:13:20.660841 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1375/2733] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:13:20.665217 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b325f4-5ef4-4b62-824e-bee5804f7701 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:13:20.676144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b325f4-5ef4-4b62-824e-bee5804f7701 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:13:20.681475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3d19a-e995-4991-86ea-41e91a5ede77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:13:20.682181 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3d19a-e995-4991-86ea-41e91a5ede77 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:13:20.682460 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3d19a-e995-4991-86ea-41e91a5ede77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:13:20.682735 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3d19a-e995-4991-86ea-41e91a5ede77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:13:20.683478 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3d19a-e995-4991-86ea-41e91a5ede77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:13:20.683834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3d19a-e995-4991-86ea-41e91a5ede77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:13:20.685460 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3d19a-e995-4991-86ea-41e91a5ede77 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:13:20.698191 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1359/2734] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:13:20.702442 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93735254-7124-48b9-bf49-871cea346186 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:13:20.714182 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93735254-7124-48b9-bf49-871cea346186 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:13:20.719646 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455cf08-e7b9-45da-b32a-8e3f287c9334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:13:20.720385 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455cf08-e7b9-45da-b32a-8e3f287c9334 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:13:20.720749 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455cf08-e7b9-45da-b32a-8e3f287c9334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:13:20.721154 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455cf08-e7b9-45da-b32a-8e3f287c9334 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:13:20.722759 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455cf08-e7b9-45da-b32a-8e3f287c9334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:13:20.724728 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455cf08-e7b9-45da-b32a-8e3f287c9334 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:13:20.756454 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1376/2735] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:13:20 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:13:20.761081 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3d19a-e995-4991-86ea-41e91a5ede77 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:13:20.772282 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3d19a-e995-4991-86ea-41e91a5ede77 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:13:20.835321 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffe8e5-fb10-497c-91a4-7ac5995a967b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:13:20.836054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffe8e5-fb10-497c-91a4-7ac5995a967b admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:13:20.836385 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffe8e5-fb10-497c-91a4-7ac5995a967b admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:13:20.836684 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffe8e5-fb10-497c-91a4-7ac5995a967b admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:13:20.837404 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffe8e5-fb10-497c-91a4-7ac5995a967b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:13:20.839394 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffe8e5-fb10-497c-91a4-7ac5995a967b admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:13:20.846325 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:13:20.865406 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1360/2736] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:13:20 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:13:20.866723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455cf08-e7b9-45da-b32a-8e3f287c9334 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:13:20.877679 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455cf08-e7b9-45da-b32a-8e3f287c9334 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:13:20.883175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c326ac4-1802-4760-b435-08808ead7583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:13:20.883890 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c326ac4-1802-4760-b435-08808ead7583 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:13:20.884169 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c326ac4-1802-4760-b435-08808ead7583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:13:20.884440 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c326ac4-1802-4760-b435-08808ead7583 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:13:20.885177 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c326ac4-1802-4760-b435-08808ead7583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:13:20.886806 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c326ac4-1802-4760-b435-08808ead7583 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:13:20.897727 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1377/2737] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:13:20.902968 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffe8e5-fb10-497c-91a4-7ac5995a967b admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:13:20.914056 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffe8e5-fb10-497c-91a4-7ac5995a967b admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:13:20.919687 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc43489-1c81-46ec-81ce-51932555ea4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:13:20.920371 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc43489-1c81-46ec-81ce-51932555ea4a admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:13:20.920658 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc43489-1c81-46ec-81ce-51932555ea4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:13:20.920935 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc43489-1c81-46ec-81ce-51932555ea4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:13:20.921679 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc43489-1c81-46ec-81ce-51932555ea4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:13:20.923292 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc43489-1c81-46ec-81ce-51932555ea4a admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:13:20.934215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1361/2738] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:13:20.938640 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c326ac4-1802-4760-b435-08808ead7583 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:13:20.949969 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c326ac4-1802-4760-b435-08808ead7583 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:13:20.955765 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec36870-2cc9-42d0-a053-c6d578acab87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:13:20.956765 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec36870-2cc9-42d0-a053-c6d578acab87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:13:20.957129 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec36870-2cc9-42d0-a053-c6d578acab87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:13:20.957409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec36870-2cc9-42d0-a053-c6d578acab87 admin admin] PATH_INFO: `/v3/projects/845c1cf063fe4cdca853ad714bb422a0/users/ccac020fddaf4ddb892ee62ffff96e80/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:13:20.972326 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec36870-2cc9-42d0-a053-c6d578acab87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=845c1cf063fe4cdca853ad714bb422a0, user_id=ccac020fddaf4ddb892ee62ffff96e80, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:13:20.975031 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec36870-2cc9-42d0-a053-c6d578acab87 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:13:20.990592 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1378/2739] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:13:20 2022] PUT /identity/v3/projects/845c1cf063fe4cdca853ad714bb422a0/users/ccac020fddaf4ddb892ee62ffff96e80/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:13:20.996696 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2647cc2-b116-4cbd-a9a8-71b822c81ea8 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:13:20.997082 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2647cc2-b116-4cbd-a9a8-71b822c81ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:13:20.997402 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2647cc2-b116-4cbd-a9a8-71b822c81ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:13:21.023140 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-a2647cc2-b116-4cbd-a9a8-71b822c81ea8 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:13:21.024280 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a2647cc2-b116-4cbd-a9a8-71b822c81ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:13:21.089630 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1362/2740] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:13:21.099890 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec36870-2cc9-42d0-a053-c6d578acab87 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:13:21.102097 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-dec36870-2cc9-42d0-a053-c6d578acab87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:13:21.161774 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec36870-2cc9-42d0-a053-c6d578acab87 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:13:21.165849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae03297-c84c-4668-bd0a-e46ee4a36823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:13:21.166502 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae03297-c84c-4668-bd0a-e46ee4a36823 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:13:21.166780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae03297-c84c-4668-bd0a-e46ee4a36823 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:13:21.167052 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae03297-c84c-4668-bd0a-e46ee4a36823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:13:21.176811 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae03297-c84c-4668-bd0a-e46ee4a36823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:13:21.178262 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae03297-c84c-4668-bd0a-e46ee4a36823 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:13:21.191835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1379/2741] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:13:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:13:25.079047 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0b6b9-4ff9-4393-843e-cff1f990fac4 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:13:25.079570 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0b6b9-4ff9-4393-843e-cff1f990fac4 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:13:25.079688 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0b6b9-4ff9-4393-843e-cff1f990fac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:13:25.108187 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-6ce0b6b9-4ff9-4393-843e-cff1f990fac4 None None] MFA Rules not processed for user `ccac020fddaf4ddb892ee62ffff96e80`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:13:25.109336 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-6ce0b6b9-4ff9-4393-843e-cff1f990fac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:13:25.177121 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1363/2742] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:13:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:13:25.191975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae03297-c84c-4668-bd0a-e46ee4a36823 service neutron] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:13:25.193491 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-fae03297-c84c-4668-bd0a-e46ee4a36823 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:13:25.236690 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:13:25.274114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae03297-c84c-4668-bd0a-e46ee4a36823 service neutron] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:13:25.280327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bdbd4-4d54-4351-bdf1-7c3caa2768f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:13:25.281001 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bdbd4-4d54-4351-bdf1-7c3caa2768f0 service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:13:25.281280 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bdbd4-4d54-4351-bdf1-7c3caa2768f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:13:25.281548 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bdbd4-4d54-4351-bdf1-7c3caa2768f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:13:25.290440 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bdbd4-4d54-4351-bdf1-7c3caa2768f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:13:25.292106 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bdbd4-4d54-4351-bdf1-7c3caa2768f0 service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:13:25.302148 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1380/2743] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:13:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:13:26.647518 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f34f68-9cbd-4139-9a79-d1f235ba4ae0 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:13:26.648054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f34f68-9cbd-4139-9a79-d1f235ba4ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:13:26.648054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f34f68-9cbd-4139-9a79-d1f235ba4ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:13:26.670685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-d1f34f68-9cbd-4139-9a79-d1f235ba4ae0 None None] MFA Rules not processed for user `ccac020fddaf4ddb892ee62ffff96e80`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:13:26.672418 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-d1f34f68-9cbd-4139-9a79-d1f235ba4ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:13:26.683751 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1364/2744] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:13:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:13:35.297674 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=18 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:13:36.661216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:14:07.531639 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bdbd4-4d54-4351-bdf1-7c3caa2768f0 service nova] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:14:07.533174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-541bdbd4-4d54-4351-bdf1-7c3caa2768f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:14:07.548302 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bdbd4-4d54-4351-bdf1-7c3caa2768f0 service nova] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:14:07.553387 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365daf38-9a0f-47c8-8d69-826a578c701a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:14:07.554043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365daf38-9a0f-47c8-8d69-826a578c701a service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:14:07.554321 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365daf38-9a0f-47c8-8d69-826a578c701a service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:14:07.554633 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365daf38-9a0f-47c8-8d69-826a578c701a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:14:07.556950 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-365daf38-9a0f-47c8-8d69-826a578c701a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:14:07.572699 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365daf38-9a0f-47c8-8d69-826a578c701a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:14:07.574134 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365daf38-9a0f-47c8-8d69-826a578c701a service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:14:07.585321 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1381/2745] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:14:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:14:08.773485 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f34f68-9cbd-4139-9a79-d1f235ba4ae0 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:14:08.789533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f34f68-9cbd-4139-9a79-d1f235ba4ae0 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:14:08.794499 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3af24-3ace-48fb-b4c2-25442ecf178d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:14:08.795149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3af24-3ace-48fb-b4c2-25442ecf178d service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:14:08.795443 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3af24-3ace-48fb-b4c2-25442ecf178d service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:14:08.795725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3af24-3ace-48fb-b4c2-25442ecf178d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:14:08.797586 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-c0e3af24-3ace-48fb-b4c2-25442ecf178d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:14:08.812003 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3af24-3ace-48fb-b4c2-25442ecf178d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:14:08.813446 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3af24-3ace-48fb-b4c2-25442ecf178d service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:14:08.824726 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1365/2746] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:14:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:14:17.580566 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=6 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:14:18.819506 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=6 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:14:30.425755 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365daf38-9a0f-47c8-8d69-826a578c701a service neutron] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:14:30.434734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365daf38-9a0f-47c8-8d69-826a578c701a service neutron] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:14:30.439557 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81552ba1-20c4-42bb-b3be-1a39c139b941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:14:30.440240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81552ba1-20c4-42bb-b3be-1a39c139b941 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:14:30.440518 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81552ba1-20c4-42bb-b3be-1a39c139b941 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:14:30.440758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81552ba1-20c4-42bb-b3be-1a39c139b941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:14:30.442809 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-81552ba1-20c4-42bb-b3be-1a39c139b941 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:14:30.455723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81552ba1-20c4-42bb-b3be-1a39c139b941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:14:30.457171 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81552ba1-20c4-42bb-b3be-1a39c139b941 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:14:30.465587 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1382/2747] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:14:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:14:30.542341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3af24-3ace-48fb-b4c2-25442ecf178d service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:14:30.551931 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3af24-3ace-48fb-b4c2-25442ecf178d service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:14:30.556194 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833940d-2899-411a-aa05-2ad008899542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:14:30.556841 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833940d-2899-411a-aa05-2ad008899542 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:14:30.557120 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833940d-2899-411a-aa05-2ad008899542 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:14:30.557394 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833940d-2899-411a-aa05-2ad008899542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:14:30.559149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-4833940d-2899-411a-aa05-2ad008899542 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:14:30.574435 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833940d-2899-411a-aa05-2ad008899542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:14:30.575990 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833940d-2899-411a-aa05-2ad008899542 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:14:30.587476 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1366/2748] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:14:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:14:34.641156 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81552ba1-20c4-42bb-b3be-1a39c139b941 service neutron] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:14:34.653732 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81552ba1-20c4-42bb-b3be-1a39c139b941 service neutron] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:14:34.659087 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ff2f8-e43b-4734-919d-b402af0357b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:14:34.659780 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ff2f8-e43b-4734-919d-b402af0357b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:14:34.660080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ff2f8-e43b-4734-919d-b402af0357b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:14:34.660335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ff2f8-e43b-4734-919d-b402af0357b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:14:34.662241 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-206ff2f8-e43b-4734-919d-b402af0357b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:14:34.672915 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ff2f8-e43b-4734-919d-b402af0357b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:14:34.674400 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ff2f8-e43b-4734-919d-b402af0357b1 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:14:34.682805 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1383/2749] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:14:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:14:40.583013 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=6 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:14:44.679570 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=12 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:14:51.403579 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd93eb1-81ba-431a-9049-7fe442001cc8 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:14:51.404160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd93eb1-81ba-431a-9049-7fe442001cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:14:51.404160 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd93eb1-81ba-431a-9049-7fe442001cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:14:51.427803 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-0dd93eb1-81ba-431a-9049-7fe442001cc8 None None] MFA Rules not processed for user `ccac020fddaf4ddb892ee62ffff96e80`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:14:51.429009 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-0dd93eb1-81ba-431a-9049-7fe442001cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:14:51.436947 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1367/2750] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:14:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:14:52.132979 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ff2f8-e43b-4734-919d-b402af0357b1 service neutron] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:14:52.134672 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-206ff2f8-e43b-4734-919d-b402af0357b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:14:52.206222 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ff2f8-e43b-4734-919d-b402af0357b1 service neutron] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:14:52.211840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49285d0e-7d86-44e6-8d19-80e27a4e1cf7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9756f5b9de8a4f23b365a96d309d86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:14:52.212503 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49285d0e-7d86-44e6-8d19-80e27a4e1cf7 service placement] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:14:52.212786 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49285d0e-7d86-44e6-8d19-80e27a4e1cf7 service placement] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:14:52.213061 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49285d0e-7d86-44e6-8d19-80e27a4e1cf7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:14:52.214958 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-49285d0e-7d86-44e6-8d19-80e27a4e1cf7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:14:52.226503 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49285d0e-7d86-44e6-8d19-80e27a4e1cf7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:14:52.228204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49285d0e-7d86-44e6-8d19-80e27a4e1cf7 service placement] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:14:52.238688 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1384/2751] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:14:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:15:01.421738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:15:02.234285 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=32 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:16:12.883565 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd93eb1-81ba-431a-9049-7fe442001cc8 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:16:12.894568 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd93eb1-81ba-431a-9049-7fe442001cc8 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:16:12.899632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d30697-65e0-48f6-b3b5-e53e637f5be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:16:12.900289 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d30697-65e0-48f6-b3b5-e53e637f5be4 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:16:12.900571 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d30697-65e0-48f6-b3b5-e53e637f5be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:16:12.900842 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d30697-65e0-48f6-b3b5-e53e637f5be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:16:12.902829 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-25d30697-65e0-48f6-b3b5-e53e637f5be4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:16:12.964584 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d30697-65e0-48f6-b3b5-e53e637f5be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:16:12.966033 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d30697-65e0-48f6-b3b5-e53e637f5be4 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:16:12.978984 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1368/2752] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:16:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:16:13.877971 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49285d0e-7d86-44e6-8d19-80e27a4e1cf7 service placement] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:16:13.879428 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-49285d0e-7d86-44e6-8d19-80e27a4e1cf7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:16:13.897882 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49285d0e-7d86-44e6-8d19-80e27a4e1cf7 service placement] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:16:13.905678 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec762c-4096-48d1-b55a-98a1192926e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:16:13.911217 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec762c-4096-48d1-b55a-98a1192926e4 service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:16:13.911628 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec762c-4096-48d1-b55a-98a1192926e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:16:13.911979 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec762c-4096-48d1-b55a-98a1192926e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:16:13.914334 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-59ec762c-4096-48d1-b55a-98a1192926e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:16:13.930792 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec762c-4096-48d1-b55a-98a1192926e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:16:13.932824 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec762c-4096-48d1-b55a-98a1192926e4 service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:16:13.945018 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1385/2753] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:16:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:16:17.780701 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d30697-65e0-48f6-b3b5-e53e637f5be4 service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:16:17.789569 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d30697-65e0-48f6-b3b5-e53e637f5be4 service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:16:17.794347 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e35e4-f662-43d4-96ab-37fdf69b0e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:16:17.795350 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e35e4-f662-43d4-96ab-37fdf69b0e8b service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:16:17.795679 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e35e4-f662-43d4-96ab-37fdf69b0e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:16:17.795956 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e35e4-f662-43d4-96ab-37fdf69b0e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:16:17.797747 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-e61e35e4-f662-43d4-96ab-37fdf69b0e8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:16:17.810545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e35e4-f662-43d4-96ab-37fdf69b0e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:16:17.812044 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e35e4-f662-43d4-96ab-37fdf69b0e8b service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:16:17.821682 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1369/2754] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:16:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:16:20.662619 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec762c-4096-48d1-b55a-98a1192926e4 service nova] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:16:20.664283 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-59ec762c-4096-48d1-b55a-98a1192926e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:16:20.680737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec762c-4096-48d1-b55a-98a1192926e4 service nova] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:16:20.687609 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dee09a-fd07-4c0f-9d1e-717f9f09c6ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9756f5b9de8a4f23b365a96d309d86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:16:20.688683 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dee09a-fd07-4c0f-9d1e-717f9f09c6ce service placement] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:16:20.689327 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dee09a-fd07-4c0f-9d1e-717f9f09c6ce service placement] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:16:20.689978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dee09a-fd07-4c0f-9d1e-717f9f09c6ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:16:20.692255 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-56dee09a-fd07-4c0f-9d1e-717f9f09c6ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:16:20.708829 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dee09a-fd07-4c0f-9d1e-717f9f09c6ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:16:20.710641 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dee09a-fd07-4c0f-9d1e-717f9f09c6ce service placement] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:16:20.728051 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1386/2755] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:16:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:16:23.726432 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e35e4-f662-43d4-96ab-37fdf69b0e8b service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:16:23.757017 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e35e4-f662-43d4-96ab-37fdf69b0e8b service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:16:23.771616 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f29a8-c976-42e2-95ff-a448ab4606ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:16:23.773177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f29a8-c976-42e2-95ff-a448ab4606ad service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:16:23.775205 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f29a8-c976-42e2-95ff-a448ab4606ad service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:16:23.775693 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f29a8-c976-42e2-95ff-a448ab4606ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:16:23.778447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-c54f29a8-c976-42e2-95ff-a448ab4606ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:16:23.800957 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f29a8-c976-42e2-95ff-a448ab4606ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:16:23.803566 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f29a8-c976-42e2-95ff-a448ab4606ad service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:16:23.816792 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1370/2756] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:16:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:16:25.184394 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dee09a-fd07-4c0f-9d1e-717f9f09c6ce service placement] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:16:25.185870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-56dee09a-fd07-4c0f-9d1e-717f9f09c6ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:16:25.201049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dee09a-fd07-4c0f-9d1e-717f9f09c6ce service placement] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:16:25.206175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d352d7-cdc1-4595-a364-cd228a6fd2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:16:25.207070 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d352d7-cdc1-4595-a364-cd228a6fd2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:16:25.207346 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d352d7-cdc1-4595-a364-cd228a6fd2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:16:25.207882 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d352d7-cdc1-4595-a364-cd228a6fd2f8 admin admin] PATH_INFO: `/v3/users/8d78b45727a94620b8ecab2dbb77db50` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:16:25.208835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d352d7-cdc1-4595-a364-cd228a6fd2f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d78b45727a94620b8ecab2dbb77db50)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:16:25.210781 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d352d7-cdc1-4595-a364-cd228a6fd2f8 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:16:25.261624 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-49d352d7-cdc1-4595-a364-cd228a6fd2f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d78b45727a94620b8ecab2dbb77db50'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:16:25.268791 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-49d352d7-cdc1-4595-a364-cd228a6fd2f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d78b45727a94620b8ecab2dbb77db50'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:16:25.269496 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-49d352d7-cdc1-4595-a364-cd228a6fd2f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d78b45727a94620b8ecab2dbb77db50'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:16:25.270098 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-49d352d7-cdc1-4595-a364-cd228a6fd2f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d78b45727a94620b8ecab2dbb77db50'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:16:25.283284 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-49d352d7-cdc1-4595-a364-cd228a6fd2f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d78b45727a94620b8ecab2dbb77db50'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:16:25.300240 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1387/2757] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:16:25 2022] DELETE /identity/v3/users/8d78b45727a94620b8ecab2dbb77db50 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:16:25.481968 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f29a8-c976-42e2-95ff-a448ab4606ad service nova] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:16:25.493177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f29a8-c976-42e2-95ff-a448ab4606ad service nova] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:16:25.554315 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4be564-a25b-4060-8480-5b21b7402f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:16:25.555212 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4be564-a25b-4060-8480-5b21b7402f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:16:25.555666 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4be564-a25b-4060-8480-5b21b7402f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:16:25.556002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4be564-a25b-4060-8480-5b21b7402f2f admin admin] PATH_INFO: `/v3/projects/410e0d53a5194be4b2ad9a2c28017244` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:16:25.557221 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4be564-a25b-4060-8480-5b21b7402f2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=410e0d53a5194be4b2ad9a2c28017244)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:16:25.559218 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4be564-a25b-4060-8480-5b21b7402f2f admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:16:25.609638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-9b4be564-a25b-4060-8480-5b21b7402f2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '410e0d53a5194be4b2ad9a2c28017244', 'request_id': 'req-9b4be564-a25b-4060-8480-5b21b7402f2f'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:16:25.618898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-9b4be564-a25b-4060-8480-5b21b7402f2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '410e0d53a5194be4b2ad9a2c28017244', 'request_id': 'req-9b4be564-a25b-4060-8480-5b21b7402f2f'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:16:25.625752 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-9b4be564-a25b-4060-8480-5b21b7402f2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '410e0d53a5194be4b2ad9a2c28017244', 'request_id': 'req-9b4be564-a25b-4060-8480-5b21b7402f2f'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:16:25.638672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-9b4be564-a25b-4060-8480-5b21b7402f2f admin admin] The token cache is being invalidate because project 410e0d53a5194be4b2ad9a2c28017244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:16:25.638963 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-9b4be564-a25b-4060-8480-5b21b7402f2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:16:25.639640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-9b4be564-a25b-4060-8480-5b21b7402f2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:16:25.641545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1371/2758] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:16:25 2022] DELETE /identity/v3/projects/410e0d53a5194be4b2ad9a2c28017244 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:16:25.645506 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d352d7-cdc1-4595-a364-cd228a6fd2f8 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:16:25.646928 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-49d352d7-cdc1-4595-a364-cd228a6fd2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:16:25.660753 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d352d7-cdc1-4595-a364-cd228a6fd2f8 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:16:25.716828 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea52c8-444c-4f0e-833a-d45018f902fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:16:25.717713 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea52c8-444c-4f0e-833a-d45018f902fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:16:25.717991 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea52c8-444c-4f0e-833a-d45018f902fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:16:25.718267 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea52c8-444c-4f0e-833a-d45018f902fd admin admin] PATH_INFO: `/v3/users/f35c2e5b1a36494bba53f77518a9ea94` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:16:25.719437 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea52c8-444c-4f0e-833a-d45018f902fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f35c2e5b1a36494bba53f77518a9ea94)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:16:25.721404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea52c8-444c-4f0e-833a-d45018f902fd admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:16:25.770429 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-52ea52c8-444c-4f0e-833a-d45018f902fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f35c2e5b1a36494bba53f77518a9ea94'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:16:25.771723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:16:25.785700 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-52ea52c8-444c-4f0e-833a-d45018f902fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f35c2e5b1a36494bba53f77518a9ea94'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:16:25.786528 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-52ea52c8-444c-4f0e-833a-d45018f902fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f35c2e5b1a36494bba53f77518a9ea94'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:16:25.787212 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-52ea52c8-444c-4f0e-833a-d45018f902fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f35c2e5b1a36494bba53f77518a9ea94'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:16:25.802204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-52ea52c8-444c-4f0e-833a-d45018f902fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f35c2e5b1a36494bba53f77518a9ea94'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:16:25.818771 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1388/2759] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:16:25 2022] DELETE /identity/v3/users/f35c2e5b1a36494bba53f77518a9ea94 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:16:25.993798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4be564-a25b-4060-8480-5b21b7402f2f admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:16:25.995260 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-9b4be564-a25b-4060-8480-5b21b7402f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:16:26.003147 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:16:26.009336 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4be564-a25b-4060-8480-5b21b7402f2f admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:16:26.077737 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cbc47-bd67-434a-9386-689b32f9e2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:16:26.078993 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cbc47-bd67-434a-9386-689b32f9e2ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:16:26.079355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cbc47-bd67-434a-9386-689b32f9e2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:16:26.079800 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cbc47-bd67-434a-9386-689b32f9e2ba admin admin] PATH_INFO: `/v3/projects/e98a67ee0a7244308d6ee899ee2f313f` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:16:26.081625 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807cbc47-bd67-434a-9386-689b32f9e2ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=e98a67ee0a7244308d6ee899ee2f313f)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:16:26.084674 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807cbc47-bd67-434a-9386-689b32f9e2ba admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:16:26.133726 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-807cbc47-bd67-434a-9386-689b32f9e2ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e98a67ee0a7244308d6ee899ee2f313f', 'request_id': 'req-807cbc47-bd67-434a-9386-689b32f9e2ba'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:16:26.142864 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-807cbc47-bd67-434a-9386-689b32f9e2ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e98a67ee0a7244308d6ee899ee2f313f', 'request_id': 'req-807cbc47-bd67-434a-9386-689b32f9e2ba'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:16:26.148957 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-807cbc47-bd67-434a-9386-689b32f9e2ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e98a67ee0a7244308d6ee899ee2f313f', 'request_id': 'req-807cbc47-bd67-434a-9386-689b32f9e2ba'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:16:26.160816 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-807cbc47-bd67-434a-9386-689b32f9e2ba admin admin] The token cache is being invalidate because project e98a67ee0a7244308d6ee899ee2f313f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:16:26.161103 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-807cbc47-bd67-434a-9386-689b32f9e2ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:16:26.161742 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-807cbc47-bd67-434a-9386-689b32f9e2ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:16:26.163376 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1372/2760] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:16:25 2022] DELETE /identity/v3/projects/e98a67ee0a7244308d6ee899ee2f313f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:16:32.398045 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b7a48-5cfd-4202-b783-4ec99a9e7b12 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:16:32.398602 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b7a48-5cfd-4202-b783-4ec99a9e7b12 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:16:32.398602 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b7a48-5cfd-4202-b783-4ec99a9e7b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:16:32.418355 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-c82b7a48-5cfd-4202-b783-4ec99a9e7b12 None None] MFA Rules not processed for user `ccac020fddaf4ddb892ee62ffff96e80`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:16:32.420024 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-c82b7a48-5cfd-4202-b783-4ec99a9e7b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:16:32.478570 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1389/2761] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:16:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:16:32.818924 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cbc47-bd67-434a-9386-689b32f9e2ba admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:16:32.820433 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-807cbc47-bd67-434a-9386-689b32f9e2ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:16:32.878720 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cbc47-bd67-434a-9386-689b32f9e2ba admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:16:32.882554 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ddf49-1d99-45cd-96ba-45b29bb5489c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:16:32.883215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ddf49-1d99-45cd-96ba-45b29bb5489c service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:16:32.883529 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ddf49-1d99-45cd-96ba-45b29bb5489c service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:16:32.883827 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ddf49-1d99-45cd-96ba-45b29bb5489c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:16:32.885710 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-764ddf49-1d99-45cd-96ba-45b29bb5489c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:16:32.895183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ddf49-1d99-45cd-96ba-45b29bb5489c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:16:32.896642 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ddf49-1d99-45cd-96ba-45b29bb5489c service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:16:32.904544 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1373/2762] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:16:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:16:42.471315 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=37,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:16:42.657374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b7a48-5cfd-4202-b783-4ec99a9e7b12 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:16:42.659074 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-c82b7a48-5cfd-4202-b783-4ec99a9e7b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:16:42.786321 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b7a48-5cfd-4202-b783-4ec99a9e7b12 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:16:42.793198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ef8a9-6eaa-4e63-b43a-2ce069da99b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:16:42.793591 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ef8a9-6eaa-4e63-b43a-2ce069da99b3 service nova] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:16:42.794132 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ef8a9-6eaa-4e63-b43a-2ce069da99b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:16:42.794359 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ef8a9-6eaa-4e63-b43a-2ce069da99b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:16:42.796946 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-416ef8a9-6eaa-4e63-b43a-2ce069da99b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:16:42.810002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ef8a9-6eaa-4e63-b43a-2ce069da99b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:16:42.811645 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ef8a9-6eaa-4e63-b43a-2ce069da99b3 service nova] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:16:42.823844 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1390/2763] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:16:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:16:42.900925 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:16:52.819163 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=56 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:18:10.115123 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ddf49-1d99-45cd-96ba-45b29bb5489c service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:18:10.116764 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-764ddf49-1d99-45cd-96ba-45b29bb5489c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:18:10.244330 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ddf49-1d99-45cd-96ba-45b29bb5489c service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:18:10.249880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77e6f4-b8d9-40b5-b344-bdd08ed63f0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9756f5b9de8a4f23b365a96d309d86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:18:10.250528 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77e6f4-b8d9-40b5-b344-bdd08ed63f0f service placement] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:18:10.250818 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77e6f4-b8d9-40b5-b344-bdd08ed63f0f service placement] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:18:10.251099 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77e6f4-b8d9-40b5-b344-bdd08ed63f0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:18:10.252976 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-ae77e6f4-b8d9-40b5-b344-bdd08ed63f0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:18:10.265403 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77e6f4-b8d9-40b5-b344-bdd08ed63f0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:18:10.266953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77e6f4-b8d9-40b5-b344-bdd08ed63f0f service placement] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:18:10.277374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1374/2764] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:18:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:18:12.726797 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fab325-fcf4-4da7-a904-3176bd3c5efb None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:18:12.727437 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fab325-fcf4-4da7-a904-3176bd3c5efb None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:18:12.727437 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fab325-fcf4-4da7-a904-3176bd3c5efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:18:12.745364 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-d8fab325-fcf4-4da7-a904-3176bd3c5efb None None] MFA Rules not processed for user `ccac020fddaf4ddb892ee62ffff96e80`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:18:12.746553 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-d8fab325-fcf4-4da7-a904-3176bd3c5efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:18:12.754349 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1391/2765] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:18:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:18:20.273773 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=54 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:18:22.740393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:19:29.734071 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77e6f4-b8d9-40b5-b344-bdd08ed63f0f service placement] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:29.735894 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-ae77e6f4-b8d9-40b5-b344-bdd08ed63f0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:29.781144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77e6f4-b8d9-40b5-b344-bdd08ed63f0f service placement] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:29.787199 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0ff59-b0ef-4633-b257-f88be570c255 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d3b5180fb7144c394c39d4db28713b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:29.787890 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0ff59-b0ef-4633-b257-f88be570c255 service nova] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:29.788174 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0ff59-b0ef-4633-b257-f88be570c255 service nova] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:29.788452 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0ff59-b0ef-4633-b257-f88be570c255 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:29.790303 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-66d0ff59-b0ef-4633-b257-f88be570c255 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:29.801245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0ff59-b0ef-4633-b257-f88be570c255 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:29.802826 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0ff59-b0ef-4633-b257-f88be570c255 service nova] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:29.814787 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1375/2766] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:19:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:19:31.258287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fab325-fcf4-4da7-a904-3176bd3c5efb None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:31.260834 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-d8fab325-fcf4-4da7-a904-3176bd3c5efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:31.322077 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fab325-fcf4-4da7-a904-3176bd3c5efb None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:31.325997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a691861-748f-459f-b651-7335e774af11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:31.326651 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a691861-748f-459f-b651-7335e774af11 service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:31.326930 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a691861-748f-459f-b651-7335e774af11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:31.327198 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a691861-748f-459f-b651-7335e774af11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:31.329382 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5a691861-748f-459f-b651-7335e774af11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:31.343937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a691861-748f-459f-b651-7335e774af11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:31.345419 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a691861-748f-459f-b651-7335e774af11 service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:31.357112 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1392/2767] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:19:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:19:33.996815 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0ff59-b0ef-4633-b257-f88be570c255 service nova] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:34.008271 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0ff59-b0ef-4633-b257-f88be570c255 service nova] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:34.013108 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448677bf-6058-4c0c-89e2-5cac678f6869 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:34.014092 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448677bf-6058-4c0c-89e2-5cac678f6869 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:34.014375 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448677bf-6058-4c0c-89e2-5cac678f6869 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:34.014649 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448677bf-6058-4c0c-89e2-5cac678f6869 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:34.017345 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-448677bf-6058-4c0c-89e2-5cac678f6869 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:34.032059 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448677bf-6058-4c0c-89e2-5cac678f6869 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:34.033836 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448677bf-6058-4c0c-89e2-5cac678f6869 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:34.046292 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1376/2768] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:19:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:19:41.352083 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=26 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:19:43.379902 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a691861-748f-459f-b651-7335e774af11 service cinder] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:43.400459 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a691861-748f-459f-b651-7335e774af11 service cinder] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:43.404659 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14820eeb-88d4-43f2-96d8-8bca34eac468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:43.405309 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14820eeb-88d4-43f2-96d8-8bca34eac468 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:43.405589 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14820eeb-88d4-43f2-96d8-8bca34eac468 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:43.405858 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14820eeb-88d4-43f2-96d8-8bca34eac468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:43.407812 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-14820eeb-88d4-43f2-96d8-8bca34eac468 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:43.501558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14820eeb-88d4-43f2-96d8-8bca34eac468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:43.503023 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14820eeb-88d4-43f2-96d8-8bca34eac468 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:43.522759 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1393/2769] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:19:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:19:44.040205 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=24 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:19:46.630766 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448677bf-6058-4c0c-89e2-5cac678f6869 service cinder] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:46.642790 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448677bf-6058-4c0c-89e2-5cac678f6869 service cinder] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:46.652595 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f967e6-85e9-427e-ae80-f2c3b97c407a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9756f5b9de8a4f23b365a96d309d86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:46.653289 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f967e6-85e9-427e-ae80-f2c3b97c407a service placement] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:46.653578 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f967e6-85e9-427e-ae80-f2c3b97c407a service placement] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:46.653982 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f967e6-85e9-427e-ae80-f2c3b97c407a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:46.656209 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-95f967e6-85e9-427e-ae80-f2c3b97c407a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:46.670925 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f967e6-85e9-427e-ae80-f2c3b97c407a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:46.672599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f967e6-85e9-427e-ae80-f2c3b97c407a service placement] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:46.687742 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1377/2770] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:19:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:19:46.702080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14820eeb-88d4-43f2-96d8-8bca34eac468 service neutron] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:46.702080 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-14820eeb-88d4-43f2-96d8-8bca34eac468 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:46.712890 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14820eeb-88d4-43f2-96d8-8bca34eac468 service neutron] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:46.720313 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ff6dc-b0ad-45ca-8087-fe50b8d22420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:46.721992 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ff6dc-b0ad-45ca-8087-fe50b8d22420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:46.722345 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ff6dc-b0ad-45ca-8087-fe50b8d22420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:46.722690 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ff6dc-b0ad-45ca-8087-fe50b8d22420 admin admin] PATH_INFO: `/v3/users/ccac020fddaf4ddb892ee62ffff96e80` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:46.724931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ff6dc-b0ad-45ca-8087-fe50b8d22420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccac020fddaf4ddb892ee62ffff96e80)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:46.731540 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ff6dc-b0ad-45ca-8087-fe50b8d22420 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:46.790634 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-485ff6dc-b0ad-45ca-8087-fe50b8d22420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccac020fddaf4ddb892ee62ffff96e80'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:46.798898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-485ff6dc-b0ad-45ca-8087-fe50b8d22420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccac020fddaf4ddb892ee62ffff96e80'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:46.799636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-485ff6dc-b0ad-45ca-8087-fe50b8d22420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccac020fddaf4ddb892ee62ffff96e80'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:46.800247 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-485ff6dc-b0ad-45ca-8087-fe50b8d22420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccac020fddaf4ddb892ee62ffff96e80'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:46.813002 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-485ff6dc-b0ad-45ca-8087-fe50b8d22420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccac020fddaf4ddb892ee62ffff96e80'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:46.831661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1394/2771] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:19:46 2022] DELETE /identity/v3/users/ccac020fddaf4ddb892ee62ffff96e80 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:19:47.012667 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f967e6-85e9-427e-ae80-f2c3b97c407a service placement] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:47.024957 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f967e6-85e9-427e-ae80-f2c3b97c407a service placement] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:47.094703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e395bd-f477-4621-ae68-6047f3128e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:47.095638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e395bd-f477-4621-ae68-6047f3128e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:47.095926 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e395bd-f477-4621-ae68-6047f3128e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:47.096204 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e395bd-f477-4621-ae68-6047f3128e87 admin admin] PATH_INFO: `/v3/projects/845c1cf063fe4cdca853ad714bb422a0` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:47.097413 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e395bd-f477-4621-ae68-6047f3128e87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=845c1cf063fe4cdca853ad714bb422a0)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:47.099355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e395bd-f477-4621-ae68-6047f3128e87 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:47.150809 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-b0e395bd-f477-4621-ae68-6047f3128e87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '845c1cf063fe4cdca853ad714bb422a0', 'request_id': 'req-b0e395bd-f477-4621-ae68-6047f3128e87'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:47.159082 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-b0e395bd-f477-4621-ae68-6047f3128e87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '845c1cf063fe4cdca853ad714bb422a0', 'request_id': 'req-b0e395bd-f477-4621-ae68-6047f3128e87'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:47.165552 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-b0e395bd-f477-4621-ae68-6047f3128e87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '845c1cf063fe4cdca853ad714bb422a0', 'request_id': 'req-b0e395bd-f477-4621-ae68-6047f3128e87'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:47.176903 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-b0e395bd-f477-4621-ae68-6047f3128e87 admin admin] The token cache is being invalidate because project 845c1cf063fe4cdca853ad714bb422a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:19:47.177196 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-b0e395bd-f477-4621-ae68-6047f3128e87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:47.177826 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-b0e395bd-f477-4621-ae68-6047f3128e87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:47.180668 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1378/2772] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:19:47 2022] DELETE /identity/v3/projects/845c1cf063fe4cdca853ad714bb422a0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:19:47.186531 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a6f03-f6cc-43af-9681-56101300ca35 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:47.186879 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a6f03-f6cc-43af-9681-56101300ca35 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:47.187223 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a6f03-f6cc-43af-9681-56101300ca35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:47.235031 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:19:47.256120 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-fd9a6f03-f6cc-43af-9681-56101300ca35 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:19:47.257473 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-fd9a6f03-f6cc-43af-9681-56101300ca35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:47.324411 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1395/2773] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:19:47.332541 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59d20c-541f-45d1-bf1d-e60ba37156dc None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:47.332832 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59d20c-541f-45d1-bf1d-e60ba37156dc None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:47.333110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59d20c-541f-45d1-bf1d-e60ba37156dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:47.354247 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-fd59d20c-541f-45d1-bf1d-e60ba37156dc None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:19:47.355503 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-fd59d20c-541f-45d1-bf1d-e60ba37156dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:47.365125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1379/2774] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:19:47.369474 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a6f03-f6cc-43af-9681-56101300ca35 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:47.380163 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a6f03-f6cc-43af-9681-56101300ca35 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:47.385680 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134a8e3-235e-4a49-936f-338f616b3ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:47.386346 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134a8e3-235e-4a49-936f-338f616b3ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:47.386627 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134a8e3-235e-4a49-936f-338f616b3ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:47.386901 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134a8e3-235e-4a49-936f-338f616b3ef7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:47.387673 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134a8e3-235e-4a49-936f-338f616b3ef7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:19:47.387980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134a8e3-235e-4a49-936f-338f616b3ef7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:47.389597 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134a8e3-235e-4a49-936f-338f616b3ef7 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:47.401890 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1396/2775] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:19:47.406811 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59d20c-541f-45d1-bf1d-e60ba37156dc None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:47.422107 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59d20c-541f-45d1-bf1d-e60ba37156dc None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:47.430386 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e4b4a-ab3e-4c7a-a060-3da79af93f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:47.431046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e4b4a-ab3e-4c7a-a060-3da79af93f1b admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:47.431328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e4b4a-ab3e-4c7a-a060-3da79af93f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:47.431634 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e4b4a-ab3e-4c7a-a060-3da79af93f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:47.432328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e4b4a-ab3e-4c7a-a060-3da79af93f1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:47.434262 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e4b4a-ab3e-4c7a-a060-3da79af93f1b admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:47.462125 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1380/2776] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:19:47 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:19:47.466316 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134a8e3-235e-4a49-936f-338f616b3ef7 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:47.476459 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134a8e3-235e-4a49-936f-338f616b3ef7 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:47.536609 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbff67-1d35-47fe-a051-d242e58ddcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:47.537301 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbff67-1d35-47fe-a051-d242e58ddcfe admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:47.537642 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbff67-1d35-47fe-a051-d242e58ddcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:47.538046 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbff67-1d35-47fe-a051-d242e58ddcfe admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:47.538588 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbff67-1d35-47fe-a051-d242e58ddcfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:47.540587 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbff67-1d35-47fe-a051-d242e58ddcfe admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:47.563777 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1397/2777] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:19:47 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:19:47.567940 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e4b4a-ab3e-4c7a-a060-3da79af93f1b admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:47.578798 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e4b4a-ab3e-4c7a-a060-3da79af93f1b admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:47.583921 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2de02d-bd62-48de-9d00-df61deb216bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:47.584692 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de02d-bd62-48de-9d00-df61deb216bd admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:47.584969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de02d-bd62-48de-9d00-df61deb216bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:47.585238 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de02d-bd62-48de-9d00-df61deb216bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:47.585962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2de02d-bd62-48de-9d00-df61deb216bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:47.587605 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2de02d-bd62-48de-9d00-df61deb216bd admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:47.598351 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1381/2778] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:19:47.602670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbff67-1d35-47fe-a051-d242e58ddcfe admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:47.613342 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbff67-1d35-47fe-a051-d242e58ddcfe admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:47.619010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5098355-e58b-4e59-8dc1-b479803ee5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:47.619725 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5098355-e58b-4e59-8dc1-b479803ee5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:47.620004 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5098355-e58b-4e59-8dc1-b479803ee5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:47.620278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5098355-e58b-4e59-8dc1-b479803ee5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:47.621006 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5098355-e58b-4e59-8dc1-b479803ee5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:47.622609 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5098355-e58b-4e59-8dc1-b479803ee5d2 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:47.632947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1398/2779] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:19:47.637384 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2de02d-bd62-48de-9d00-df61deb216bd admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:47.648223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2de02d-bd62-48de-9d00-df61deb216bd admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:47.654135 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052186a8-3e04-4861-81f4-74a19a9c9e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:47.654960 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052186a8-3e04-4861-81f4-74a19a9c9e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:47.655242 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052186a8-3e04-4861-81f4-74a19a9c9e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:47.655719 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052186a8-3e04-4861-81f4-74a19a9c9e36 admin admin] PATH_INFO: `/v3/projects/8474a88619204cfb8e406895d11f2b3c/users/525a1875ea7c4899a2a8f7428852789c/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:47.671796 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052186a8-3e04-4861-81f4-74a19a9c9e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8474a88619204cfb8e406895d11f2b3c, user_id=525a1875ea7c4899a2a8f7428852789c, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:47.674516 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052186a8-3e04-4861-81f4-74a19a9c9e36 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:47.689133 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1382/2780] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:19:47 2022] PUT /identity/v3/projects/8474a88619204cfb8e406895d11f2b3c/users/525a1875ea7c4899a2a8f7428852789c/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:19:47.700501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd65ce-0d2d-4c1b-af0c-5606e2ac3572 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:47.700809 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd65ce-0d2d-4c1b-af0c-5606e2ac3572 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:47.701081 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd65ce-0d2d-4c1b-af0c-5606e2ac3572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:47.729017 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-01fd65ce-0d2d-4c1b-af0c-5606e2ac3572 None None] MFA Rules not processed for user `525a1875ea7c4899a2a8f7428852789c`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:19:47.730218 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-01fd65ce-0d2d-4c1b-af0c-5606e2ac3572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:47.796574 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:19:47.808300 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1399/2781] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:19:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:19:47.814419 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052186a8-3e04-4861-81f4-74a19a9c9e36 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:47.828794 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:19:47.882302 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052186a8-3e04-4861-81f4-74a19a9c9e36 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:47.888166 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33925c-af8c-45bf-99e0-920397b54710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:47.888835 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33925c-af8c-45bf-99e0-920397b54710 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:47.889126 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33925c-af8c-45bf-99e0-920397b54710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:47.889395 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33925c-af8c-45bf-99e0-920397b54710 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:47.890096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33925c-af8c-45bf-99e0-920397b54710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:47.892053 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33925c-af8c-45bf-99e0-920397b54710 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:47.920109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1383/2782] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:19:47 2022] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:19:47.923994 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd65ce-0d2d-4c1b-af0c-5606e2ac3572 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:47.936020 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd65ce-0d2d-4c1b-af0c-5606e2ac3572 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:47.992701 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce6859-960b-4c17-8c39-4488bcac74b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:47.993370 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce6859-960b-4c17-8c39-4488bcac74b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:47.993650 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce6859-960b-4c17-8c39-4488bcac74b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:47.993926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce6859-960b-4c17-8c39-4488bcac74b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:47.994634 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce6859-960b-4c17-8c39-4488bcac74b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:47.996608 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce6859-960b-4c17-8c39-4488bcac74b7 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:48.023850 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1400/2783] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:19:47 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:19:48.027921 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33925c-af8c-45bf-99e0-920397b54710 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:48.038514 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33925c-af8c-45bf-99e0-920397b54710 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:48.043525 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21251b62-8108-4b79-b637-8f1b8507e7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:48.044202 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21251b62-8108-4b79-b637-8f1b8507e7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:48.044486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21251b62-8108-4b79-b637-8f1b8507e7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:48.045101 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21251b62-8108-4b79-b637-8f1b8507e7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:48.045848 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21251b62-8108-4b79-b637-8f1b8507e7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:48.047488 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21251b62-8108-4b79-b637-8f1b8507e7d1 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:48.059329 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1384/2784] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:19:48.064314 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce6859-960b-4c17-8c39-4488bcac74b7 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:48.076631 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce6859-960b-4c17-8c39-4488bcac74b7 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:48.082246 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d125f-4ac0-4115-85f7-ccbe5cbc8079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:48.083139 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d125f-4ac0-4115-85f7-ccbe5cbc8079 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:48.083435 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d125f-4ac0-4115-85f7-ccbe5cbc8079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:48.083727 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d125f-4ac0-4115-85f7-ccbe5cbc8079 admin admin] PATH_INFO: `/v3/projects/831e192d5813429182c8d651e43c536c/users/bf8a9f47c95345c082097d76a7dc2ef6/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:48.099577 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d125f-4ac0-4115-85f7-ccbe5cbc8079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=831e192d5813429182c8d651e43c536c, user_id=bf8a9f47c95345c082097d76a7dc2ef6, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:48.102319 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d125f-4ac0-4115-85f7-ccbe5cbc8079 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:48.120102 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1401/2785] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:19:48 2022] PUT /identity/v3/projects/831e192d5813429182c8d651e43c536c/users/bf8a9f47c95345c082097d76a7dc2ef6/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:19:48.124159 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21251b62-8108-4b79-b637-8f1b8507e7d1 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:48.134496 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21251b62-8108-4b79-b637-8f1b8507e7d1 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:48.195967 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407156b-d9db-4745-a56e-0e76e740e343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:48.196564 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407156b-d9db-4745-a56e-0e76e740e343 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:48.196845 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407156b-d9db-4745-a56e-0e76e740e343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:48.197114 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407156b-d9db-4745-a56e-0e76e740e343 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:48.197934 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407156b-d9db-4745-a56e-0e76e740e343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:48.199637 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407156b-d9db-4745-a56e-0e76e740e343 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:48.212861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1385/2786] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:19:48.217253 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d125f-4ac0-4115-85f7-ccbe5cbc8079 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:48.227831 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d125f-4ac0-4115-85f7-ccbe5cbc8079 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:48.233255 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51269f18-3cad-40b5-b22d-c5d547c781b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:48.234335 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51269f18-3cad-40b5-b22d-c5d547c781b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:48.234616 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51269f18-3cad-40b5-b22d-c5d547c781b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:48.234893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51269f18-3cad-40b5-b22d-c5d547c781b5 admin admin] PATH_INFO: `/v3/projects/831e192d5813429182c8d651e43c536c/users/bf8a9f47c95345c082097d76a7dc2ef6/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:48.236911 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51269f18-3cad-40b5-b22d-c5d547c781b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=831e192d5813429182c8d651e43c536c, user_id=bf8a9f47c95345c082097d76a7dc2ef6, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:48.239631 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51269f18-3cad-40b5-b22d-c5d547c781b5 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:48.250569 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1402/2787] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:19:48 2022] PUT /identity/v3/projects/831e192d5813429182c8d651e43c536c/users/bf8a9f47c95345c082097d76a7dc2ef6/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:19:48.260803 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ed2d5-04fc-48f7-9135-2e4b4208d456 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:48.261090 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ed2d5-04fc-48f7-9135-2e4b4208d456 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:48.261366 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ed2d5-04fc-48f7-9135-2e4b4208d456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:48.289391 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-9d6ed2d5-04fc-48f7-9135-2e4b4208d456 None None] MFA Rules not processed for user `bf8a9f47c95345c082097d76a7dc2ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:19:48.290577 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-9d6ed2d5-04fc-48f7-9135-2e4b4208d456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:48.364575 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1386/2788] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:19:48 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:19:48.378193 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51269f18-3cad-40b5-b22d-c5d547c781b5 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:48.380544 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-51269f18-3cad-40b5-b22d-c5d547c781b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:48.443430 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51269f18-3cad-40b5-b22d-c5d547c781b5 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:48.448596 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bd473-fb4e-4792-ae7d-360b0ede7108 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:48.449192 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bd473-fb4e-4792-ae7d-360b0ede7108 service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:48.449484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bd473-fb4e-4792-ae7d-360b0ede7108 service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:48.449789 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bd473-fb4e-4792-ae7d-360b0ede7108 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:48.461051 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bd473-fb4e-4792-ae7d-360b0ede7108 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:48.462528 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bd473-fb4e-4792-ae7d-360b0ede7108 service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:48.472297 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1403/2789] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:19:48 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:19:48.558110 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ed2d5-04fc-48f7-9135-2e4b4208d456 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:48.568104 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ed2d5-04fc-48f7-9135-2e4b4208d456 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:48.573032 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf41ec-c988-49c1-ad61-e6f9cf06307b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:48.573833 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf41ec-c988-49c1-ad61-e6f9cf06307b service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:48.574121 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf41ec-c988-49c1-ad61-e6f9cf06307b service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:48.574398 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf41ec-c988-49c1-ad61-e6f9cf06307b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:48.580202 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:19:48.637373 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf41ec-c988-49c1-ad61-e6f9cf06307b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:48.638865 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf41ec-c988-49c1-ad61-e6f9cf06307b service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:48.648504 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1387/2790] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:19:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:19:51.402278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bd473-fb4e-4792-ae7d-360b0ede7108 service cinder] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:51.455895 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:19:51.471590 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bd473-fb4e-4792-ae7d-360b0ede7108 service cinder] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:51.477025 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cf9bd-a2ad-49bd-a2fe-d5afdf6705e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:51.477921 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cf9bd-a2ad-49bd-a2fe-d5afdf6705e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:51.478206 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cf9bd-a2ad-49bd-a2fe-d5afdf6705e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:51.478482 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cf9bd-a2ad-49bd-a2fe-d5afdf6705e9 admin admin] PATH_INFO: `/v3/users/525a1875ea7c4899a2a8f7428852789c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:51.479734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4cf9bd-a2ad-49bd-a2fe-d5afdf6705e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=525a1875ea7c4899a2a8f7428852789c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:51.481709 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4cf9bd-a2ad-49bd-a2fe-d5afdf6705e9 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:51.532181 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-5c4cf9bd-a2ad-49bd-a2fe-d5afdf6705e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '525a1875ea7c4899a2a8f7428852789c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:51.540046 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-5c4cf9bd-a2ad-49bd-a2fe-d5afdf6705e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '525a1875ea7c4899a2a8f7428852789c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:51.540731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-5c4cf9bd-a2ad-49bd-a2fe-d5afdf6705e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '525a1875ea7c4899a2a8f7428852789c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:51.541340 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-5c4cf9bd-a2ad-49bd-a2fe-d5afdf6705e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '525a1875ea7c4899a2a8f7428852789c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:51.554523 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-5c4cf9bd-a2ad-49bd-a2fe-d5afdf6705e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '525a1875ea7c4899a2a8f7428852789c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:51.569830 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1404/2791] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:19:51 2022] DELETE /identity/v3/users/525a1875ea7c4899a2a8f7428852789c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:19:51.574432 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432aac4-c1d7-4cd5-a6fb-046c041f1b0d None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:51.574931 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432aac4-c1d7-4cd5-a6fb-046c041f1b0d None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:51.575049 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432aac4-c1d7-4cd5-a6fb-046c041f1b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:51.592851 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-e432aac4-c1d7-4cd5-a6fb-046c041f1b0d None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:19:51.594117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-e432aac4-c1d7-4cd5-a6fb-046c041f1b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:51.668326 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1388/2792] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:19:51.678631 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cf9bd-a2ad-49bd-a2fe-d5afdf6705e9 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:51.680333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5c4cf9bd-a2ad-49bd-a2fe-d5afdf6705e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:51.760227 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cf9bd-a2ad-49bd-a2fe-d5afdf6705e9 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:51.764625 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e6e13-e174-4dca-b344-a3855e15bc30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:51.765286 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e6e13-e174-4dca-b344-a3855e15bc30 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:51.765570 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e6e13-e174-4dca-b344-a3855e15bc30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:51.765840 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e6e13-e174-4dca-b344-a3855e15bc30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:51.775149 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e6e13-e174-4dca-b344-a3855e15bc30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:51.776634 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e6e13-e174-4dca-b344-a3855e15bc30 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:51.786287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1405/2793] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:19:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:19:52.067980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432aac4-c1d7-4cd5-a6fb-046c041f1b0d None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:52.069475 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-e432aac4-c1d7-4cd5-a6fb-046c041f1b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:52.083667 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432aac4-c1d7-4cd5-a6fb-046c041f1b0d None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:52.089127 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f808740-5b1c-404d-8c78-2031f69f9da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:52.090011 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f808740-5b1c-404d-8c78-2031f69f9da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:52.090293 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f808740-5b1c-404d-8c78-2031f69f9da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:52.090579 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f808740-5b1c-404d-8c78-2031f69f9da1 admin admin] PATH_INFO: `/v3/projects/8474a88619204cfb8e406895d11f2b3c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:52.091941 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f808740-5b1c-404d-8c78-2031f69f9da1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8474a88619204cfb8e406895d11f2b3c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:52.093984 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f808740-5b1c-404d-8c78-2031f69f9da1 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:52.147272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-0f808740-5b1c-404d-8c78-2031f69f9da1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8474a88619204cfb8e406895d11f2b3c', 'request_id': 'req-0f808740-5b1c-404d-8c78-2031f69f9da1'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:52.156293 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-0f808740-5b1c-404d-8c78-2031f69f9da1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8474a88619204cfb8e406895d11f2b3c', 'request_id': 'req-0f808740-5b1c-404d-8c78-2031f69f9da1'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:52.161940 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-0f808740-5b1c-404d-8c78-2031f69f9da1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8474a88619204cfb8e406895d11f2b3c', 'request_id': 'req-0f808740-5b1c-404d-8c78-2031f69f9da1'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:52.173550 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-0f808740-5b1c-404d-8c78-2031f69f9da1 admin admin] The token cache is being invalidate because project 8474a88619204cfb8e406895d11f2b3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:19:52.173840 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-0f808740-5b1c-404d-8c78-2031f69f9da1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:52.174619 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-0f808740-5b1c-404d-8c78-2031f69f9da1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:52.176284 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1389/2794] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:19:52 2022] DELETE /identity/v3/projects/8474a88619204cfb8e406895d11f2b3c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:19:52.180596 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e6e13-e174-4dca-b344-a3855e15bc30 service neutron] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:52.190899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e6e13-e174-4dca-b344-a3855e15bc30 service neutron] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:52.257817 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59822704-6308-415c-a16c-ee72d3e1700b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:52.258699 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59822704-6308-415c-a16c-ee72d3e1700b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:52.258973 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59822704-6308-415c-a16c-ee72d3e1700b admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:52.259247 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59822704-6308-415c-a16c-ee72d3e1700b admin admin] PATH_INFO: `/v3/users/bf8a9f47c95345c082097d76a7dc2ef6` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:52.260488 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59822704-6308-415c-a16c-ee72d3e1700b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf8a9f47c95345c082097d76a7dc2ef6)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:52.262438 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59822704-6308-415c-a16c-ee72d3e1700b admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:52.263981 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:19:52.314209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-59822704-6308-415c-a16c-ee72d3e1700b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf8a9f47c95345c082097d76a7dc2ef6'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:52.321739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-59822704-6308-415c-a16c-ee72d3e1700b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf8a9f47c95345c082097d76a7dc2ef6'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:52.322419 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-59822704-6308-415c-a16c-ee72d3e1700b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf8a9f47c95345c082097d76a7dc2ef6'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:52.323043 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-59822704-6308-415c-a16c-ee72d3e1700b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf8a9f47c95345c082097d76a7dc2ef6'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:52.335133 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-59822704-6308-415c-a16c-ee72d3e1700b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf8a9f47c95345c082097d76a7dc2ef6'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:52.350614 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1406/2795] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:19:52 2022] DELETE /identity/v3/users/bf8a9f47c95345c082097d76a7dc2ef6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:19:52.630920 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f808740-5b1c-404d-8c78-2031f69f9da1 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:52.632578 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-0f808740-5b1c-404d-8c78-2031f69f9da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:52.646394 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f808740-5b1c-404d-8c78-2031f69f9da1 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:52.679471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:19:52.709338 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d8753-a864-4957-9892-9b3f9b690627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:52.710215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d8753-a864-4957-9892-9b3f9b690627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:52.710552 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d8753-a864-4957-9892-9b3f9b690627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:52.710863 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d8753-a864-4957-9892-9b3f9b690627 admin admin] PATH_INFO: `/v3/projects/831e192d5813429182c8d651e43c536c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:52.712145 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d8753-a864-4957-9892-9b3f9b690627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=831e192d5813429182c8d651e43c536c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:52.714065 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d8753-a864-4957-9892-9b3f9b690627 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:52.762320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-989d8753-a864-4957-9892-9b3f9b690627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '831e192d5813429182c8d651e43c536c', 'request_id': 'req-989d8753-a864-4957-9892-9b3f9b690627'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:52.771656 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-989d8753-a864-4957-9892-9b3f9b690627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '831e192d5813429182c8d651e43c536c', 'request_id': 'req-989d8753-a864-4957-9892-9b3f9b690627'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:52.778426 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-989d8753-a864-4957-9892-9b3f9b690627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '831e192d5813429182c8d651e43c536c', 'request_id': 'req-989d8753-a864-4957-9892-9b3f9b690627'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:52.790056 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-989d8753-a864-4957-9892-9b3f9b690627 admin admin] The token cache is being invalidate because project 831e192d5813429182c8d651e43c536c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:19:52.790341 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-989d8753-a864-4957-9892-9b3f9b690627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:52.791027 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-989d8753-a864-4957-9892-9b3f9b690627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:52.792624 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1390/2796] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:19:52 2022] DELETE /identity/v3/projects/831e192d5813429182c8d651e43c536c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:19:52.798483 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8745a-b91c-41a1-b593-9828469da200 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:52.798989 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8745a-b91c-41a1-b593-9828469da200 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:52.798989 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8745a-b91c-41a1-b593-9828469da200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:52.817462 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-4eb8745a-b91c-41a1-b593-9828469da200 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:19:52.818734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-4eb8745a-b91c-41a1-b593-9828469da200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:52.888699 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1407/2797] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:19:52.896703 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ed4cd-99ae-465c-8bfa-e4440bdb4d1d None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:52.896988 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ed4cd-99ae-465c-8bfa-e4440bdb4d1d None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:52.897277 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ed4cd-99ae-465c-8bfa-e4440bdb4d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:52.917418 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-190ed4cd-99ae-465c-8bfa-e4440bdb4d1d None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:19:52.918669 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-190ed4cd-99ae-465c-8bfa-e4440bdb4d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:52.928547 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1391/2798] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:19:52.933107 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8745a-b91c-41a1-b593-9828469da200 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:52.943180 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8745a-b91c-41a1-b593-9828469da200 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:52.948217 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a500e36-a6e3-448c-9560-71fb2a47de7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:52.948877 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a500e36-a6e3-448c-9560-71fb2a47de7f admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:52.949162 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a500e36-a6e3-448c-9560-71fb2a47de7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:52.949440 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a500e36-a6e3-448c-9560-71fb2a47de7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:52.950176 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a500e36-a6e3-448c-9560-71fb2a47de7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:19:52.950481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a500e36-a6e3-448c-9560-71fb2a47de7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:52.952134 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a500e36-a6e3-448c-9560-71fb2a47de7f admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:52.964026 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1408/2799] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:19:52.968477 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ed4cd-99ae-465c-8bfa-e4440bdb4d1d None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:52.978644 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ed4cd-99ae-465c-8bfa-e4440bdb4d1d None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:52.984517 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5ab00-dcd5-4e59-a6b2-148186cfcc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:52.985174 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5ab00-dcd5-4e59-a6b2-148186cfcc59 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:52.985447 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5ab00-dcd5-4e59-a6b2-148186cfcc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:52.985712 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5ab00-dcd5-4e59-a6b2-148186cfcc59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:52.986401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5ab00-dcd5-4e59-a6b2-148186cfcc59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:52.988355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5ab00-dcd5-4e59-a6b2-148186cfcc59 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:53.017835 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1392/2800] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:19:52 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:19:53.022304 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a500e36-a6e3-448c-9560-71fb2a47de7f admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:53.033542 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a500e36-a6e3-448c-9560-71fb2a47de7f admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:53.092351 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047d73a-3c7a-4a07-a71b-9e697139f24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:53.093023 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047d73a-3c7a-4a07-a71b-9e697139f24d admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:53.093300 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047d73a-3c7a-4a07-a71b-9e697139f24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:53.093565 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047d73a-3c7a-4a07-a71b-9e697139f24d admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:53.094246 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047d73a-3c7a-4a07-a71b-9e697139f24d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:53.096221 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047d73a-3c7a-4a07-a71b-9e697139f24d admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:53.106325 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:19:53.120045 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1409/2801] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:19:53 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:19:53.125726 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5ab00-dcd5-4e59-a6b2-148186cfcc59 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:53.137235 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5ab00-dcd5-4e59-a6b2-148186cfcc59 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:53.143050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a41a5-039a-42f8-b959-7cdf9ccace92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:53.143672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a41a5-039a-42f8-b959-7cdf9ccace92 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:53.143952 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a41a5-039a-42f8-b959-7cdf9ccace92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:53.144225 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a41a5-039a-42f8-b959-7cdf9ccace92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:53.145002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a41a5-039a-42f8-b959-7cdf9ccace92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:53.146638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a41a5-039a-42f8-b959-7cdf9ccace92 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:53.157334 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1393/2802] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:19:53.161279 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047d73a-3c7a-4a07-a71b-9e697139f24d admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:53.171655 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047d73a-3c7a-4a07-a71b-9e697139f24d admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:53.176218 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc69253-0ed0-438c-9b76-14a5fa87df36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:53.176850 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc69253-0ed0-438c-9b76-14a5fa87df36 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:53.177128 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc69253-0ed0-438c-9b76-14a5fa87df36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:53.177372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc69253-0ed0-438c-9b76-14a5fa87df36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:53.178125 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc69253-0ed0-438c-9b76-14a5fa87df36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:53.179792 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc69253-0ed0-438c-9b76-14a5fa87df36 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:53.189552 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1410/2803] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:19:53.193612 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a41a5-039a-42f8-b959-7cdf9ccace92 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:53.204266 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a41a5-039a-42f8-b959-7cdf9ccace92 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:53.209322 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba8ef3-1c7f-4ee1-afbb-ad8f3e1c50d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:53.210199 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba8ef3-1c7f-4ee1-afbb-ad8f3e1c50d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:53.210502 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba8ef3-1c7f-4ee1-afbb-ad8f3e1c50d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:53.210770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba8ef3-1c7f-4ee1-afbb-ad8f3e1c50d7 admin admin] PATH_INFO: `/v3/projects/0c0dd53918774432b80c4923807faf53/users/9445b6d7371244fc915ca51c61e337be/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:53.232924 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba8ef3-1c7f-4ee1-afbb-ad8f3e1c50d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c0dd53918774432b80c4923807faf53, user_id=9445b6d7371244fc915ca51c61e337be, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:53.237866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba8ef3-1c7f-4ee1-afbb-ad8f3e1c50d7 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:53.253340 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1394/2804] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:19:53 2022] PUT /identity/v3/projects/0c0dd53918774432b80c4923807faf53/users/9445b6d7371244fc915ca51c61e337be/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:19:53.264682 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04656e36-4038-45e2-9928-eac68efb3bb7 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:53.264973 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04656e36-4038-45e2-9928-eac68efb3bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:53.265281 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04656e36-4038-45e2-9928-eac68efb3bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:53.292288 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-04656e36-4038-45e2-9928-eac68efb3bb7 None None] MFA Rules not processed for user `9445b6d7371244fc915ca51c61e337be`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:19:53.293509 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-04656e36-4038-45e2-9928-eac68efb3bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:53.359444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1411/2805] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:19:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:19:53.364416 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba8ef3-1c7f-4ee1-afbb-ad8f3e1c50d7 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:53.429620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:19:53.433638 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba8ef3-1c7f-4ee1-afbb-ad8f3e1c50d7 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:53.440237 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c208a-c10c-44f3-98ae-41d99344807f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:53.440901 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c208a-c10c-44f3-98ae-41d99344807f admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:53.441187 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c208a-c10c-44f3-98ae-41d99344807f admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:53.441838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c208a-c10c-44f3-98ae-41d99344807f admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:53.442957 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c208a-c10c-44f3-98ae-41d99344807f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:53.446554 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c208a-c10c-44f3-98ae-41d99344807f admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:53.479741 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1395/2806] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:19:53 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:19:53.483907 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04656e36-4038-45e2-9928-eac68efb3bb7 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:53.494806 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04656e36-4038-45e2-9928-eac68efb3bb7 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:53.553886 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f817b45-898c-4ff7-bbc6-924fb290e6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:53.554601 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f817b45-898c-4ff7-bbc6-924fb290e6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:53.554871 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f817b45-898c-4ff7-bbc6-924fb290e6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:53.555206 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f817b45-898c-4ff7-bbc6-924fb290e6b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:53.555997 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f817b45-898c-4ff7-bbc6-924fb290e6b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:53.558004 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f817b45-898c-4ff7-bbc6-924fb290e6b0 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:53.580609 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1412/2807] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:19:53 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:19:53.584702 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c208a-c10c-44f3-98ae-41d99344807f admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:53.595520 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c208a-c10c-44f3-98ae-41d99344807f admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:53.600542 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943414a-63d7-4da6-9667-f1bd5b2d3210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:53.601216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943414a-63d7-4da6-9667-f1bd5b2d3210 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:53.601717 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943414a-63d7-4da6-9667-f1bd5b2d3210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:53.601998 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943414a-63d7-4da6-9667-f1bd5b2d3210 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:53.602736 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943414a-63d7-4da6-9667-f1bd5b2d3210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:53.604390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943414a-63d7-4da6-9667-f1bd5b2d3210 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:53.615245 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1396/2808] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:19:53.619503 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f817b45-898c-4ff7-bbc6-924fb290e6b0 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:53.629554 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f817b45-898c-4ff7-bbc6-924fb290e6b0 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:53.634504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ee1d9-93d5-4d53-ad1a-10c9ec6adc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:53.635393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ee1d9-93d5-4d53-ad1a-10c9ec6adc8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:53.635703 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ee1d9-93d5-4d53-ad1a-10c9ec6adc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:53.635980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ee1d9-93d5-4d53-ad1a-10c9ec6adc8d admin admin] PATH_INFO: `/v3/projects/5741b52e28f6466eb04266e8ba64de78/users/bc08a265f0f84f5a893646058b3f0096/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:53.651759 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ee1d9-93d5-4d53-ad1a-10c9ec6adc8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5741b52e28f6466eb04266e8ba64de78, user_id=bc08a265f0f84f5a893646058b3f0096, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:53.654452 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ee1d9-93d5-4d53-ad1a-10c9ec6adc8d admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:53.669675 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1413/2809] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:19:53 2022] PUT /identity/v3/projects/5741b52e28f6466eb04266e8ba64de78/users/bc08a265f0f84f5a893646058b3f0096/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:19:53.674172 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943414a-63d7-4da6-9667-f1bd5b2d3210 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:53.684936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943414a-63d7-4da6-9667-f1bd5b2d3210 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:53.744995 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40107d0b-8411-4f21-804c-9807de8a8619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:53.745674 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40107d0b-8411-4f21-804c-9807de8a8619 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:53.745955 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40107d0b-8411-4f21-804c-9807de8a8619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:53.746227 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40107d0b-8411-4f21-804c-9807de8a8619 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:53.747073 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40107d0b-8411-4f21-804c-9807de8a8619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:53.748778 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40107d0b-8411-4f21-804c-9807de8a8619 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:53.758834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1397/2810] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:19:53.763135 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ee1d9-93d5-4d53-ad1a-10c9ec6adc8d admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:53.774074 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ee1d9-93d5-4d53-ad1a-10c9ec6adc8d admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:53.779508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899268f-87d1-4c04-b518-7b06b0914aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:53.780427 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899268f-87d1-4c04-b518-7b06b0914aea admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:53.780704 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899268f-87d1-4c04-b518-7b06b0914aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:53.780975 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899268f-87d1-4c04-b518-7b06b0914aea admin admin] PATH_INFO: `/v3/projects/5741b52e28f6466eb04266e8ba64de78/users/bc08a265f0f84f5a893646058b3f0096/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:53.783137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899268f-87d1-4c04-b518-7b06b0914aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=5741b52e28f6466eb04266e8ba64de78, user_id=bc08a265f0f84f5a893646058b3f0096, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:53.785872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899268f-87d1-4c04-b518-7b06b0914aea admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:53.797303 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1414/2811] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:19:53 2022] PUT /identity/v3/projects/5741b52e28f6466eb04266e8ba64de78/users/bc08a265f0f84f5a893646058b3f0096/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:19:53.807816 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00047dd3-6d12-4408-83fc-ba2c02031058 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:53.808135 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00047dd3-6d12-4408-83fc-ba2c02031058 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:53.808412 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00047dd3-6d12-4408-83fc-ba2c02031058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:53.835966 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-00047dd3-6d12-4408-83fc-ba2c02031058 None None] MFA Rules not processed for user `bc08a265f0f84f5a893646058b3f0096`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:19:53.837148 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-00047dd3-6d12-4408-83fc-ba2c02031058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:53.909370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1398/2812] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:19:53 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:19:53.921018 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899268f-87d1-4c04-b518-7b06b0914aea admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:53.923022 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-8899268f-87d1-4c04-b518-7b06b0914aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:53.956266 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:19:53.984405 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899268f-87d1-4c04-b518-7b06b0914aea admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:53.988369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9687c03-2236-46eb-83bd-d942913045a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:53.989013 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9687c03-2236-46eb-83bd-d942913045a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:53.989292 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9687c03-2236-46eb-83bd-d942913045a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:53.989566 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9687c03-2236-46eb-83bd-d942913045a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:53.998850 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9687c03-2236-46eb-83bd-d942913045a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:54.000334 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9687c03-2236-46eb-83bd-d942913045a7 service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:54.010106 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1415/2813] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:19:53 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:19:55.410144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00047dd3-6d12-4408-83fc-ba2c02031058 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:55.469176 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:19:55.483661 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00047dd3-6d12-4408-83fc-ba2c02031058 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:55.488737 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f24bf-50f1-4d83-9728-202c1177a6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:55.489659 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f24bf-50f1-4d83-9728-202c1177a6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:55.489940 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f24bf-50f1-4d83-9728-202c1177a6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:55.490213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f24bf-50f1-4d83-9728-202c1177a6fc admin admin] PATH_INFO: `/v3/users/9445b6d7371244fc915ca51c61e337be` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:55.491562 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f24bf-50f1-4d83-9728-202c1177a6fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9445b6d7371244fc915ca51c61e337be)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:55.493553 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f24bf-50f1-4d83-9728-202c1177a6fc admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:55.543335 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-a89f24bf-50f1-4d83-9728-202c1177a6fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9445b6d7371244fc915ca51c61e337be'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:55.555295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-a89f24bf-50f1-4d83-9728-202c1177a6fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9445b6d7371244fc915ca51c61e337be'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:55.562510 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-a89f24bf-50f1-4d83-9728-202c1177a6fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9445b6d7371244fc915ca51c61e337be'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:55.563166 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-a89f24bf-50f1-4d83-9728-202c1177a6fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9445b6d7371244fc915ca51c61e337be'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:55.572795 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-a89f24bf-50f1-4d83-9728-202c1177a6fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9445b6d7371244fc915ca51c61e337be'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:55.579291 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1399/2814] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:19:55 2022] DELETE /identity/v3/users/9445b6d7371244fc915ca51c61e337be => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:19:55.583990 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b207db-85ca-488c-9c87-a12f21746884 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:55.584477 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b207db-85ca-488c-9c87-a12f21746884 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:55.584591 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b207db-85ca-488c-9c87-a12f21746884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:55.602775 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-a7b207db-85ca-488c-9c87-a12f21746884 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:19:55.604770 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-a7b207db-85ca-488c-9c87-a12f21746884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:55.680980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1416/2815] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:19:55.692901 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f24bf-50f1-4d83-9728-202c1177a6fc admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:55.694531 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a89f24bf-50f1-4d83-9728-202c1177a6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:55.754333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f24bf-50f1-4d83-9728-202c1177a6fc admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:55.759238 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b0df8-3675-4fb6-b280-5a9e1ababe19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:55.759934 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b0df8-3675-4fb6-b280-5a9e1ababe19 service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:55.760217 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b0df8-3675-4fb6-b280-5a9e1ababe19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:55.760491 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b0df8-3675-4fb6-b280-5a9e1ababe19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:55.770234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b0df8-3675-4fb6-b280-5a9e1ababe19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:55.771698 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b0df8-3675-4fb6-b280-5a9e1ababe19 service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:55.781833 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1400/2816] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:19:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:19:56.077275 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b207db-85ca-488c-9c87-a12f21746884 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:56.078707 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-a7b207db-85ca-488c-9c87-a12f21746884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:56.090918 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b207db-85ca-488c-9c87-a12f21746884 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:56.095679 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edca38-d621-475d-aed8-3891a3ab6a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:56.096598 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edca38-d621-475d-aed8-3891a3ab6a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:56.096880 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edca38-d621-475d-aed8-3891a3ab6a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:56.097157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edca38-d621-475d-aed8-3891a3ab6a3c admin admin] PATH_INFO: `/v3/projects/0c0dd53918774432b80c4923807faf53` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:56.098464 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42edca38-d621-475d-aed8-3891a3ab6a3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c0dd53918774432b80c4923807faf53)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:56.100520 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42edca38-d621-475d-aed8-3891a3ab6a3c admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:56.150143 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-42edca38-d621-475d-aed8-3891a3ab6a3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c0dd53918774432b80c4923807faf53', 'request_id': 'req-42edca38-d621-475d-aed8-3891a3ab6a3c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:56.156255 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-42edca38-d621-475d-aed8-3891a3ab6a3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c0dd53918774432b80c4923807faf53', 'request_id': 'req-42edca38-d621-475d-aed8-3891a3ab6a3c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:56.164831 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-42edca38-d621-475d-aed8-3891a3ab6a3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c0dd53918774432b80c4923807faf53', 'request_id': 'req-42edca38-d621-475d-aed8-3891a3ab6a3c'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:56.175734 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-42edca38-d621-475d-aed8-3891a3ab6a3c admin admin] The token cache is being invalidate because project 0c0dd53918774432b80c4923807faf53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:19:56.176021 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-42edca38-d621-475d-aed8-3891a3ab6a3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:56.176644 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-42edca38-d621-475d-aed8-3891a3ab6a3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:56.178218 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1417/2817] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:19:56 2022] DELETE /identity/v3/projects/0c0dd53918774432b80c4923807faf53 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:19:56.182409 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b0df8-3675-4fb6-b280-5a9e1ababe19 service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:56.192298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b0df8-3675-4fb6-b280-5a9e1ababe19 service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:56.251231 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f689afb-b58a-4ebc-92ec-038563795cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:56.252121 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f689afb-b58a-4ebc-92ec-038563795cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:56.252417 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f689afb-b58a-4ebc-92ec-038563795cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:56.252769 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f689afb-b58a-4ebc-92ec-038563795cc1 admin admin] PATH_INFO: `/v3/users/bc08a265f0f84f5a893646058b3f0096` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:56.254071 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f689afb-b58a-4ebc-92ec-038563795cc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc08a265f0f84f5a893646058b3f0096)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:56.256056 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f689afb-b58a-4ebc-92ec-038563795cc1 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:56.278149 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:19:56.311370 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-8f689afb-b58a-4ebc-92ec-038563795cc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc08a265f0f84f5a893646058b3f0096'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:56.323932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-8f689afb-b58a-4ebc-92ec-038563795cc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc08a265f0f84f5a893646058b3f0096'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:56.331211 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-8f689afb-b58a-4ebc-92ec-038563795cc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc08a265f0f84f5a893646058b3f0096'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:56.332021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-8f689afb-b58a-4ebc-92ec-038563795cc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc08a265f0f84f5a893646058b3f0096'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:56.341931 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-8f689afb-b58a-4ebc-92ec-038563795cc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc08a265f0f84f5a893646058b3f0096'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:56.348767 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1401/2818] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:19:56 2022] DELETE /identity/v3/users/bc08a265f0f84f5a893646058b3f0096 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:19:56.622966 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edca38-d621-475d-aed8-3891a3ab6a3c admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:56.624527 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-42edca38-d621-475d-aed8-3891a3ab6a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:56.637490 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edca38-d621-475d-aed8-3891a3ab6a3c admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:56.686607 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:19:56.697985 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dec1aa-5ad2-47a5-b1c7-64b191c16c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:56.698875 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dec1aa-5ad2-47a5-b1c7-64b191c16c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:56.699163 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dec1aa-5ad2-47a5-b1c7-64b191c16c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:56.699468 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dec1aa-5ad2-47a5-b1c7-64b191c16c92 admin admin] PATH_INFO: `/v3/projects/5741b52e28f6466eb04266e8ba64de78` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:56.700727 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dec1aa-5ad2-47a5-b1c7-64b191c16c92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5741b52e28f6466eb04266e8ba64de78)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:56.703004 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dec1aa-5ad2-47a5-b1c7-64b191c16c92 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:56.751739 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-43dec1aa-5ad2-47a5-b1c7-64b191c16c92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5741b52e28f6466eb04266e8ba64de78', 'request_id': 'req-43dec1aa-5ad2-47a5-b1c7-64b191c16c92'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:56.758106 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-43dec1aa-5ad2-47a5-b1c7-64b191c16c92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5741b52e28f6466eb04266e8ba64de78', 'request_id': 'req-43dec1aa-5ad2-47a5-b1c7-64b191c16c92'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:56.767825 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-43dec1aa-5ad2-47a5-b1c7-64b191c16c92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5741b52e28f6466eb04266e8ba64de78', 'request_id': 'req-43dec1aa-5ad2-47a5-b1c7-64b191c16c92'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:56.778873 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-43dec1aa-5ad2-47a5-b1c7-64b191c16c92 admin admin] The token cache is being invalidate because project 5741b52e28f6466eb04266e8ba64de78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:19:56.779157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-43dec1aa-5ad2-47a5-b1c7-64b191c16c92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:56.779945 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-43dec1aa-5ad2-47a5-b1c7-64b191c16c92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:56.781662 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1418/2819] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:19:56 2022] DELETE /identity/v3/projects/5741b52e28f6466eb04266e8ba64de78 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:19:56.787357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df9bab-6b82-45e0-b1e6-46b43a24e7ec None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:56.787888 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df9bab-6b82-45e0-b1e6-46b43a24e7ec None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:56.788002 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df9bab-6b82-45e0-b1e6-46b43a24e7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:56.807932 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-b3df9bab-6b82-45e0-b1e6-46b43a24e7ec None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:19:56.809130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-b3df9bab-6b82-45e0-b1e6-46b43a24e7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:56.870350 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1402/2820] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:19:56.878478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764917d-9b29-4994-b6a7-6bbb90ab02fe None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:56.878815 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764917d-9b29-4994-b6a7-6bbb90ab02fe None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:56.879160 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764917d-9b29-4994-b6a7-6bbb90ab02fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:56.898439 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-e764917d-9b29-4994-b6a7-6bbb90ab02fe None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:19:56.899691 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-e764917d-9b29-4994-b6a7-6bbb90ab02fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:56.907913 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1419/2821] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:19:56.912272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df9bab-6b82-45e0-b1e6-46b43a24e7ec None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:56.923077 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df9bab-6b82-45e0-b1e6-46b43a24e7ec None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:56.928794 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2f1b5-d9a0-488c-ad9b-f83c6e7c2240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:56.929450 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2f1b5-d9a0-488c-ad9b-f83c6e7c2240 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:56.929732 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2f1b5-d9a0-488c-ad9b-f83c6e7c2240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:56.930005 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2f1b5-d9a0-488c-ad9b-f83c6e7c2240 admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:56.930813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2f1b5-d9a0-488c-ad9b-f83c6e7c2240 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:19:56.931117 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2f1b5-d9a0-488c-ad9b-f83c6e7c2240 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:56.932801 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2f1b5-d9a0-488c-ad9b-f83c6e7c2240 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:56.945438 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1403/2822] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:19:56.950387 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764917d-9b29-4994-b6a7-6bbb90ab02fe None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:56.960217 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764917d-9b29-4994-b6a7-6bbb90ab02fe None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:56.965226 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdeab6b-c925-4b23-b88c-be63273daa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:56.965890 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdeab6b-c925-4b23-b88c-be63273daa2c admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:56.966174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdeab6b-c925-4b23-b88c-be63273daa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:56.966451 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdeab6b-c925-4b23-b88c-be63273daa2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:56.967147 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdeab6b-c925-4b23-b88c-be63273daa2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:56.969137 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdeab6b-c925-4b23-b88c-be63273daa2c admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:56.997041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1420/2823] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:19:56 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:19:57.001064 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2f1b5-d9a0-488c-ad9b-f83c6e7c2240 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:57.011460 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2f1b5-d9a0-488c-ad9b-f83c6e7c2240 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:57.071212 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b49d9e-aca4-4ab3-867e-0cfb75cef67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:57.072163 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b49d9e-aca4-4ab3-867e-0cfb75cef67b admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:57.072522 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b49d9e-aca4-4ab3-867e-0cfb75cef67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:57.072866 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b49d9e-aca4-4ab3-867e-0cfb75cef67b admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:57.073644 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b49d9e-aca4-4ab3-867e-0cfb75cef67b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:57.076738 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b49d9e-aca4-4ab3-867e-0cfb75cef67b admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:57.102611 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1404/2824] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:19:57 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:19:57.108477 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdeab6b-c925-4b23-b88c-be63273daa2c admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:57.120036 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdeab6b-c925-4b23-b88c-be63273daa2c admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:57.125916 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8d415-8c36-4573-8b2b-7d5113694fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:57.126523 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8d415-8c36-4573-8b2b-7d5113694fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:57.126804 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8d415-8c36-4573-8b2b-7d5113694fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:57.127075 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8d415-8c36-4573-8b2b-7d5113694fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:57.127853 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8d415-8c36-4573-8b2b-7d5113694fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:57.129501 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8d415-8c36-4573-8b2b-7d5113694fc1 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:57.141719 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1421/2825] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:19:57.145979 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b49d9e-aca4-4ab3-867e-0cfb75cef67b admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:57.157092 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b49d9e-aca4-4ab3-867e-0cfb75cef67b admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:57.162199 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e1fa8-d8c7-410f-8f0d-1e68df97a104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:57.162862 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e1fa8-d8c7-410f-8f0d-1e68df97a104 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:57.163143 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e1fa8-d8c7-410f-8f0d-1e68df97a104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:57.163434 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e1fa8-d8c7-410f-8f0d-1e68df97a104 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:57.164169 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e1fa8-d8c7-410f-8f0d-1e68df97a104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:57.166008 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e1fa8-d8c7-410f-8f0d-1e68df97a104 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:57.171942 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:19:57.180999 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1405/2826] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:19:57.185785 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8d415-8c36-4573-8b2b-7d5113694fc1 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:57.196553 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8d415-8c36-4573-8b2b-7d5113694fc1 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:57.202403 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fac5a-2eff-4f28-a7fb-8397547f06fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:57.203331 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fac5a-2eff-4f28-a7fb-8397547f06fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:57.203639 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fac5a-2eff-4f28-a7fb-8397547f06fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:57.203915 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fac5a-2eff-4f28-a7fb-8397547f06fb admin admin] PATH_INFO: `/v3/projects/2d7b64563338485bacce804a496d650e/users/2c45b087e7a64f66bffc8765d2f2d020/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:57.219207 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fac5a-2eff-4f28-a7fb-8397547f06fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7b64563338485bacce804a496d650e, user_id=2c45b087e7a64f66bffc8765d2f2d020, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:57.221952 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fac5a-2eff-4f28-a7fb-8397547f06fb admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:57.237744 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1422/2827] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:19:57 2022] PUT /identity/v3/projects/2d7b64563338485bacce804a496d650e/users/2c45b087e7a64f66bffc8765d2f2d020/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:19:57.248194 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ecc4c-dc7a-4188-9ed3-5969ceb98ed5 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:57.248486 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ecc4c-dc7a-4188-9ed3-5969ceb98ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:57.248760 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ecc4c-dc7a-4188-9ed3-5969ceb98ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:57.277654 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-216ecc4c-dc7a-4188-9ed3-5969ceb98ed5 None None] MFA Rules not processed for user `2c45b087e7a64f66bffc8765d2f2d020`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:19:57.278867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-216ecc4c-dc7a-4188-9ed3-5969ceb98ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:57.347276 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1406/2828] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:19:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:19:57.353538 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fac5a-2eff-4f28-a7fb-8397547f06fb admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:57.417415 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fac5a-2eff-4f28-a7fb-8397547f06fb admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:57.423108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a52686-dd8a-42f5-84aa-ff61d78e7f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:57.423812 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a52686-dd8a-42f5-84aa-ff61d78e7f10 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:57.424097 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a52686-dd8a-42f5-84aa-ff61d78e7f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:57.424371 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a52686-dd8a-42f5-84aa-ff61d78e7f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:57.425060 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a52686-dd8a-42f5-84aa-ff61d78e7f10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:57.427010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a52686-dd8a-42f5-84aa-ff61d78e7f10 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:57.460863 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1423/2829] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:19:57 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:19:57.465037 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ecc4c-dc7a-4188-9ed3-5969ceb98ed5 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:57.475909 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ecc4c-dc7a-4188-9ed3-5969ceb98ed5 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:57.534178 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c1ac0-ce5a-43d1-b817-5d686b4d960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:57.534855 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c1ac0-ce5a-43d1-b817-5d686b4d960a admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:57.535140 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c1ac0-ce5a-43d1-b817-5d686b4d960a admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:57.535443 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c1ac0-ce5a-43d1-b817-5d686b4d960a admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:57.536139 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c1ac0-ce5a-43d1-b817-5d686b4d960a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:57.538096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c1ac0-ce5a-43d1-b817-5d686b4d960a admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:57.560660 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1407/2830] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:19:57 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:19:57.564752 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a52686-dd8a-42f5-84aa-ff61d78e7f10 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:57.571725 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:19:57.575635 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a52686-dd8a-42f5-84aa-ff61d78e7f10 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:57.581597 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5dbf04-c3fa-47b0-8736-40dfd2cec3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:57.582372 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5dbf04-c3fa-47b0-8736-40dfd2cec3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:57.582646 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5dbf04-c3fa-47b0-8736-40dfd2cec3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:57.582933 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5dbf04-c3fa-47b0-8736-40dfd2cec3d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:57.583892 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5dbf04-c3fa-47b0-8736-40dfd2cec3d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:57.585858 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5dbf04-c3fa-47b0-8736-40dfd2cec3d6 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:57.596504 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1424/2831] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:19:57.600710 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c1ac0-ce5a-43d1-b817-5d686b4d960a admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:57.611579 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c1ac0-ce5a-43d1-b817-5d686b4d960a admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:57.616882 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e765836-aabd-4f34-8b07-2d80d526e189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:57.617794 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e765836-aabd-4f34-8b07-2d80d526e189 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:57.618082 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e765836-aabd-4f34-8b07-2d80d526e189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:57.618364 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e765836-aabd-4f34-8b07-2d80d526e189 admin admin] PATH_INFO: `/v3/projects/6bddfd35e0c345baaada12566cc22815/users/eaa5a442ffea4988a14519d1cb56ab05/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:57.634154 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e765836-aabd-4f34-8b07-2d80d526e189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bddfd35e0c345baaada12566cc22815, user_id=eaa5a442ffea4988a14519d1cb56ab05, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:57.637047 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e765836-aabd-4f34-8b07-2d80d526e189 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:57.653640 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1408/2832] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:19:57 2022] PUT /identity/v3/projects/6bddfd35e0c345baaada12566cc22815/users/eaa5a442ffea4988a14519d1cb56ab05/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:19:57.657921 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5dbf04-c3fa-47b0-8736-40dfd2cec3d6 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:57.668508 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5dbf04-c3fa-47b0-8736-40dfd2cec3d6 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:57.738583 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af6f43-dd5f-4c9c-9be1-21cc1acbd3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:57.739448 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af6f43-dd5f-4c9c-9be1-21cc1acbd3aa admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:57.739711 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af6f43-dd5f-4c9c-9be1-21cc1acbd3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:57.740127 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af6f43-dd5f-4c9c-9be1-21cc1acbd3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:57.740899 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af6f43-dd5f-4c9c-9be1-21cc1acbd3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:57.742546 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af6f43-dd5f-4c9c-9be1-21cc1acbd3aa admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:57.753451 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1425/2833] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:19:57.757861 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e765836-aabd-4f34-8b07-2d80d526e189 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:57.770226 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e765836-aabd-4f34-8b07-2d80d526e189 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:57.776910 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59d922-6308-4217-b1d1-761d08a6d47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:57.777817 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59d922-6308-4217-b1d1-761d08a6d47f admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:57.778097 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59d922-6308-4217-b1d1-761d08a6d47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:57.778372 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59d922-6308-4217-b1d1-761d08a6d47f admin admin] PATH_INFO: `/v3/projects/6bddfd35e0c345baaada12566cc22815/users/eaa5a442ffea4988a14519d1cb56ab05/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:57.780830 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59d922-6308-4217-b1d1-761d08a6d47f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bddfd35e0c345baaada12566cc22815, user_id=eaa5a442ffea4988a14519d1cb56ab05, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:57.783566 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59d922-6308-4217-b1d1-761d08a6d47f admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:57.795710 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1409/2834] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:19:57 2022] PUT /identity/v3/projects/6bddfd35e0c345baaada12566cc22815/users/eaa5a442ffea4988a14519d1cb56ab05/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:19:57.806959 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930bd84-13a8-4916-bb2b-d0c0967c9755 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:57.807255 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930bd84-13a8-4916-bb2b-d0c0967c9755 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:57.807584 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930bd84-13a8-4916-bb2b-d0c0967c9755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:57.838192 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-c930bd84-13a8-4916-bb2b-d0c0967c9755 None None] MFA Rules not processed for user `eaa5a442ffea4988a14519d1cb56ab05`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:19:57.839449 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-c930bd84-13a8-4916-bb2b-d0c0967c9755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:57.914209 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1426/2835] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:19:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:19:57.926507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59d922-6308-4217-b1d1-761d08a6d47f admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:57.929066 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-ba59d922-6308-4217-b1d1-761d08a6d47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:57.978786 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:19:57.992225 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59d922-6308-4217-b1d1-761d08a6d47f admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:57.996528 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd91901-7c08-465d-87e6-19d5d176f138 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:57.997188 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd91901-7c08-465d-87e6-19d5d176f138 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:57.997471 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd91901-7c08-465d-87e6-19d5d176f138 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:57.997751 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd91901-7c08-465d-87e6-19d5d176f138 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:58.007131 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd91901-7c08-465d-87e6-19d5d176f138 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:58.008632 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd91901-7c08-465d-87e6-19d5d176f138 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:58.018050 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1410/2836] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:19:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:19:58.382184 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930bd84-13a8-4916-bb2b-d0c0967c9755 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:58.449644 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930bd84-13a8-4916-bb2b-d0c0967c9755 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:58.455254 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd172f90-e1b4-4821-90fe-06f957762972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:58.456254 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd172f90-e1b4-4821-90fe-06f957762972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:58.456537 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd172f90-e1b4-4821-90fe-06f957762972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:58.456818 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd172f90-e1b4-4821-90fe-06f957762972 admin admin] PATH_INFO: `/v3/users/2c45b087e7a64f66bffc8765d2f2d020` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:58.458158 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd172f90-e1b4-4821-90fe-06f957762972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c45b087e7a64f66bffc8765d2f2d020)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:58.460178 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd172f90-e1b4-4821-90fe-06f957762972 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:58.476706 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:19:58.512943 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-bd172f90-e1b4-4821-90fe-06f957762972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c45b087e7a64f66bffc8765d2f2d020'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:58.519862 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-bd172f90-e1b4-4821-90fe-06f957762972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c45b087e7a64f66bffc8765d2f2d020'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:58.520532 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-bd172f90-e1b4-4821-90fe-06f957762972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c45b087e7a64f66bffc8765d2f2d020'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:58.521161 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-bd172f90-e1b4-4821-90fe-06f957762972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c45b087e7a64f66bffc8765d2f2d020'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:58.534204 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-bd172f90-e1b4-4821-90fe-06f957762972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c45b087e7a64f66bffc8765d2f2d020'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:58.550631 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1427/2837] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:19:58 2022] DELETE /identity/v3/users/2c45b087e7a64f66bffc8765d2f2d020 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:19:58.555359 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea8357-9993-4701-8d66-d8bb837c88fe None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:58.555660 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea8357-9993-4701-8d66-d8bb837c88fe None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:58.555961 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea8357-9993-4701-8d66-d8bb837c88fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:58.575054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-44ea8357-9993-4701-8d66-d8bb837c88fe None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:19:58.576299 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-44ea8357-9993-4701-8d66-d8bb837c88fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:58.654889 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1411/2838] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:19:58.664826 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd172f90-e1b4-4821-90fe-06f957762972 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:58.666738 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-bd172f90-e1b4-4821-90fe-06f957762972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:58.725275 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd172f90-e1b4-4821-90fe-06f957762972 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:58.729647 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92552c9c-7aaa-4bf7-a7e6-13a939df5844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:58.730310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92552c9c-7aaa-4bf7-a7e6-13a939df5844 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:58.730586 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92552c9c-7aaa-4bf7-a7e6-13a939df5844 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:58.730857 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92552c9c-7aaa-4bf7-a7e6-13a939df5844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:58.741184 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92552c9c-7aaa-4bf7-a7e6-13a939df5844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:58.742636 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92552c9c-7aaa-4bf7-a7e6-13a939df5844 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:58.752434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1428/2839] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:19:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:19:59.049233 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea8357-9993-4701-8d66-d8bb837c88fe None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:59.050784 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-44ea8357-9993-4701-8d66-d8bb837c88fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:59.063301 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea8357-9993-4701-8d66-d8bb837c88fe None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:59.068745 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724a74c-8e5f-4a78-a501-69e693779cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:59.069625 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724a74c-8e5f-4a78-a501-69e693779cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:59.069901 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724a74c-8e5f-4a78-a501-69e693779cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:59.070170 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724a74c-8e5f-4a78-a501-69e693779cf2 admin admin] PATH_INFO: `/v3/projects/2d7b64563338485bacce804a496d650e` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:59.071526 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724a74c-8e5f-4a78-a501-69e693779cf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7b64563338485bacce804a496d650e)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:59.073711 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724a74c-8e5f-4a78-a501-69e693779cf2 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:59.122785 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-f724a74c-8e5f-4a78-a501-69e693779cf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7b64563338485bacce804a496d650e', 'request_id': 'req-f724a74c-8e5f-4a78-a501-69e693779cf2'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:59.131746 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-f724a74c-8e5f-4a78-a501-69e693779cf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7b64563338485bacce804a496d650e', 'request_id': 'req-f724a74c-8e5f-4a78-a501-69e693779cf2'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:59.137660 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-f724a74c-8e5f-4a78-a501-69e693779cf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7b64563338485bacce804a496d650e', 'request_id': 'req-f724a74c-8e5f-4a78-a501-69e693779cf2'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:59.148651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-f724a74c-8e5f-4a78-a501-69e693779cf2 admin admin] The token cache is being invalidate because project 2d7b64563338485bacce804a496d650e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:19:59.148962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-f724a74c-8e5f-4a78-a501-69e693779cf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:59.149620 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-f724a74c-8e5f-4a78-a501-69e693779cf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:59.151189 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1412/2840] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:19:59 2022] DELETE /identity/v3/projects/2d7b64563338485bacce804a496d650e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:19:59.155183 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92552c9c-7aaa-4bf7-a7e6-13a939df5844 service neutron] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:59.164978 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92552c9c-7aaa-4bf7-a7e6-13a939df5844 service neutron] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:59.227283 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515b716-55bf-4240-8c73-79692a529e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:59.228371 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515b716-55bf-4240-8c73-79692a529e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:59.228679 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515b716-55bf-4240-8c73-79692a529e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:59.228956 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515b716-55bf-4240-8c73-79692a529e3f admin admin] PATH_INFO: `/v3/users/eaa5a442ffea4988a14519d1cb56ab05` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:59.230310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515b716-55bf-4240-8c73-79692a529e3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaa5a442ffea4988a14519d1cb56ab05)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:59.232411 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515b716-55bf-4240-8c73-79692a529e3f admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:59.280539 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:19:59.289561 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-7515b716-55bf-4240-8c73-79692a529e3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaa5a442ffea4988a14519d1cb56ab05'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:59.301328 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-7515b716-55bf-4240-8c73-79692a529e3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaa5a442ffea4988a14519d1cb56ab05'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:59.302980 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-7515b716-55bf-4240-8c73-79692a529e3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaa5a442ffea4988a14519d1cb56ab05'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:59.303723 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-7515b716-55bf-4240-8c73-79692a529e3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaa5a442ffea4988a14519d1cb56ab05'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:59.321032 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-7515b716-55bf-4240-8c73-79692a529e3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaa5a442ffea4988a14519d1cb56ab05'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:59.338390 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1429/2841] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:19:59 2022] DELETE /identity/v3/users/eaa5a442ffea4988a14519d1cb56ab05 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:19:59.677642 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724a74c-8e5f-4a78-a501-69e693779cf2 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:19:59.679163 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-f724a74c-8e5f-4a78-a501-69e693779cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:59.701187 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724a74c-8e5f-4a78-a501-69e693779cf2 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:19:59.763804 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48b88d-a04b-4932-bd51-182f13bdeed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:19:59.764752 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48b88d-a04b-4932-bd51-182f13bdeed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:59.765049 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48b88d-a04b-4932-bd51-182f13bdeed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:59.765325 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48b88d-a04b-4932-bd51-182f13bdeed3 admin admin] PATH_INFO: `/v3/projects/6bddfd35e0c345baaada12566cc22815` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:59.766673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48b88d-a04b-4932-bd51-182f13bdeed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bddfd35e0c345baaada12566cc22815)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:19:59.768739 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48b88d-a04b-4932-bd51-182f13bdeed3 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:19:59.782841 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:19:59.834062 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-8b48b88d-a04b-4932-bd51-182f13bdeed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bddfd35e0c345baaada12566cc22815', 'request_id': 'req-8b48b88d-a04b-4932-bd51-182f13bdeed3'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:59.843614 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-8b48b88d-a04b-4932-bd51-182f13bdeed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bddfd35e0c345baaada12566cc22815', 'request_id': 'req-8b48b88d-a04b-4932-bd51-182f13bdeed3'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:59.850250 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-8b48b88d-a04b-4932-bd51-182f13bdeed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bddfd35e0c345baaada12566cc22815', 'request_id': 'req-8b48b88d-a04b-4932-bd51-182f13bdeed3'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:59.863073 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-8b48b88d-a04b-4932-bd51-182f13bdeed3 admin admin] The token cache is being invalidate because project 6bddfd35e0c345baaada12566cc22815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:19:59.863333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-8b48b88d-a04b-4932-bd51-182f13bdeed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:59.864103 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-8b48b88d-a04b-4932-bd51-182f13bdeed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:19:59.865729 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1413/2842] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:19:59 2022] DELETE /identity/v3/projects/6bddfd35e0c345baaada12566cc22815 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:19:59.870947 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dd8a5-7ae2-4e1d-abe6-c4246b6e4b46 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:59.871487 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dd8a5-7ae2-4e1d-abe6-c4246b6e4b46 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:59.871605 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dd8a5-7ae2-4e1d-abe6-c4246b6e4b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:19:59.896661 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-9b5dd8a5-7ae2-4e1d-abe6-c4246b6e4b46 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:19:59.897896 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-9b5dd8a5-7ae2-4e1d-abe6-c4246b6e4b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:19:59.976579 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1430/2843] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:19:59.986516 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70e437-7ade-41d8-a6b9-74a2342aa630 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:19:59.986807 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70e437-7ade-41d8-a6b9-74a2342aa630 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:19:59.987091 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70e437-7ade-41d8-a6b9-74a2342aa630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:00.010824 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-ae70e437-7ade-41d8-a6b9-74a2342aa630 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:20:00.012792 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-ae70e437-7ade-41d8-a6b9-74a2342aa630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:00.024740 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1414/2844] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:20:00.034298 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5dd8a5-7ae2-4e1d-abe6-c4246b6e4b46 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:00.052256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5dd8a5-7ae2-4e1d-abe6-c4246b6e4b46 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:00.059910 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04850d4-4da8-4796-a0d5-5bcde26b74f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:00.060728 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04850d4-4da8-4796-a0d5-5bcde26b74f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:00.061010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04850d4-4da8-4796-a0d5-5bcde26b74f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:00.061282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04850d4-4da8-4796-a0d5-5bcde26b74f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:00.062023 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04850d4-4da8-4796-a0d5-5bcde26b74f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:20:00.062330 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04850d4-4da8-4796-a0d5-5bcde26b74f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:00.064369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04850d4-4da8-4796-a0d5-5bcde26b74f0 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:00.079048 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1431/2845] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:20:00.084148 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70e437-7ade-41d8-a6b9-74a2342aa630 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:00.098188 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70e437-7ade-41d8-a6b9-74a2342aa630 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:00.105338 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800c45c-395f-40ed-99b4-9b6207f62a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:00.106244 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800c45c-395f-40ed-99b4-9b6207f62a21 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:00.106706 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800c45c-395f-40ed-99b4-9b6207f62a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:00.107168 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800c45c-395f-40ed-99b4-9b6207f62a21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:00.107917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800c45c-395f-40ed-99b4-9b6207f62a21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:00.109853 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800c45c-395f-40ed-99b4-9b6207f62a21 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:00.141938 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1415/2846] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:20:00 2022] POST /identity/v3/projects => generated 361 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:20:00.147278 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04850d4-4da8-4796-a0d5-5bcde26b74f0 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:00.157622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04850d4-4da8-4796-a0d5-5bcde26b74f0 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:00.221239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ee401-e555-4a06-b51b-d61aa66b4cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:00.221931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ee401-e555-4a06-b51b-d61aa66b4cda admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:00.222206 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ee401-e555-4a06-b51b-d61aa66b4cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:00.222474 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ee401-e555-4a06-b51b-d61aa66b4cda admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:00.223165 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ee401-e555-4a06-b51b-d61aa66b4cda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:00.225181 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ee401-e555-4a06-b51b-d61aa66b4cda admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:00.258605 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1432/2847] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:20:00 2022] POST /identity/v3/users => generated 281 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:20:00.263058 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800c45c-395f-40ed-99b4-9b6207f62a21 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:00.276054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800c45c-395f-40ed-99b4-9b6207f62a21 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:00.281343 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffa3e3-8594-4e59-a970-5b1045637483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:00.282066 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffa3e3-8594-4e59-a970-5b1045637483 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:00.282348 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffa3e3-8594-4e59-a970-5b1045637483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:00.282625 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffa3e3-8594-4e59-a970-5b1045637483 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:00.283459 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffa3e3-8594-4e59-a970-5b1045637483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:00.285057 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffa3e3-8594-4e59-a970-5b1045637483 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:00.296374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1416/2848] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:20:00.300730 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ee401-e555-4a06-b51b-d61aa66b4cda admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:00.313049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ee401-e555-4a06-b51b-d61aa66b4cda admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:00.319155 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb31581-6f66-4799-99e1-6f8b0b14e148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:00.319862 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb31581-6f66-4799-99e1-6f8b0b14e148 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:00.320147 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb31581-6f66-4799-99e1-6f8b0b14e148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:00.320426 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb31581-6f66-4799-99e1-6f8b0b14e148 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:00.321188 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb31581-6f66-4799-99e1-6f8b0b14e148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:00.322898 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb31581-6f66-4799-99e1-6f8b0b14e148 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:00.333531 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1433/2849] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:20:00.338179 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffa3e3-8594-4e59-a970-5b1045637483 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:00.348902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffa3e3-8594-4e59-a970-5b1045637483 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:00.354735 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc2a66-b092-4275-b1d7-ef331755fcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:00.355685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc2a66-b092-4275-b1d7-ef331755fcc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:00.355969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc2a66-b092-4275-b1d7-ef331755fcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:00.356243 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc2a66-b092-4275-b1d7-ef331755fcc9 admin admin] PATH_INFO: `/v3/projects/43f27be711d64959992510e8c42aa64c/users/9af36dcb6bf04ef2ad33ba1abac503bc/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:00.372137 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc2a66-b092-4275-b1d7-ef331755fcc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f27be711d64959992510e8c42aa64c, user_id=9af36dcb6bf04ef2ad33ba1abac503bc, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:00.374845 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc2a66-b092-4275-b1d7-ef331755fcc9 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:00.389698 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1417/2850] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:20:00 2022] PUT /identity/v3/projects/43f27be711d64959992510e8c42aa64c/users/9af36dcb6bf04ef2ad33ba1abac503bc/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:20:00.400282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70dedb-4161-41a2-8837-3a1e1151562c None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:00.400549 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70dedb-4161-41a2-8837-3a1e1151562c None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:00.400851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70dedb-4161-41a2-8837-3a1e1151562c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:00.429766 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-ee70dedb-4161-41a2-8837-3a1e1151562c None None] MFA Rules not processed for user `9af36dcb6bf04ef2ad33ba1abac503bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:20:00.431019 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-ee70dedb-4161-41a2-8837-3a1e1151562c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:00.442238 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:20:00.502248 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1434/2851] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:20:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:20:00.536834 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc2a66-b092-4275-b1d7-ef331755fcc9 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:00.538885 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-1adc2a66-b092-4275-b1d7-ef331755fcc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:00.599223 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc2a66-b092-4275-b1d7-ef331755fcc9 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:00.604854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158277c9-bf2b-45cb-8b23-622610511ad8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:00.605768 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158277c9-bf2b-45cb-8b23-622610511ad8 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:00.606183 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158277c9-bf2b-45cb-8b23-622610511ad8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:00.606592 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158277c9-bf2b-45cb-8b23-622610511ad8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:00.618980 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158277c9-bf2b-45cb-8b23-622610511ad8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:00.621595 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158277c9-bf2b-45cb-8b23-622610511ad8 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:00.633460 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1418/2852] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:20:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:20:00.651357 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70dedb-4161-41a2-8837-3a1e1151562c None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:00.720178 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70dedb-4161-41a2-8837-3a1e1151562c None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:00.725917 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e15ad1-ad8d-4b93-8815-29019e3fddb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:00.726808 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e15ad1-ad8d-4b93-8815-29019e3fddb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:00.727087 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e15ad1-ad8d-4b93-8815-29019e3fddb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:00.727359 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e15ad1-ad8d-4b93-8815-29019e3fddb7 admin admin] PATH_INFO: `/v3/users/9af36dcb6bf04ef2ad33ba1abac503bc` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:00.728705 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e15ad1-ad8d-4b93-8815-29019e3fddb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af36dcb6bf04ef2ad33ba1abac503bc)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:00.730672 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e15ad1-ad8d-4b93-8815-29019e3fddb7 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:00.779707 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-30e15ad1-ad8d-4b93-8815-29019e3fddb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af36dcb6bf04ef2ad33ba1abac503bc'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:00.786488 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-30e15ad1-ad8d-4b93-8815-29019e3fddb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af36dcb6bf04ef2ad33ba1abac503bc'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:00.787253 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-30e15ad1-ad8d-4b93-8815-29019e3fddb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af36dcb6bf04ef2ad33ba1abac503bc'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:00.787849 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-30e15ad1-ad8d-4b93-8815-29019e3fddb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af36dcb6bf04ef2ad33ba1abac503bc'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:00.800601 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-30e15ad1-ad8d-4b93-8815-29019e3fddb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af36dcb6bf04ef2ad33ba1abac503bc'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:00.819167 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1435/2853] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:20:00 2022] DELETE /identity/v3/users/9af36dcb6bf04ef2ad33ba1abac503bc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:20:00.824046 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408c9d6-86ec-47a5-b08a-82cf99bed540 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:00.824334 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408c9d6-86ec-47a5-b08a-82cf99bed540 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:00.824609 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408c9d6-86ec-47a5-b08a-82cf99bed540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:00.842846 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-7408c9d6-86ec-47a5-b08a-82cf99bed540 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:20:00.844107 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-7408c9d6-86ec-47a5-b08a-82cf99bed540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:00.878021 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:20:00.913168 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1419/2854] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:20:00.923303 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e15ad1-ad8d-4b93-8815-29019e3fddb7 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:00.924930 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-30e15ad1-ad8d-4b93-8815-29019e3fddb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:00.968986 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:20:00.995868 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e15ad1-ad8d-4b93-8815-29019e3fddb7 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:00.999972 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f601c0-b3d5-4cfe-8f1a-a5dd0f4deb14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:01.000637 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f601c0-b3d5-4cfe-8f1a-a5dd0f4deb14 service neutron] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:01.000921 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f601c0-b3d5-4cfe-8f1a-a5dd0f4deb14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:01.001184 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f601c0-b3d5-4cfe-8f1a-a5dd0f4deb14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:01.011134 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f601c0-b3d5-4cfe-8f1a-a5dd0f4deb14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:01.012642 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f601c0-b3d5-4cfe-8f1a-a5dd0f4deb14 service neutron] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:01.022358 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1436/2855] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:20:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:20:01.303878 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408c9d6-86ec-47a5-b08a-82cf99bed540 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:01.305357 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-7408c9d6-86ec-47a5-b08a-82cf99bed540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:01.318006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408c9d6-86ec-47a5-b08a-82cf99bed540 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:01.323439 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42687fde-527e-448b-ac46-bea5ce97ade3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:01.324369 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42687fde-527e-448b-ac46-bea5ce97ade3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:01.325153 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42687fde-527e-448b-ac46-bea5ce97ade3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:01.325537 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42687fde-527e-448b-ac46-bea5ce97ade3 admin admin] PATH_INFO: `/v3/projects/43f27be711d64959992510e8c42aa64c` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:01.326897 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42687fde-527e-448b-ac46-bea5ce97ade3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43f27be711d64959992510e8c42aa64c)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:01.328874 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42687fde-527e-448b-ac46-bea5ce97ade3 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:01.380313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-42687fde-527e-448b-ac46-bea5ce97ade3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43f27be711d64959992510e8c42aa64c', 'request_id': 'req-42687fde-527e-448b-ac46-bea5ce97ade3'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:01.388924 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-42687fde-527e-448b-ac46-bea5ce97ade3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43f27be711d64959992510e8c42aa64c', 'request_id': 'req-42687fde-527e-448b-ac46-bea5ce97ade3'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:01.394898 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-42687fde-527e-448b-ac46-bea5ce97ade3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43f27be711d64959992510e8c42aa64c', 'request_id': 'req-42687fde-527e-448b-ac46-bea5ce97ade3'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:01.406639 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-42687fde-527e-448b-ac46-bea5ce97ade3 admin admin] The token cache is being invalidate because project 43f27be711d64959992510e8c42aa64c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:20:01.406930 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-42687fde-527e-448b-ac46-bea5ce97ade3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:01.407651 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-42687fde-527e-448b-ac46-bea5ce97ade3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:01.409309 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1420/2856] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:20:01 2022] DELETE /identity/v3/projects/43f27be711d64959992510e8c42aa64c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:20:01.414363 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fca059-5c02-4596-9169-2c3bec70a078 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:01.414651 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fca059-5c02-4596-9169-2c3bec70a078 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:01.414926 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fca059-5c02-4596-9169-2c3bec70a078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:01.433459 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-75fca059-5c02-4596-9169-2c3bec70a078 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:20:01.434670 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-75fca059-5c02-4596-9169-2c3bec70a078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:01.510938 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1437/2857] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:20:01.519814 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fc500-5b2e-45b8-84a7-1080e8fa57e1 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:01.520170 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fc500-5b2e-45b8-84a7-1080e8fa57e1 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:01.520545 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fc500-5b2e-45b8-84a7-1080e8fa57e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:01.541342 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-c54fc500-5b2e-45b8-84a7-1080e8fa57e1 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:20:01.542829 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-c54fc500-5b2e-45b8-84a7-1080e8fa57e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:01.555298 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1421/2858] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:20:01.556560 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fca059-5c02-4596-9169-2c3bec70a078 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:01.567469 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fca059-5c02-4596-9169-2c3bec70a078 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:01.574054 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86ea6c-2638-45b0-bd3d-a3b6406a3dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:01.574717 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86ea6c-2638-45b0-bd3d-a3b6406a3dad admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:01.574995 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86ea6c-2638-45b0-bd3d-a3b6406a3dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:01.575263 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86ea6c-2638-45b0-bd3d-a3b6406a3dad admin admin] PATH_INFO: `/v3/domains` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:01.576041 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86ea6c-2638-45b0-bd3d-a3b6406a3dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80430) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:20:01.576342 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86ea6c-2638-45b0-bd3d-a3b6406a3dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:01.577951 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86ea6c-2638-45b0-bd3d-a3b6406a3dad admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:01.591051 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1438/2859] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:20:01.595453 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fc500-5b2e-45b8-84a7-1080e8fa57e1 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:01.605390 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fc500-5b2e-45b8-84a7-1080e8fa57e1 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:01.611094 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faccc4a9-d3f3-4dfb-8d1f-1dda8065c064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:01.611786 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccc4a9-d3f3-4dfb-8d1f-1dda8065c064 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:01.612069 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccc4a9-d3f3-4dfb-8d1f-1dda8065c064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:01.612339 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccc4a9-d3f3-4dfb-8d1f-1dda8065c064 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:01.613032 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faccc4a9-d3f3-4dfb-8d1f-1dda8065c064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:01.614953 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faccc4a9-d3f3-4dfb-8d1f-1dda8065c064 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:01.650970 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1422/2860] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:20:01 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:20:01.655835 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86ea6c-2638-45b0-bd3d-a3b6406a3dad admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:01.666333 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86ea6c-2638-45b0-bd3d-a3b6406a3dad admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:01.726658 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121c56a-b065-4a36-bcc1-854648b62376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:01.727681 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121c56a-b065-4a36-bcc1-854648b62376 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:01.728055 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121c56a-b065-4a36-bcc1-854648b62376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:01.728414 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121c56a-b065-4a36-bcc1-854648b62376 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:01.729423 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121c56a-b065-4a36-bcc1-854648b62376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:01.732523 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121c56a-b065-4a36-bcc1-854648b62376 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:01.759891 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1439/2861] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:20:01 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:20:01.764590 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faccc4a9-d3f3-4dfb-8d1f-1dda8065c064 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:01.775355 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faccc4a9-d3f3-4dfb-8d1f-1dda8065c064 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:01.781669 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656cb4a-bf98-48de-b6e0-e2b7b992c4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:01.782349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656cb4a-bf98-48de-b6e0-e2b7b992c4de admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:01.782631 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656cb4a-bf98-48de-b6e0-e2b7b992c4de admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:01.782906 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656cb4a-bf98-48de-b6e0-e2b7b992c4de admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:01.783664 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656cb4a-bf98-48de-b6e0-e2b7b992c4de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:01.785280 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656cb4a-bf98-48de-b6e0-e2b7b992c4de admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:01.797032 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1423/2862] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:20:01.800948 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121c56a-b065-4a36-bcc1-854648b62376 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:01.811604 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121c56a-b065-4a36-bcc1-854648b62376 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:01.816717 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e50d3-cf4e-419c-ba8f-09f8bdd9b2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:01.817478 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e50d3-cf4e-419c-ba8f-09f8bdd9b2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:01.817810 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e50d3-cf4e-419c-ba8f-09f8bdd9b2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:01.818110 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e50d3-cf4e-419c-ba8f-09f8bdd9b2a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:01.819376 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e50d3-cf4e-419c-ba8f-09f8bdd9b2a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:01.821294 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e50d3-cf4e-419c-ba8f-09f8bdd9b2a3 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:01.835521 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1440/2863] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:20:01.837064 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656cb4a-bf98-48de-b6e0-e2b7b992c4de admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:01.848705 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656cb4a-bf98-48de-b6e0-e2b7b992c4de admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:01.854485 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64665a72-be71-4e67-bc06-a1b91030decd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:01.855402 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64665a72-be71-4e67-bc06-a1b91030decd admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:01.855721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64665a72-be71-4e67-bc06-a1b91030decd admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:01.856000 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64665a72-be71-4e67-bc06-a1b91030decd admin admin] PATH_INFO: `/v3/projects/4aa7d8629f5c4ca8945bdf99cf165534/users/2330a29e83f34c2781fc4ebfe17ee79e/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:01.871153 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64665a72-be71-4e67-bc06-a1b91030decd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa7d8629f5c4ca8945bdf99cf165534, user_id=2330a29e83f34c2781fc4ebfe17ee79e, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:01.873867 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64665a72-be71-4e67-bc06-a1b91030decd admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:01.889444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1424/2864] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:20:01 2022] PUT /identity/v3/projects/4aa7d8629f5c4ca8945bdf99cf165534/users/2330a29e83f34c2781fc4ebfe17ee79e/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:20:01.953165 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc43d1-7835-4254-8ab6-f72483dae714 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:01.953789 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc43d1-7835-4254-8ab6-f72483dae714 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:01.953789 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc43d1-7835-4254-8ab6-f72483dae714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:01.983842 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-5cbc43d1-7835-4254-8ab6-f72483dae714 None None] MFA Rules not processed for user `2330a29e83f34c2781fc4ebfe17ee79e`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:20:01.985105 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-5cbc43d1-7835-4254-8ab6-f72483dae714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:02.018549 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:20:02.058401 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1441/2865] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:20:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:20:02.065349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64665a72-be71-4e67-bc06-a1b91030decd admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:02.126551 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:20:02.130969 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64665a72-be71-4e67-bc06-a1b91030decd admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:02.138425 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d6cd0-f212-46d6-9b6b-52df515e77af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:02.139144 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d6cd0-f212-46d6-9b6b-52df515e77af admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:02.139463 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d6cd0-f212-46d6-9b6b-52df515e77af admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:02.140170 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d6cd0-f212-46d6-9b6b-52df515e77af admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:02.141006 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d6cd0-f212-46d6-9b6b-52df515e77af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:02.143022 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d6cd0-f212-46d6-9b6b-52df515e77af admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:02.177333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1425/2866] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:20:02 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:20:02.181481 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc43d1-7835-4254-8ab6-f72483dae714 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:02.193280 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc43d1-7835-4254-8ab6-f72483dae714 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:02.256135 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2e497-76d6-4da0-9486-8f75e577ae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:02.256967 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2e497-76d6-4da0-9486-8f75e577ae56 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:02.257339 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2e497-76d6-4da0-9486-8f75e577ae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:02.257605 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2e497-76d6-4da0-9486-8f75e577ae56 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:02.258345 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2e497-76d6-4da0-9486-8f75e577ae56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:02.260324 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2e497-76d6-4da0-9486-8f75e577ae56 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:02.283474 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1442/2867] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:20:02 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 02:20:02.288583 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d6cd0-f212-46d6-9b6b-52df515e77af admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:02.300163 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d6cd0-f212-46d6-9b6b-52df515e77af admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:02.305437 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d7f08-f988-43e7-acff-39a210218f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:02.306124 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d7f08-f988-43e7-acff-39a210218f6a admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:02.306408 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d7f08-f988-43e7-acff-39a210218f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:02.306682 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d7f08-f988-43e7-acff-39a210218f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:02.307561 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d7f08-f988-43e7-acff-39a210218f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:02.309174 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d7f08-f988-43e7-acff-39a210218f6a admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:02.320024 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1426/2868] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:20:02.325751 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2e497-76d6-4da0-9486-8f75e577ae56 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:02.336230 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2e497-76d6-4da0-9486-8f75e577ae56 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:02.341331 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da39002-faee-4d1a-8e39-c8eeeee7257d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:02.342005 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da39002-faee-4d1a-8e39-c8eeeee7257d admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:02.342283 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da39002-faee-4d1a-8e39-c8eeeee7257d admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:02.342555 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da39002-faee-4d1a-8e39-c8eeeee7257d admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:02.343434 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da39002-faee-4d1a-8e39-c8eeeee7257d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:02.345113 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da39002-faee-4d1a-8e39-c8eeeee7257d admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:02.355806 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1443/2869] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:20:02.360088 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d7f08-f988-43e7-acff-39a210218f6a admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:02.370549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d7f08-f988-43e7-acff-39a210218f6a admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:02.375375 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c739ae-c340-4759-8e7e-b06af15049a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:02.376297 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c739ae-c340-4759-8e7e-b06af15049a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:02.376579 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c739ae-c340-4759-8e7e-b06af15049a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:02.376859 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c739ae-c340-4759-8e7e-b06af15049a8 admin admin] PATH_INFO: `/v3/projects/8a9c15e981ae4178b9447e7c29408087/users/f364ac5417604912b3fea49685f74cdd/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:02.392365 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c739ae-c340-4759-8e7e-b06af15049a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a9c15e981ae4178b9447e7c29408087, user_id=f364ac5417604912b3fea49685f74cdd, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:02.395195 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c739ae-c340-4759-8e7e-b06af15049a8 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:02.410368 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1427/2870] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:20:02 2022] PUT /identity/v3/projects/8a9c15e981ae4178b9447e7c29408087/users/f364ac5417604912b3fea49685f74cdd/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:20:02.420983 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cbd8c-1d51-47ce-971e-179146b3f117 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:02.421280 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cbd8c-1d51-47ce-971e-179146b3f117 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:02.421558 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cbd8c-1d51-47ce-971e-179146b3f117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:02.448138 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-791cbd8c-1d51-47ce-971e-179146b3f117 None None] MFA Rules not processed for user `f364ac5417604912b3fea49685f74cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:20:02.449301 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-791cbd8c-1d51-47ce-971e-179146b3f117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:02.520101 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1444/2871] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:20:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:20:02.526882 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c739ae-c340-4759-8e7e-b06af15049a8 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:02.591388 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c739ae-c340-4759-8e7e-b06af15049a8 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:02.596845 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a5572-aab4-4860-889f-a7e09f4ce929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:02.597514 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a5572-aab4-4860-889f-a7e09f4ce929 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:02.597800 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a5572-aab4-4860-889f-a7e09f4ce929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:02.598079 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a5572-aab4-4860-889f-a7e09f4ce929 admin admin] PATH_INFO: `/v3/projects` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:02.598831 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a5572-aab4-4860-889f-a7e09f4ce929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:02.600968 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a5572-aab4-4860-889f-a7e09f4ce929 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:02.629722 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1428/2872] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:20:02 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:20:02.636357 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cbd8c-1d51-47ce-971e-179146b3f117 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:02.654070 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cbd8c-1d51-47ce-971e-179146b3f117 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:02.699591 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:20:02.725126 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd6f3d-3e21-4b9e-abc4-cbb8f6b188d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:02.725803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd6f3d-3e21-4b9e-abc4-cbb8f6b188d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:02.726093 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd6f3d-3e21-4b9e-abc4-cbb8f6b188d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:02.726359 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd6f3d-3e21-4b9e-abc4-cbb8f6b188d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:02.727037 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd6f3d-3e21-4b9e-abc4-cbb8f6b188d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:02.729016 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd6f3d-3e21-4b9e-abc4-cbb8f6b188d6 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:02.750826 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1445/2873] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:20:02 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:20:02.755130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a5572-aab4-4860-889f-a7e09f4ce929 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:02.765658 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a5572-aab4-4860-889f-a7e09f4ce929 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:02.770354 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32bd78-3eca-476e-91df-1123dd106fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:02.771022 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32bd78-3eca-476e-91df-1123dd106fba admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:02.771301 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32bd78-3eca-476e-91df-1123dd106fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:02.771604 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32bd78-3eca-476e-91df-1123dd106fba admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:02.772333 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32bd78-3eca-476e-91df-1123dd106fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:02.773936 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32bd78-3eca-476e-91df-1123dd106fba admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:02.784307 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1429/2874] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:20:02.788471 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd6f3d-3e21-4b9e-abc4-cbb8f6b188d6 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:02.799250 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd6f3d-3e21-4b9e-abc4-cbb8f6b188d6 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:02.805951 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b23e3-9e7a-446a-80c7-c41db344161b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:02.806876 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b23e3-9e7a-446a-80c7-c41db344161b admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:02.807167 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b23e3-9e7a-446a-80c7-c41db344161b admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:02.807443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b23e3-9e7a-446a-80c7-c41db344161b admin admin] PATH_INFO: `/v3/projects/ac591a0309454322b1d20e0ec4021cf0/users/096645a34da64b07ba17e27c0e2be816/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:02.824649 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b23e3-9e7a-446a-80c7-c41db344161b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac591a0309454322b1d20e0ec4021cf0, user_id=096645a34da64b07ba17e27c0e2be816, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:02.827435 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b23e3-9e7a-446a-80c7-c41db344161b admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:02.842332 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1446/2875] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:20:02 2022] PUT /identity/v3/projects/ac591a0309454322b1d20e0ec4021cf0/users/096645a34da64b07ba17e27c0e2be816/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 02:20:02.846365 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32bd78-3eca-476e-91df-1123dd106fba admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:02.856799 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32bd78-3eca-476e-91df-1123dd106fba admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:02.923509 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5eee0f-445b-42a9-837c-99b013edb038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:02.924202 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5eee0f-445b-42a9-837c-99b013edb038 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:02.924483 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5eee0f-445b-42a9-837c-99b013edb038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:02.924759 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5eee0f-445b-42a9-837c-99b013edb038 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:02.925489 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5eee0f-445b-42a9-837c-99b013edb038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:02.927099 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5eee0f-445b-42a9-837c-99b013edb038 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:02.937599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1430/2876] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:20:02.941820 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b23e3-9e7a-446a-80c7-c41db344161b admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:02.953255 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b23e3-9e7a-446a-80c7-c41db344161b admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:02.958371 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cab885-0738-4760-a7f6-39dae20623c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:02.959265 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cab885-0738-4760-a7f6-39dae20623c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:02.959578 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cab885-0738-4760-a7f6-39dae20623c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:02.959851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cab885-0738-4760-a7f6-39dae20623c7 admin admin] PATH_INFO: `/v3/projects/ac591a0309454322b1d20e0ec4021cf0/users/096645a34da64b07ba17e27c0e2be816/roles/58e04437159e4eb39aa4a43c213ea34c` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:02.961966 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cab885-0738-4760-a7f6-39dae20623c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac591a0309454322b1d20e0ec4021cf0, user_id=096645a34da64b07ba17e27c0e2be816, role_id=58e04437159e4eb39aa4a43c213ea34c)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:02.964851 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cab885-0738-4760-a7f6-39dae20623c7 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:02.976551 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1447/2877] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:20:02 2022] PUT /identity/v3/projects/ac591a0309454322b1d20e0ec4021cf0/users/096645a34da64b07ba17e27c0e2be816/roles/58e04437159e4eb39aa4a43c213ea34c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:20:02.989063 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e83c0c-2ba1-4b0b-8e15-d644ac07669c None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:02.989354 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e83c0c-2ba1-4b0b-8e15-d644ac07669c None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:02.989630 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e83c0c-2ba1-4b0b-8e15-d644ac07669c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:03.018324 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-74e83c0c-2ba1-4b0b-8e15-d644ac07669c None None] MFA Rules not processed for user `096645a34da64b07ba17e27c0e2be816`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:20:03.019642 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-74e83c0c-2ba1-4b0b-8e15-d644ac07669c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:03.024962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:20:03.095359 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1431/2878] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:20:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 02:20:03.109018 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cab885-0738-4760-a7f6-39dae20623c7 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:03.111950 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-10cab885-0738-4760-a7f6-39dae20623c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:03.174821 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cab885-0738-4760-a7f6-39dae20623c7 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:03.179430 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d22f3-b49d-42e0-a2ff-0273fcd9f900 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:03.180083 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d22f3-b49d-42e0-a2ff-0273fcd9f900 service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:03.180359 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d22f3-b49d-42e0-a2ff-0273fcd9f900 service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:03.180638 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d22f3-b49d-42e0-a2ff-0273fcd9f900 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:03.242542 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d22f3-b49d-42e0-a2ff-0273fcd9f900 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:03.244056 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d22f3-b49d-42e0-a2ff-0273fcd9f900 service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:03.253691 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1448/2879] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:20:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:20:04.769043 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e83c0c-2ba1-4b0b-8e15-d644ac07669c None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:04.770664 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-74e83c0c-2ba1-4b0b-8e15-d644ac07669c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:04.783213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e83c0c-2ba1-4b0b-8e15-d644ac07669c None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:04.787485 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb186003-9928-40a4-b45d-0ba3073bb193 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:04.788168 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb186003-9928-40a4-b45d-0ba3073bb193 service cinder] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:04.788450 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb186003-9928-40a4-b45d-0ba3073bb193 service cinder] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:04.788722 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb186003-9928-40a4-b45d-0ba3073bb193 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:04.853385 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb186003-9928-40a4-b45d-0ba3073bb193 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:04.854852 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb186003-9928-40a4-b45d-0ba3073bb193 service cinder] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:04.864262 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1432/2880] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:20:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:20:05.418829 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d22f3-b49d-42e0-a2ff-0273fcd9f900 service cinder] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:05.428642 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d22f3-b49d-42e0-a2ff-0273fcd9f900 service cinder] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:05.433293 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b16b1a-a0f4-45fc-99ab-03bf66aaf61e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:05.434009 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b16b1a-a0f4-45fc-99ab-03bf66aaf61e service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:05.434731 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b16b1a-a0f4-45fc-99ab-03bf66aaf61e service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:05.435012 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b16b1a-a0f4-45fc-99ab-03bf66aaf61e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:05.445267 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b16b1a-a0f4-45fc-99ab-03bf66aaf61e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:05.446732 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b16b1a-a0f4-45fc-99ab-03bf66aaf61e service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:05.457119 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1449/2881] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:20:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:20:09.370156 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb186003-9928-40a4-b45d-0ba3073bb193 service cinder] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:09.447449 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb186003-9928-40a4-b45d-0ba3073bb193 service cinder] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:09.455784 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acaff19-6722-41dd-8f57-e089774890d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:09.456673 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acaff19-6722-41dd-8f57-e089774890d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:09.456962 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acaff19-6722-41dd-8f57-e089774890d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:09.457229 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acaff19-6722-41dd-8f57-e089774890d5 admin admin] PATH_INFO: `/v3/users/2330a29e83f34c2781fc4ebfe17ee79e` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:09.458542 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acaff19-6722-41dd-8f57-e089774890d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2330a29e83f34c2781fc4ebfe17ee79e)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:09.460558 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acaff19-6722-41dd-8f57-e089774890d5 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:09.515290 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:20:09.518252 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-7acaff19-6722-41dd-8f57-e089774890d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2330a29e83f34c2781fc4ebfe17ee79e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:09.531318 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-7acaff19-6722-41dd-8f57-e089774890d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2330a29e83f34c2781fc4ebfe17ee79e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:09.538190 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-7acaff19-6722-41dd-8f57-e089774890d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2330a29e83f34c2781fc4ebfe17ee79e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:09.538880 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-7acaff19-6722-41dd-8f57-e089774890d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2330a29e83f34c2781fc4ebfe17ee79e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:09.549750 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-7acaff19-6722-41dd-8f57-e089774890d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2330a29e83f34c2781fc4ebfe17ee79e'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:09.556633 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1433/2882] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:20:09 2022] DELETE /identity/v3/users/2330a29e83f34c2781fc4ebfe17ee79e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:20:09.561409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4418c35-cd3f-49d7-8e6d-d254250d5e89 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:09.561893 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4418c35-cd3f-49d7-8e6d-d254250d5e89 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:09.561993 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4418c35-cd3f-49d7-8e6d-d254250d5e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:09.579888 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-f4418c35-cd3f-49d7-8e6d-d254250d5e89 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:20:09.581264 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-f4418c35-cd3f-49d7-8e6d-d254250d5e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:09.608109 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:20:09.643428 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1450/2883] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:20:09.653272 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acaff19-6722-41dd-8f57-e089774890d5 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:09.654773 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-7acaff19-6722-41dd-8f57-e089774890d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:09.715389 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acaff19-6722-41dd-8f57-e089774890d5 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:09.719937 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950ed7f-0f5f-4ce0-8b45-4920b411e07f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:09.720685 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950ed7f-0f5f-4ce0-8b45-4920b411e07f service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:09.720959 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950ed7f-0f5f-4ce0-8b45-4920b411e07f service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:09.721260 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950ed7f-0f5f-4ce0-8b45-4920b411e07f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:09.731251 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950ed7f-0f5f-4ce0-8b45-4920b411e07f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:09.732734 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950ed7f-0f5f-4ce0-8b45-4920b411e07f service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:09.742644 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1434/2884] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:20:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:20:10.028583 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4418c35-cd3f-49d7-8e6d-d254250d5e89 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:10.030110 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-f4418c35-cd3f-49d7-8e6d-d254250d5e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:10.045477 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4418c35-cd3f-49d7-8e6d-d254250d5e89 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:10.050894 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17c253-b39f-4cf8-9ca6-955fd8d6b399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:10.051812 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17c253-b39f-4cf8-9ca6-955fd8d6b399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:10.052114 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17c253-b39f-4cf8-9ca6-955fd8d6b399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:10.052367 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17c253-b39f-4cf8-9ca6-955fd8d6b399 admin admin] PATH_INFO: `/v3/projects/4aa7d8629f5c4ca8945bdf99cf165534` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:10.053560 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17c253-b39f-4cf8-9ca6-955fd8d6b399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aa7d8629f5c4ca8945bdf99cf165534)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:10.055515 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17c253-b39f-4cf8-9ca6-955fd8d6b399 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:10.104341 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-6a17c253-b39f-4cf8-9ca6-955fd8d6b399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aa7d8629f5c4ca8945bdf99cf165534', 'request_id': 'req-6a17c253-b39f-4cf8-9ca6-955fd8d6b399'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:10.110457 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-6a17c253-b39f-4cf8-9ca6-955fd8d6b399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aa7d8629f5c4ca8945bdf99cf165534', 'request_id': 'req-6a17c253-b39f-4cf8-9ca6-955fd8d6b399'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:10.120159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-6a17c253-b39f-4cf8-9ca6-955fd8d6b399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aa7d8629f5c4ca8945bdf99cf165534', 'request_id': 'req-6a17c253-b39f-4cf8-9ca6-955fd8d6b399'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:10.130542 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-6a17c253-b39f-4cf8-9ca6-955fd8d6b399 admin admin] The token cache is being invalidate because project 4aa7d8629f5c4ca8945bdf99cf165534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:20:10.130823 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-6a17c253-b39f-4cf8-9ca6-955fd8d6b399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:10.131484 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-6a17c253-b39f-4cf8-9ca6-955fd8d6b399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:10.133033 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1451/2885] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:20:10 2022] DELETE /identity/v3/projects/4aa7d8629f5c4ca8945bdf99cf165534 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:20:10.137079 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950ed7f-0f5f-4ce0-8b45-4920b411e07f service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:10.146769 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950ed7f-0f5f-4ce0-8b45-4920b411e07f service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:10.204201 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08d2b6-2410-497d-b749-f2552ed6eb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:10.205229 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08d2b6-2410-497d-b749-f2552ed6eb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:10.205519 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08d2b6-2410-497d-b749-f2552ed6eb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:10.205792 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08d2b6-2410-497d-b749-f2552ed6eb34 admin admin] PATH_INFO: `/v3/users/f364ac5417604912b3fea49685f74cdd` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:10.207056 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08d2b6-2410-497d-b749-f2552ed6eb34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f364ac5417604912b3fea49685f74cdd)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:10.209038 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08d2b6-2410-497d-b749-f2552ed6eb34 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:10.262234 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3f08d2b6-2410-497d-b749-f2552ed6eb34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f364ac5417604912b3fea49685f74cdd'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:10.277511 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3f08d2b6-2410-497d-b749-f2552ed6eb34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f364ac5417604912b3fea49685f74cdd'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:10.278715 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:20:10.287219 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3f08d2b6-2410-497d-b749-f2552ed6eb34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f364ac5417604912b3fea49685f74cdd'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:10.288218 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3f08d2b6-2410-497d-b749-f2552ed6eb34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f364ac5417604912b3fea49685f74cdd'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:10.300067 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3f08d2b6-2410-497d-b749-f2552ed6eb34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f364ac5417604912b3fea49685f74cdd'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:10.306533 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1435/2886] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:20:10 2022] DELETE /identity/v3/users/f364ac5417604912b3fea49685f74cdd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:20:10.586310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17c253-b39f-4cf8-9ca6-955fd8d6b399 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:10.587872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-6a17c253-b39f-4cf8-9ca6-955fd8d6b399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:10.604516 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17c253-b39f-4cf8-9ca6-955fd8d6b399 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:10.666660 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6177a09-cce6-49c9-88ca-fdde9182d23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:10.667444 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6177a09-cce6-49c9-88ca-fdde9182d23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:10.667744 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6177a09-cce6-49c9-88ca-fdde9182d23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:10.668016 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6177a09-cce6-49c9-88ca-fdde9182d23b admin admin] PATH_INFO: `/v3/projects/8a9c15e981ae4178b9447e7c29408087` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:10.669272 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6177a09-cce6-49c9-88ca-fdde9182d23b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a9c15e981ae4178b9447e7c29408087)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:10.671673 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6177a09-cce6-49c9-88ca-fdde9182d23b admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:10.726005 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-c6177a09-cce6-49c9-88ca-fdde9182d23b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a9c15e981ae4178b9447e7c29408087', 'request_id': 'req-c6177a09-cce6-49c9-88ca-fdde9182d23b'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:10.732953 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-c6177a09-cce6-49c9-88ca-fdde9182d23b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a9c15e981ae4178b9447e7c29408087', 'request_id': 'req-c6177a09-cce6-49c9-88ca-fdde9182d23b'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:10.735832 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:20:10.744102 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-c6177a09-cce6-49c9-88ca-fdde9182d23b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a9c15e981ae4178b9447e7c29408087', 'request_id': 'req-c6177a09-cce6-49c9-88ca-fdde9182d23b'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:10.757703 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-c6177a09-cce6-49c9-88ca-fdde9182d23b admin admin] The token cache is being invalidate because project 8a9c15e981ae4178b9447e7c29408087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:20:10.758199 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-c6177a09-cce6-49c9-88ca-fdde9182d23b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:10.758897 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-c6177a09-cce6-49c9-88ca-fdde9182d23b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:10.760836 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1452/2887] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:20:10 2022] DELETE /identity/v3/projects/8a9c15e981ae4178b9447e7c29408087 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:20:10.764843 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08d2b6-2410-497d-b749-f2552ed6eb34 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:10.766349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-3f08d2b6-2410-497d-b749-f2552ed6eb34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:10.780276 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08d2b6-2410-497d-b749-f2552ed6eb34 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:10.842057 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c8371-43d8-44a1-b76d-e0841a901b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:10.842960 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c8371-43d8-44a1-b76d-e0841a901b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:10.843236 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c8371-43d8-44a1-b76d-e0841a901b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:10.843549 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c8371-43d8-44a1-b76d-e0841a901b6e admin admin] PATH_INFO: `/v3/users/096645a34da64b07ba17e27c0e2be816` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:10.844775 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c8371-43d8-44a1-b76d-e0841a901b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=096645a34da64b07ba17e27c0e2be816)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:10.846812 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c8371-43d8-44a1-b76d-e0841a901b6e admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:10.895728 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-bf3c8371-43d8-44a1-b76d-e0841a901b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '096645a34da64b07ba17e27c0e2be816'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:10.908444 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-bf3c8371-43d8-44a1-b76d-e0841a901b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '096645a34da64b07ba17e27c0e2be816'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:10.915840 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-bf3c8371-43d8-44a1-b76d-e0841a901b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '096645a34da64b07ba17e27c0e2be816'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:10.916599 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-bf3c8371-43d8-44a1-b76d-e0841a901b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '096645a34da64b07ba17e27c0e2be816'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:10.925217 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-bf3c8371-43d8-44a1-b76d-e0841a901b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '096645a34da64b07ba17e27c0e2be816'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:10.931821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1436/2888] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:20:10 2022] DELETE /identity/v3/users/096645a34da64b07ba17e27c0e2be816 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:20:11.216300 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6177a09-cce6-49c9-88ca-fdde9182d23b admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:11.218091 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-c6177a09-cce6-49c9-88ca-fdde9182d23b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:11.237571 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6177a09-cce6-49c9-88ca-fdde9182d23b admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:11.302697 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47e0d3-58be-4673-808a-bba01a75af09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:11.303622 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47e0d3-58be-4673-808a-bba01a75af09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:11.303888 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47e0d3-58be-4673-808a-bba01a75af09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:11.304157 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47e0d3-58be-4673-808a-bba01a75af09 admin admin] PATH_INFO: `/v3/projects/ac591a0309454322b1d20e0ec4021cf0` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:11.305375 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47e0d3-58be-4673-808a-bba01a75af09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac591a0309454322b1d20e0ec4021cf0)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:11.307308 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47e0d3-58be-4673-808a-bba01a75af09 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:11.356174 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-cc47e0d3-58be-4673-808a-bba01a75af09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac591a0309454322b1d20e0ec4021cf0', 'request_id': 'req-cc47e0d3-58be-4673-808a-bba01a75af09'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:11.362880 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-cc47e0d3-58be-4673-808a-bba01a75af09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac591a0309454322b1d20e0ec4021cf0', 'request_id': 'req-cc47e0d3-58be-4673-808a-bba01a75af09'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:11.373907 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-cc47e0d3-58be-4673-808a-bba01a75af09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac591a0309454322b1d20e0ec4021cf0', 'request_id': 'req-cc47e0d3-58be-4673-808a-bba01a75af09'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:11.384350 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-cc47e0d3-58be-4673-808a-bba01a75af09 admin admin] The token cache is being invalidate because project ac591a0309454322b1d20e0ec4021cf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:20:11.384630 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-cc47e0d3-58be-4673-808a-bba01a75af09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:11.385241 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-cc47e0d3-58be-4673-808a-bba01a75af09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:11.386777 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1453/2889] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:20:11 2022] DELETE /identity/v3/projects/ac591a0309454322b1d20e0ec4021cf0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:20:11.391918 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03375410-68a3-4d29-8f93-5325b9d31dad None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:11.392215 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03375410-68a3-4d29-8f93-5325b9d31dad None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:11.392559 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03375410-68a3-4d29-8f93-5325b9d31dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:11.411506 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-03375410-68a3-4d29-8f93-5325b9d31dad None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:20:11.412730 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-03375410-68a3-4d29-8f93-5325b9d31dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:11.474263 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1437/2890] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:20:11.482336 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6e752-5458-462f-b1ff-0dded9aa4c76 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:11.482717 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6e752-5458-462f-b1ff-0dded9aa4c76 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:11.483030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6e752-5458-462f-b1ff-0dded9aa4c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:11.502030 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-27e6e752-5458-462f-b1ff-0dded9aa4c76 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:20:11.503234 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-27e6e752-5458-462f-b1ff-0dded9aa4c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:11.511816 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1454/2891] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:20:11.516087 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03375410-68a3-4d29-8f93-5325b9d31dad None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:11.521146 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:20:11.526821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03375410-68a3-4d29-8f93-5325b9d31dad None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:11.532736 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26accb-a28c-436a-9750-fa2a6895031e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:11.533662 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26accb-a28c-436a-9750-fa2a6895031e admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:11.534107 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26accb-a28c-436a-9750-fa2a6895031e admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:11.534400 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26accb-a28c-436a-9750-fa2a6895031e admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:11.535349 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26accb-a28c-436a-9750-fa2a6895031e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:20:11.535688 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26accb-a28c-436a-9750-fa2a6895031e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:11.537320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26accb-a28c-436a-9750-fa2a6895031e admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:11.549567 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1438/2892] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 02:20:11.554185 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6e752-5458-462f-b1ff-0dded9aa4c76 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:11.563970 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6e752-5458-462f-b1ff-0dded9aa4c76 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:11.569128 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f4ed3-bf4e-4e5b-ad23-6dc1ddfc3c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:11.569777 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f4ed3-bf4e-4e5b-ad23-6dc1ddfc3c34 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:11.570057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f4ed3-bf4e-4e5b-ad23-6dc1ddfc3c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:11.570328 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f4ed3-bf4e-4e5b-ad23-6dc1ddfc3c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:11.571011 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f4ed3-bf4e-4e5b-ad23-6dc1ddfc3c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:11.572963 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f4ed3-bf4e-4e5b-ad23-6dc1ddfc3c34 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:11.602003 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1455/2893] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:20:11 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:20:11.606716 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26accb-a28c-436a-9750-fa2a6895031e admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:11.620167 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26accb-a28c-436a-9750-fa2a6895031e admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:11.695672 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626b806-3ea6-4eda-b9ea-59e497a74cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:11.696354 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626b806-3ea6-4eda-b9ea-59e497a74cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:11.696661 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626b806-3ea6-4eda-b9ea-59e497a74cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:11.696917 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626b806-3ea6-4eda-b9ea-59e497a74cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:11.697609 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626b806-3ea6-4eda-b9ea-59e497a74cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:11.699586 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626b806-3ea6-4eda-b9ea-59e497a74cf4 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:11.721712 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1439/2894] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:20:11 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:20:11.726051 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f4ed3-bf4e-4e5b-ad23-6dc1ddfc3c34 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:11.736786 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f4ed3-bf4e-4e5b-ad23-6dc1ddfc3c34 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:11.742310 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1edd44-78b4-4593-8bc6-232dffb80c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:11.742979 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1edd44-78b4-4593-8bc6-232dffb80c0d admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:11.743265 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1edd44-78b4-4593-8bc6-232dffb80c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:11.743586 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1edd44-78b4-4593-8bc6-232dffb80c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:11.744324 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1edd44-78b4-4593-8bc6-232dffb80c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:11.745950 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1edd44-78b4-4593-8bc6-232dffb80c0d admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:11.756822 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1456/2895] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:20:11.762018 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626b806-3ea6-4eda-b9ea-59e497a74cf4 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:11.772442 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626b806-3ea6-4eda-b9ea-59e497a74cf4 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:11.777507 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cd43e-55a8-49c2-a8f3-608e4689b2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:11.778173 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cd43e-55a8-49c2-a8f3-608e4689b2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:11.778459 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cd43e-55a8-49c2-a8f3-608e4689b2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:11.778740 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cd43e-55a8-49c2-a8f3-608e4689b2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:11.779497 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cd43e-55a8-49c2-a8f3-608e4689b2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:11.781106 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cd43e-55a8-49c2-a8f3-608e4689b2d1 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:11.791288 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1440/2896] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:20:11.795803 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1edd44-78b4-4593-8bc6-232dffb80c0d admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:11.806398 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1edd44-78b4-4593-8bc6-232dffb80c0d admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:11.811937 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8afdb0-9e1a-4b33-bf9c-e8c6cdcc37e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:11.812820 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8afdb0-9e1a-4b33-bf9c-e8c6cdcc37e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:11.813101 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8afdb0-9e1a-4b33-bf9c-e8c6cdcc37e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:11.813374 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8afdb0-9e1a-4b33-bf9c-e8c6cdcc37e1 admin admin] PATH_INFO: `/v3/projects/e72b544a56634450a9b4cf88d39eb1de/users/7b032bc8bf084cb5afc61894b6332235/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:11.829376 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8afdb0-9e1a-4b33-bf9c-e8c6cdcc37e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e72b544a56634450a9b4cf88d39eb1de, user_id=7b032bc8bf084cb5afc61894b6332235, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:11.832228 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8afdb0-9e1a-4b33-bf9c-e8c6cdcc37e1 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:11.849175 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1457/2897] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:20:11 2022] PUT /identity/v3/projects/e72b544a56634450a9b4cf88d39eb1de/users/7b032bc8bf084cb5afc61894b6332235/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:20:11.859822 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bf9c5-a738-41b4-aaf1-2652224f2db4 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:11.860115 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bf9c5-a738-41b4-aaf1-2652224f2db4 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:11.860418 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bf9c5-a738-41b4-aaf1-2652224f2db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:11.888984 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-b92bf9c5-a738-41b4-aaf1-2652224f2db4 None None] MFA Rules not processed for user `7b032bc8bf084cb5afc61894b6332235`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:20:11.890290 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-b92bf9c5-a738-41b4-aaf1-2652224f2db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:11.956818 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1441/2898] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:20:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:20:11.969121 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8afdb0-9e1a-4b33-bf9c-e8c6cdcc37e1 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:11.971282 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-6e8afdb0-9e1a-4b33-bf9c-e8c6cdcc37e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:11.985737 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:20:12.055253 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8afdb0-9e1a-4b33-bf9c-e8c6cdcc37e1 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:12.059331 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006a83b-1173-4798-aab4-9def15725383 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46aba36939c549278bcdee7a04511e27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:12.060023 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006a83b-1173-4798-aab4-9def15725383 service glance] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:12.060305 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006a83b-1173-4798-aab4-9def15725383 service glance] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:12.060581 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006a83b-1173-4798-aab4-9def15725383 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:12.069608 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006a83b-1173-4798-aab4-9def15725383 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:12.071063 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006a83b-1173-4798-aab4-9def15725383 service glance] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:12.080108 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1458/2899] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:20:11 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:20:21.953714 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=71,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:20:22.076020 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=30 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:20:40.301320 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bf9c5-a738-41b4-aaf1-2652224f2db4 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:40.369813 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bf9c5-a738-41b4-aaf1-2652224f2db4 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:40.379055 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e0b50-722d-4df3-9f43-3a7ea7fedaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:40.380489 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e0b50-722d-4df3-9f43-3a7ea7fedaf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:40.380902 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e0b50-722d-4df3-9f43-3a7ea7fedaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:40.381275 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e0b50-722d-4df3-9f43-3a7ea7fedaf6 admin admin] PATH_INFO: `/v3/users/7b032bc8bf084cb5afc61894b6332235` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:40.383310 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e0b50-722d-4df3-9f43-3a7ea7fedaf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b032bc8bf084cb5afc61894b6332235)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:40.385316 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e0b50-722d-4df3-9f43-3a7ea7fedaf6 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:40.437919 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-757e0b50-722d-4df3-9f43-3a7ea7fedaf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b032bc8bf084cb5afc61894b6332235'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:40.449900 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-757e0b50-722d-4df3-9f43-3a7ea7fedaf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b032bc8bf084cb5afc61894b6332235'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:40.457059 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-757e0b50-722d-4df3-9f43-3a7ea7fedaf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b032bc8bf084cb5afc61894b6332235'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:40.457770 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-757e0b50-722d-4df3-9f43-3a7ea7fedaf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b032bc8bf084cb5afc61894b6332235'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:40.467130 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-757e0b50-722d-4df3-9f43-3a7ea7fedaf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b032bc8bf084cb5afc61894b6332235'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:40.473405 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1442/2900] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:20:40 2022] DELETE /identity/v3/users/7b032bc8bf084cb5afc61894b6332235 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:20:40.478139 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5bf32-8fec-4282-85fc-512a143099df None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:40.478657 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5bf32-8fec-4282-85fc-512a143099df None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:40.478810 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5bf32-8fec-4282-85fc-512a143099df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:40.496726 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-31b5bf32-8fec-4282-85fc-512a143099df None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:20:40.497946 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-31b5bf32-8fec-4282-85fc-512a143099df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:40.573010 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1459/2901] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:20:40.582838 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e0b50-722d-4df3-9f43-3a7ea7fedaf6 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:40.584496 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-757e0b50-722d-4df3-9f43-3a7ea7fedaf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:40.660661 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e0b50-722d-4df3-9f43-3a7ea7fedaf6 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:40.665618 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6123daa-13eb-4d8e-80b8-a37c9e9ecb7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:40.666283 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6123daa-13eb-4d8e-80b8-a37c9e9ecb7d service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:40.666577 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6123daa-13eb-4d8e-80b8-a37c9e9ecb7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:40.666852 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6123daa-13eb-4d8e-80b8-a37c9e9ecb7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:40.679313 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6123daa-13eb-4d8e-80b8-a37c9e9ecb7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:40.681113 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6123daa-13eb-4d8e-80b8-a37c9e9ecb7d service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:40.691213 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1443/2902] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:20:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:20:40.978725 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5bf32-8fec-4282-85fc-512a143099df None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:40.980262 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-31b5bf32-8fec-4282-85fc-512a143099df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:40.992732 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5bf32-8fec-4282-85fc-512a143099df None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:40.997951 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb90160-8892-44de-b9d7-fbd4b1f95e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:40.998826 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb90160-8892-44de-b9d7-fbd4b1f95e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:40.999100 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb90160-8892-44de-b9d7-fbd4b1f95e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:40.999369 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb90160-8892-44de-b9d7-fbd4b1f95e90 admin admin] PATH_INFO: `/v3/projects/e72b544a56634450a9b4cf88d39eb1de` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:41.001393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb90160-8892-44de-b9d7-fbd4b1f95e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e72b544a56634450a9b4cf88d39eb1de)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:41.004033 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb90160-8892-44de-b9d7-fbd4b1f95e90 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:41.053239 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-ecb90160-8892-44de-b9d7-fbd4b1f95e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e72b544a56634450a9b4cf88d39eb1de', 'request_id': 'req-ecb90160-8892-44de-b9d7-fbd4b1f95e90'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:41.059393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-ecb90160-8892-44de-b9d7-fbd4b1f95e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e72b544a56634450a9b4cf88d39eb1de', 'request_id': 'req-ecb90160-8892-44de-b9d7-fbd4b1f95e90'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:41.068812 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-ecb90160-8892-44de-b9d7-fbd4b1f95e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e72b544a56634450a9b4cf88d39eb1de', 'request_id': 'req-ecb90160-8892-44de-b9d7-fbd4b1f95e90'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:41.080393 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-ecb90160-8892-44de-b9d7-fbd4b1f95e90 admin admin] The token cache is being invalidate because project e72b544a56634450a9b4cf88d39eb1de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:20:41.080680 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-ecb90160-8892-44de-b9d7-fbd4b1f95e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:41.081404 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-ecb90160-8892-44de-b9d7-fbd4b1f95e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:41.083057 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1460/2903] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:20:40 2022] DELETE /identity/v3/projects/e72b544a56634450a9b4cf88d39eb1de => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:20:41.088364 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcbdf0-33ac-4aeb-bc91-b30113f22079 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:41.088600 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcbdf0-33ac-4aeb-bc91-b30113f22079 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:41.088874 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcbdf0-33ac-4aeb-bc91-b30113f22079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:41.107364 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-64fcbdf0-33ac-4aeb-bc91-b30113f22079 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:20:41.108607 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-64fcbdf0-33ac-4aeb-bc91-b30113f22079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:41.125854 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:20:41.176072 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1444/2904] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:20:41.184383 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9577b1e-25d9-451c-97f1-c4f88e05a688 None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:41.184669 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9577b1e-25d9-451c-97f1-c4f88e05a688 None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:41.184942 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9577b1e-25d9-451c-97f1-c4f88e05a688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:41.204782 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-c9577b1e-25d9-451c-97f1-c4f88e05a688 None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:20:41.205987 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-c9577b1e-25d9-451c-97f1-c4f88e05a688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:41.214936 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1461/2905] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:20:41.219536 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcbdf0-33ac-4aeb-bc91-b30113f22079 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:41.229946 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcbdf0-33ac-4aeb-bc91-b30113f22079 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:41.235889 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b550c4d-e16a-4944-9338-2ae3cd2a0c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:41.236554 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b550c4d-e16a-4944-9338-2ae3cd2a0c88 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:41.236832 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b550c4d-e16a-4944-9338-2ae3cd2a0c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:41.237100 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b550c4d-e16a-4944-9338-2ae3cd2a0c88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:41.237821 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b550c4d-e16a-4944-9338-2ae3cd2a0c88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 02:20:41.238122 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b550c4d-e16a-4944-9338-2ae3cd2a0c88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:41.239783 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b550c4d-e16a-4944-9338-2ae3cd2a0c88 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:41.251998 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1445/2906] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 23 02:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 02:20:41.256423 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9577b1e-25d9-451c-97f1-c4f88e05a688 None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:41.266360 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9577b1e-25d9-451c-97f1-c4f88e05a688 None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:41.272309 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e91ca-4fa8-4354-b75c-1bb217e14a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:41.272962 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e91ca-4fa8-4354-b75c-1bb217e14a48 admin admin] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:41.273235 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e91ca-4fa8-4354-b75c-1bb217e14a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:41.273666 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e91ca-4fa8-4354-b75c-1bb217e14a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:41.274537 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e91ca-4fa8-4354-b75c-1bb217e14a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:41.276521 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e91ca-4fa8-4354-b75c-1bb217e14a48 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:41.315287 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1462/2907] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 23 02:20:41 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:20:41.320285 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b550c4d-e16a-4944-9338-2ae3cd2a0c88 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:41.336177 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b550c4d-e16a-4944-9338-2ae3cd2a0c88 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:41.391527 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac213f-e595-4609-887e-aa83cf46c9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:41.392113 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac213f-e595-4609-887e-aa83cf46c9dc admin admin] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:41.392393 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac213f-e595-4609-887e-aa83cf46c9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:41.392670 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac213f-e595-4609-887e-aa83cf46c9dc admin admin] PATH_INFO: `/v3/users` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:41.393358 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac213f-e595-4609-887e-aa83cf46c9dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:41.395269 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac213f-e595-4609-887e-aa83cf46c9dc admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:41.423725 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1446/2908] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 23 02:20:41 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 02:20:41.427985 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e91ca-4fa8-4354-b75c-1bb217e14a48 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:41.438732 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e91ca-4fa8-4354-b75c-1bb217e14a48 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:41.444443 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f8685-791e-4199-be29-45881cfe5e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:41.445214 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f8685-791e-4199-be29-45881cfe5e24 admin admin] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:41.445489 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f8685-791e-4199-be29-45881cfe5e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:41.445758 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f8685-791e-4199-be29-45881cfe5e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:41.446704 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f8685-791e-4199-be29-45881cfe5e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:41.448388 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f8685-791e-4199-be29-45881cfe5e24 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:41.458799 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1463/2909] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 02:20:41.463072 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac213f-e595-4609-887e-aa83cf46c9dc admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:41.473131 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac213f-e595-4609-887e-aa83cf46c9dc admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:41.478218 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c223c-7358-47a4-9a93-9162666a8289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:41.478876 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c223c-7358-47a4-9a93-9162666a8289 admin admin] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:41.479155 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c223c-7358-47a4-9a93-9162666a8289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:41.479445 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c223c-7358-47a4-9a93-9162666a8289 admin admin] PATH_INFO: `/v3/roles` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:41.480168 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c223c-7358-47a4-9a93-9162666a8289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:41.481755 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c223c-7358-47a4-9a93-9162666a8289 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:41.491833 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1447/2910] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 23 02:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 02:20:41.496409 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f8685-791e-4199-be29-45881cfe5e24 admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:41.506578 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f8685-791e-4199-be29-45881cfe5e24 admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:41.511736 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2f70c-ed7d-467f-adf0-91e69dc4b14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:41.512623 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2f70c-ed7d-467f-adf0-91e69dc4b14b admin admin] REQUEST_METHOD: `PUT` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:41.512901 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2f70c-ed7d-467f-adf0-91e69dc4b14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:41.513195 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2f70c-ed7d-467f-adf0-91e69dc4b14b admin admin] PATH_INFO: `/v3/projects/7db596650ed54d0daa02f349134201ac/users/6a74618b83904ba1affe43da8628ff3b/roles/51b1227b19794e6fb73ae32c4d0165fb` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:41.528256 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2f70c-ed7d-467f-adf0-91e69dc4b14b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7db596650ed54d0daa02f349134201ac, user_id=6a74618b83904ba1affe43da8628ff3b, role_id=51b1227b19794e6fb73ae32c4d0165fb)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:41.530932 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2f70c-ed7d-467f-adf0-91e69dc4b14b admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:41.546325 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1464/2911] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 23 02:20:41 2022] PUT /identity/v3/projects/7db596650ed54d0daa02f349134201ac/users/6a74618b83904ba1affe43da8628ff3b/roles/51b1227b19794e6fb73ae32c4d0165fb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:20:41.556624 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3278640-a5aa-46aa-b45a-03b143bab713 None None] REQUEST_METHOD: `POST` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:41.556914 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3278640-a5aa-46aa-b45a-03b143bab713 None None] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:41.557188 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3278640-a5aa-46aa-b45a-03b143bab713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:41.584721 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.auth.core [None req-c3278640-a5aa-46aa-b45a-03b143bab713 None None] MFA Rules not processed for user `6a74618b83904ba1affe43da8628ff3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:20:41.586054 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-c3278640-a5aa-46aa-b45a-03b143bab713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:41.656890 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1448/2912] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:20:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:20:41.668227 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2f70c-ed7d-467f-adf0-91e69dc4b14b admin admin] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:41.670617 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-a1c2f70c-ed7d-467f-adf0-91e69dc4b14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:41.684973 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:20:41.754931 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2f70c-ed7d-467f-adf0-91e69dc4b14b admin admin] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:41.760211 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02c46c-723c-44d6-a355-fc9bbbc565aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '883b947de43d4779b5f95103775430c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:41.760868 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02c46c-723c-44d6-a355-fc9bbbc565aa service cinder] REQUEST_METHOD: `GET` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:41.761153 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02c46c-723c-44d6-a355-fc9bbbc565aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:41.761431 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02c46c-723c-44d6-a355-fc9bbbc565aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:41.770391 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02c46c-723c-44d6-a355-fc9bbbc565aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:41.771883 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02c46c-723c-44d6-a355-fc9bbbc565aa service cinder] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:41.780872 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1465/2913] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:20:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:20:41.808726 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3278640-a5aa-46aa-b45a-03b143bab713 None None] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:41.829749 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:20:41.881594 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3278640-a5aa-46aa-b45a-03b143bab713 None None] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:41.887536 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754f832-21d2-4b1b-ae4d-6b6c139bd219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:41.888428 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754f832-21d2-4b1b-ae4d-6b6c139bd219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:41.888706 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754f832-21d2-4b1b-ae4d-6b6c139bd219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:41.888981 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754f832-21d2-4b1b-ae4d-6b6c139bd219 admin admin] PATH_INFO: `/v3/users/6a74618b83904ba1affe43da8628ff3b` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:41.890328 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754f832-21d2-4b1b-ae4d-6b6c139bd219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a74618b83904ba1affe43da8628ff3b)` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:41.892374 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754f832-21d2-4b1b-ae4d-6b6c139bd219 admin admin] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:41.943824 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3754f832-21d2-4b1b-ae4d-6b6c139bd219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a74618b83904ba1affe43da8628ff3b'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:41.956514 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3754f832-21d2-4b1b-ae4d-6b6c139bd219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a74618b83904ba1affe43da8628ff3b'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:41.964216 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3754f832-21d2-4b1b-ae4d-6b6c139bd219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a74618b83904ba1affe43da8628ff3b'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:41.964911 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3754f832-21d2-4b1b-ae4d-6b6c139bd219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a74618b83904ba1affe43da8628ff3b'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:41.973812 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.notifications [None req-3754f832-21d2-4b1b-ae4d-6b6c139bd219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a74618b83904ba1affe43da8628ff3b'} {{(pid=80431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:41.979777 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1449/2914] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 23 02:20:41 2022] DELETE /identity/v3/users/6a74618b83904ba1affe43da8628ff3b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:20:41.984345 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ef4f3-f8df-4ed8-ab15-e982f9d2a3aa None None] REQUEST_METHOD: `POST` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:41.984635 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ef4f3-f8df-4ed8-ab15-e982f9d2a3aa None None] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:41.984906 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ef4f3-f8df-4ed8-ab15-e982f9d2a3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:42.003922 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.auth.core [None req-2a7ef4f3-f8df-4ed8-ab15-e982f9d2a3aa None None] MFA Rules not processed for user `f8e0f94435f64c67b24912b3d4dbc165`. Rule list: `[]` (Enabled: `True`). {{(pid=80430) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 02:20:42.005159 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-2a7ef4f3-f8df-4ed8-ab15-e982f9d2a3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:42.065384 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1466/2915] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 23 02:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 02:20:42.075271 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754f832-21d2-4b1b-ae4d-6b6c139bd219 admin admin] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:42.076850 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-3754f832-21d2-4b1b-ae4d-6b6c139bd219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:42.146625 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754f832-21d2-4b1b-ae4d-6b6c139bd219 admin admin] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:42.151443 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3575b-22cd-4d2c-86b6-d8053654633b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cda12550db1442ab04f30b9875fdbea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:42.152109 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3575b-22cd-4d2c-86b6-d8053654633b service neutron] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:42.152401 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3575b-22cd-4d2c-86b6-d8053654633b service neutron] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:42.152675 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3575b-22cd-4d2c-86b6-d8053654633b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:42.162199 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3575b-22cd-4d2c-86b6-d8053654633b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:42.163675 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3575b-22cd-4d2c-86b6-d8053654633b service neutron] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:42.174096 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1450/2916] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:20:42.467503 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ef4f3-f8df-4ed8-ab15-e982f9d2a3aa None None] Authenticating user token {{(pid=80430) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:20:42.469188 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.fernet_utils [None req-2a7ef4f3-f8df-4ed8-ab15-e982f9d2a3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80430) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:20:42.482489 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ef4f3-f8df-4ed8-ab15-e982f9d2a3aa None None] Validating token access rules against request {{(pid=80430) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:20:42.488292 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79372ca8-5ea7-45d8-8c93-184843c92a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e0f94435f64c67b24912b3d4dbc165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c1562009fe043679c20e065b5b0b463', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80430) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:20:42.489345 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79372ca8-5ea7-45d8-8c93-184843c92a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:20:42.489760 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79372ca8-5ea7-45d8-8c93-184843c92a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:20:42.489870 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79372ca8-5ea7-45d8-8c93-184843c92a35 admin admin] PATH_INFO: `/v3/projects/7db596650ed54d0daa02f349134201ac` {{(pid=80430) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:20:42.491152 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79372ca8-5ea7-45d8-8c93-184843c92a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7db596650ed54d0daa02f349134201ac)` {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:20:42.493224 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79372ca8-5ea7-45d8-8c93-184843c92a35 admin admin] RBAC: Authorization granted {{(pid=80430) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:20:42.543044 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-79372ca8-5ea7-45d8-8c93-184843c92a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7db596650ed54d0daa02f349134201ac', 'request_id': 'req-79372ca8-5ea7-45d8-8c93-184843c92a35'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:42.549581 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-79372ca8-5ea7-45d8-8c93-184843c92a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7db596650ed54d0daa02f349134201ac', 'request_id': 'req-79372ca8-5ea7-45d8-8c93-184843c92a35'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:42.559285 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-79372ca8-5ea7-45d8-8c93-184843c92a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7db596650ed54d0daa02f349134201ac', 'request_id': 'req-79372ca8-5ea7-45d8-8c93-184843c92a35'} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:42.570049 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-79372ca8-5ea7-45d8-8c93-184843c92a35 admin admin] The token cache is being invalidate because project 7db596650ed54d0daa02f349134201ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80430) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 02:20:42.570337 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-79372ca8-5ea7-45d8-8c93-184843c92a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:42.570995 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG keystone.notifications [None req-79372ca8-5ea7-45d8-8c93-184843c92a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80430) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 02:20:42.572730 dv-cinder-815582-9-smb devstack@keystone.service[80430]: [pid: 80430|app: 0|req: 1467/2917] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 23 02:20:42 2022] DELETE /identity/v3/projects/7db596650ed54d0daa02f349134201ac => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 02:20:52.169416 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:20:52.567258 dv-cinder-815582-9-smb devstack@keystone.service[80430]: DEBUG dbcounter [-] [80430] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 02:23:18.136421 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3575b-22cd-4d2c-86b6-d8053654633b service neutron] Authenticating user token {{(pid=80431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 02:23:18.138069 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-dbf3575b-22cd-4d2c-86b6-d8053654633b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:23:18.213295 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3575b-22cd-4d2c-86b6-d8053654633b service neutron] Validating token access rules against request {{(pid=80431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 02:23:18.276210 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090f1ab-e6fb-41ca-a7bd-b7432a4351f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9756f5b9de8a4f23b365a96d309d86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f3b06be1b5a4b3a8235ebf22da2a018', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 02:23:18.276910 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090f1ab-e6fb-41ca-a7bd-b7432a4351f8 service placement] REQUEST_METHOD: `GET` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 02:23:18.277194 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090f1ab-e6fb-41ca-a7bd-b7432a4351f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 02:23:18.277470 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090f1ab-e6fb-41ca-a7bd-b7432a4351f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 02:23:18.279316 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.fernet_utils [None req-a090f1ab-e6fb-41ca-a7bd-b7432a4351f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 02:23:18.290968 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090f1ab-e6fb-41ca-a7bd-b7432a4351f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 02:23:18.292676 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090f1ab-e6fb-41ca-a7bd-b7432a4351f8 service placement] RBAC: Authorization granted {{(pid=80431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 02:23:18.303208 dv-cinder-815582-9-smb devstack@keystone.service[80431]: [pid: 80431|app: 0|req: 1451/2918] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 23 02:23:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 02:23:28.299034 dv-cinder-815582-9-smb devstack@keystone.service[80431]: DEBUG dbcounter [-] [80431] Writing DB stats keystone:SELECT=58 {{(pid=80431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}